OTR Solutions
Transportation
DataEngineer–ExternalDataIntegrations
Neural analysis suggests this role is
optimal for Mid candidates.
“Data Engineer – External Data Integrations at OTR Solutions. Skills: Data Engineering, Integration Engineering, Azure Synapse, Spark/Python. Design and build scalable batch ingestion pipelines. Develop outbound data pipelines”
What You'll Achieve.
Enable secure and reliable data exchange; Support automation, reporting, and business growth initiatives; Ensure pipeline reliability and SLA adherence; Continuously improve performance, reliability, and maintainability
Industry & Context.
Problem-solving skills; Troubleshooting complex distributed data workflows
We do not sponsor work visas
What They're Looking For.
Must Have
4–7+ years of experience in Data Engineering, Integration Engineering, or similar technical roles, experience designing and maintaining batch-oriented data pipelines at scale, Hands-on experience with Azure Synapse Analytics, Spark/Python, and Azure Logic Apps, Experience integrating with REST APIs, SFTP workflows, and external data providers, SQL skills with experience transforming and modeling large datasets, Understanding of data observability, monitoring, and reliability best practices, Experience designing secure integrations and implementing authentication mechanisms for external systems, problem-solving skills with experience troubleshooting complex distributed data workflows, Excellent communication skills with ability to work across technical and non-technical stakeholders, Experience working in Agile environments
Nice to Have
Experience with Azure Data Lake and Parquet or Delta file formats, Familiarity with Azure API Management (APIM), Experience implementing CI/CD pipelines using Azure DevOps, Knowledge of data governance, lineage, and metadata management concepts, Experience in FinTech, transportation, logistics, or other high-volume transactional environments
What You'll Do.
Design and build scalable batch ingestion pipelines
Develop outbound data pipelines
and optimize Azure Synapse pipelines
Orchestrate workflows using Azure Logic Apps
Design and implement data quality validation
Define and maintain schema standards
Build secure integrations with third-party systems
Partner with teams to define integration requirements
Troubleshoot complex integration issues
Identify opportunities to automate workflows
How You'll Work.
Team & Collaboration
Close collaboration with Engineering, Business Intelligence, and business stakeholders; Partner with Engineering, Product, and Business Intelligence teams; Ability to work across technical and non-technical stakeholders
Communication Scope
Excellent communication skills
Full Job Description
OTR Solutions is an innovator in the transportation industry providing a suite of factoring, fuel, and business management solutions. We help new and established companies get fast access to the funds they need for daily operations. As a Private Equity-backed FinTech company, we are scaling our technology and AI capabilities to deliver next-generation automation and document intelligence solutions for the freight and financial services industries. OTR has been recognized as a “Top Workplace” by the Atlanta Journal-Constitution since 2016! As a Data Engineer – External Data Integrations, you will design, build, and maintain scalable batch-oriented data pipelines that enable secure and reliable data exchange between OTR and external systems. You will play a key role in developing integrations with third-party platforms, supporting internal data operations, and ensuring data quality and observability across mission-critical workflows. This role combines data engineering and integration development, requiring close collaboration with Engineering, Business Intelligence, and business stakeholders to deliver scalable solutions that support automation, reporting, and business growth initiatives. Please note: We do not sponsor work-related visas.** Responsibilities: Design and build scalable batch ingestion pipelines from external systems, including APIs, SFTP sources, and databases Develop outbound data pipelines to securely publish structured data to external partners and third-party platforms Build, maintain, and optimize Azure Synapse pipelines and notebook-based transformations using PySpark and Spark SQL Orchestrate workflows using Azure Logic Apps, including scheduling, retries, monitoring, and alerting Design and implement data quality validation, observability, and monitoring frameworks to ensure pipeline reliability and SLA adherence Define and maintain schema standards, versioning strategies, and partner-facing data contracts Build secure integrations with third-p
Applying for this Data Engineer – External Data Integrations role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Greenhouse
- Create a Greenhouse profile before applying — it saves time across multiple applications.
- Upload your resume as a PDF; the parser handles it better than Word.
- Answer all knockout questions carefully — wrong answers auto-reject before a human sees you.
- Enable email notifications to track application status in real time.
ANONYMOUS · UNFILTERED
What do employees actually say about OTR Solutions?
Real rants from real employees. Read before you apply.