IDT
Technology DW
SeniorDataEngineer(withAI/MLexperience)
Neural analysis suggests this role is
optimal for Senior candidates.
“Senior Data Engineer (with AI/ML experience) at IDT. Skills: Data Pipelines, ETL/ELT, AI/ML Workflows, LLM Integration. Design, develop, and maintain scalable data pipelines. Design, optimize, and maintain robust ETL/ELT pipelines”
What You'll Achieve.
Enable advanced search and retrieval patterns; Deliver natural language query experience; Deliver AI-backed insights; Power conversational interfaces; Support retrieval-augmented generation (RAG) workflows; Drive corporate profitability by enabling data-driven decision-making; Provide strategic insights
Industry & Context.
What They're Looking For.
Must Have
6-7+ years of experience in building scalable data infrastructure, 1-2 years of hands-on exposure to AI/ML workflows, Excellent English communication skills, Hands-on experience with big data technologies including Apache Spark, Hadoop, and Kafka, Experience designing complex data pipelines, Demonstrated skills in SQL and PLSQL programming, Advanced mastery in Business Intelligence and data warehouse methodologies, Hands-on experience in one or more relational database systems, Hands-on experience in cloud-based database services such as Snowflake/Redshift, Effective oral and written communication skills, Demonstrated experience in utilizing python for data engineering tasks, Deep understanding of vector databases and RAG architectures, Skilled at integrating open-source LLM frameworks into data engineering workflows, Experience with cloud platforms like AWS or Azure Machine Learning, Understanding of software engineering principles, Skills working on Unix/Linux/Windows Operating systems, Experience with Agile methodologies, Proficiency in version control systems, Interest in business operations, Comprehensive understanding of how robust BI systems drive corporate profitability
Nice to Have
Experience with vector databases such as DataStax AstraDB, Developing LLM-powered applications using popular open source frameworks like LangChain and LlamaIndex, Prompt engineering, Retrieval-augmented generation (RAG), Orchestration of intelligent workflows, Evaluating and integrating open-source LLM frameworks–such as Hugging Face Transformers/LLaMA-4, Fine-tuning, Inference optimization, Knowledge of MLOps tooling, CI/CD pipelines to manage model versioning and automated deployments
What You'll Do.
and maintain scalable data pipelines
and maintain robust ETL/ELT pipelines
Build and optimize workflows for unstructured data
Architect and implement analytics and dashboarding solutions
Define and execute processes for prompt engineering
Oversee vector data stores
Develop efficient indexing methodologies
Gather requirements for language-model initiatives
Translate requirements into scalable solutions
Create and maintain documentation for data processes
Stay informed and learn emerging methodologies
How You'll Work.
Team & Collaboration
Partner with data stakeholders to gather requirements; Collaborating within a distributed development environment
Communication Scope
Excellent English communication skills; Effective oral and written communication skills
Process & Methodology
Agile methodologies
Full Job Description
## Description IDT (www.idt.net) is a communications and financial services company founded in 1990 and headquartered in New Jersey, US. Today it is an industry leader in prepaid communication and payment services and one of the world’s largest international voice carriers. We are listed on the NYSE, employ over 1700 people across 20+ countries, and have revenues in excess of $1.5 billion. We are looking for a skilled Senior Data Engineer (with AI/ML exposure) to join our BI team and take an active role in designing, building, and maintaining the end-to-end data pipeline, architecture and design that powers our warehouse, LLM-driven applications, and AI-based BI. If you're looking for a company that will give you the maximum flexibility in choosing a location to work, this opportunity is for you! * The interview process will be conducted in English. ## Responsibilities Design, develop, and maintain scalable data pipelines to support ingestion, transformation, and delivery into centralized feature stores, model-training workflows, and real-time inference services. Design, optimize, and maintain robust ETL/ELT pipelines and data structures within our cloud data warehouse (Snowflake/Redshift) to support core Business Intelligence. Build and optimize workflows for extracting, storing, and retrieving semantic representations of unstructured data to enable advanced search and retrieval patterns. Architect and implement lightweight analytics and dashboarding solutions that deliver natural language query experience and AI-backed insights. Define and execute processes for managing prompt engineering techniques, orchestration flows, and model fine-tuning routines to power conversational interfaces. Oversee vector data stores and develop efficient indexing methodologies to support retrieval-augmented generation (RAG) workflows. Partner with data stakeholders to gather requirements for language-model initiatives and translate into scalable solutions. Create and maintain com
Applying for this Senior Data Engineer (with AI/ML experience) role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Lever
- Lever uses a streamlined one-page form — apply in under 5 minutes.
- LinkedIn import works well; review parsed data before submitting.
- The cover letter field is optional but visible to reviewers — use it to differentiate.
- Referral codes from employees can significantly boost visibility of your application.
ANONYMOUS · UNFILTERED
What do employees actually say about IDT?
Real rants from real employees. Read before you apply.