Annapurna Labs Ltd.

Software Development, Cloud Computing

SoftwareDevelopmentEngineer,MLSystemsIntegration,MachineLearningIsrael(MLIL)IntegrationValidation

$450–650k ~AI est. Tel Aviv-Yafo, Tel Aviv, Israel FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Senior candidates.

The Brief

“Software Development Engineer, ML Systems Integration, Machine Learning Israel (MLIL) — Integration Validation at Annapurna Labs Ltd.. Skills: ML Systems Integration, CI/CD, Test Frameworks, System Validation. Own and evolve CI/CD pipelines. Design and implement test frameworks”

What You'll Achieve.

Ensure components validated end-to-end; Raise the bar on engineering quality

Industry & Context.

Software Development, Cloud Computing
Problems you'll solve

Root cause analysis

What They're Looking For.

Must Have

Mentor, tech lead or leading an engineering team, Leading architecture and design of systems, Python or C++ programming, Programming with Java, C++, or C#, Object-oriented design, Building test automation frameworks, Designing and operating CI/CD systems, Early adopter of AI-assisted development tools, Linux systems knowledge

Nice to Have

Bachelor's degree in computer science, Experience with AWS Services, Experience with hardware/software integration, Experience with real-time systems, Familiarity with ML inference serving stacks, Knowledge of Amazon internal tooling, Experience with performance benchmarking, Experience with GPU/accelerator workloads, Track record of leading technical initiatives, Experience with fleet-scale operations

What You'll Do.

Own and evolve CI/CD pipelines

Design and implement test frameworks

Architect system-level test suites

Build and maintain performance benchmarking infrastructure

Drive integration of third-party vendor code

Participate in feature design reviews

Define and own Continuous Testing

Leverage AI-assisted development tools

How You'll Work.

Team & Collaboration

Work across the full stack; Work with hardware engineer; Join feature design review

Process & Methodology

Technical decisions

Full Job Description

Annapurna Labs designs silicon and software that accelerates innovation. Our custom chips, accelerators, and software stacks enable us to take on technical challenges that have never been seen before, and deliver results that help our customers change the world. The Integration team is looking for a Senior Software Development Engineer to lead the design and delivery of systems software for our next-generation ML accelerator servers.. In this role you will own the design and implementation of CI/CD pipelines, test frameworks, and system-level validation for our next-generation ML inference accelerator platform. You will work across the full stack — from firmware interfaces through data-plane performance benchmarking to production fleet readiness — ensuring every component is validated end-to-end before it reaches customers. This is a greenfield environment with rapidly growing scope: new silicon, new software stacks (vLLM, NKI, NIXL), and new fleet-scale challenges. We are looking for a senior IC who can independently drive technical decisions, scale our validation infrastructure, and raise the bar on engineering quality across the group. Key job responsibilities - Own and evolve CI/CD pipelines — from pre-merge gates through continuous deployment to fleet. - Design and implement test frameworks that enable firmware and data-plane developers to write, run, and maintain tests with minimal friction. - Architect system-level test suites that stress control-plane and data-plane components beyond provisioning and vetting flows. - Build and maintain performance benchmarking infrastructure for LLM inference workloads (Prefill + Decode), including dashboarding and regression detection. - Drive integration of third-party vendor code (nightly drops) into CI/CD, ensuring quality gates catch regressions early. - Participate in feature design reviews, contributing test plans and challenging coverage gaps. - Define and own Continuous Testing in production environments (CTS). - Le

Free ATS check

Applying for this Software Development Engineer, ML Systems Integration, Machine Learning Israel (MLIL) — Integration Validation role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

ANONYMOUS · UNFILTERED

What do employees actually say about Annapurna Labs Ltd.?

Real rants from real employees. Read before you apply.

Read Company Rants →