Sarvam
Technology
PerformanceEngineer,On-DeviceInference
Neural analysis suggests this role is
optimal for Mid candidates.
“Performance Engineer, On-Device Inference at Sarvam. Skills: On-Device Inference, ML Systems, Model Deployment. Quantize models. Validate accuracy”
Industry & Context.
Performance debugging; Accuracy debugging
What They're Looking For.
Must Have
3+ years ML systems, Solid PyTorch + ONNX export, Quantization in production, Comfort with ONNX Runtime, Comfort with TensorRT, Comfort with CoreML, Comfort with OpenVINO, Comfort with QNN, Comfort with LiteRT, Profiling fluency on platform
Nice to Have
Custom op authoring in runtime
What You'll Do.
Author deployment workbook
Embed with consuming teams
Debug accuracy issues
Maintain benchmark harness
Extend benchmark harness
How You'll Work.
Team & Collaboration
Partner with consuming app team; Embed with consuming teams
Full Job Description
About Sarvam Sarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC. About the Role Take Sarvam models from research-handoff state to production-ready artifacts on at least two of our target chipsets (Intel xPU, ARM xPU, Apple xPU, Nvidia / AMD GPUs). You'll own 1 - 2 (model, chipset) pairs end-to-end and partner with the consuming app team during integration. What You’ll Do - Quantize, validate accuracy, benchmark, and document. Author the deployment workbook for each pair you own. - Embed part-time with consuming teams during integration; debug perf and accuracy issues alongside them. - Maintain and extend the team's benchmark harness. What We're Looking For - 3+ years on ML systems. - Solid PyTorch + ONNX export experience including the gotchas (dynamic shapes, control flow, custom ops). - Quantization in production on at least one real model. - Comfort with at least two of: ONNX Runtime, TensorRT, CoreML, OpenVINO, QNN, LiteRT. - Profiling fluency on at least one platform. Bonus Points - Custom op authoring in any runtime. Why Sarvam? Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact. - Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar - High ownership and high impact, from day one - Everything we do is AI-first, from the way we build and ship to the way we think about problems - You can work on problems that could change how an entire country learns, works, and co
Applying for this Performance Engineer, On-Device Inference role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Ashby
- Ashby is a fast modern ATS — most applications take under 3 minutes.
- The resume parser is strong; verify parsed experience dates and job titles.
- Custom screening questions are often scored algorithmically — answer completely.
- Location field affects geo-based screening; use your actual metro area.
ANONYMOUS · UNFILTERED
What do employees actually say about Sarvam?
Real rants from real employees. Read before you apply.