Sarvam

Technology

SeniorPerformanceEngineer,DiscreteGPU

₹35–55L ~AI est. Bengaluru, India FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Senior candidates.

The Brief

“Senior Performance Engineer, Discrete GPU at Sarvam. Skills: GPU performance, ML deployment. Land edge models on GPUs. Author TensorRT plugins”

What You'll Achieve.

Hit predefined SLAs; Headroom for concurrent workloads

Industry & Context.

Technology

What They're Looking For.

Must Have

5+ years ML deployment, 2+ years discrete GPU inference, Production TensorRT, Plugin authoring, Engine refit

Nice to Have

CUDA fluency, Debug kernel authoring, AMD ROCm production experience, HIP production experience, CUDA kernel authoring

What You'll Do.

Land edge models on GPUs

Author TensorRT plugins

Author custom CUDA kernels

Author custom ROCm kernels

Drive workstation device CI

Full Job Description

About Sarvam Sarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC. About the Role Own sarvam's discrete-GPU surface: NVIDIA RTX / RTX Pro via TensorRT and CUDA, AMD ROCm-supported GPUs via ONNX Runtime, and DirectML as a Windows-universal fallback. The workstation form factor is the most relaxed footprint target but the most demanding latency target - users running creative tools alongside sarvam’s products expect zero perceptible cost. What You’ll Do - Land Sarvam’s edge models on RTX / RTX Pro / AMD GPUs, hitting predefined SLAs with headroom for concurrent GPU workloads. - Author TensorRT plugins and custom CUDA / ROCm kernels where stock ops don't hit budget. - Drive workstation device CI. What We're Looking For - 5+ years on ML deployment with 2+ years on discrete GPU inference. - Production TensorRT including plugin authoring and engine refit. - CUDA fluency at minimum at debug level; kernel authoring is a strong plus. - Nsight Systems / Compute fluency. - ONNX Runtime + DirectML EP experience. Bonus Points - AMD ROCm / HIP production experience. - CUDA kernel authoring. Why Sarvam? Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact. - Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar - High ownership and high impact, from day one - Everything we do is AI-first, from the way we build and ship to the way we think about problems - You can work on problems that cou

Free ATS check

Applying for this Senior Performance Engineer, Discrete GPU role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Ashby

  • Ashby is a fast modern ATS — most applications take under 3 minutes.
  • The resume parser is strong; verify parsed experience dates and job titles.
  • Custom screening questions are often scored algorithmically — answer completely.
  • Location field affects geo-based screening; use your actual metro area.

ANONYMOUS · UNFILTERED

What do employees actually say about Sarvam?

Real rants from real employees. Read before you apply.

Read Company Rants →