Annapurna Labs

Technology

SoftwareDevelopmentManager,LLMInferenceModelEnablement,NeuronSDK

$166–288k Cupertino, California, United States FULL TIME
The Brief

“Software Development Manager, LLM Inference Model Enablement, Neuron SDK at Annapurna Labs. Skills: LLM Inference, Model Enablement, Neuron SDK. Lead team of AI/ML engineers. Onboard LLMs for inference”

Industry & Context.

Technology
Problems you'll solve

Technical challenges

What They're Looking For.

Must Have

3+ years engineering team management, 7+ years working directly within engineering teams, 3+ years designing or architecting systems, Experience partnering with product or program management

Nice to Have

Experience communicating with users, other technical teams, and senior leadership, Experience recruiting, hiring, mentoring/coaching and managing teams of Software Engineers

What You'll Do.

Lead team of AI/ML engineers

Onboard LLMs for inference

Optimize LLMs for inference

Drive improvements in model enablement speed

Advance inference usability and quality

Define model enablement and performance optimization

Build and deliver models to customers

Improve model onboarding experience

Enhance inference usability and quality

Manage changing priorities

Help team solve technical challenges

How You'll Work.

Team & Collaboration

Senior management; Technical leaders; Product management teams; Program management teams

Communication Scope

Collect requirements; Describe software product features; Describe technical designs; Describe product strategy

Free ATS check

Applying for this Software Development Manager, LLM Inference Model Enablement, Neuron SDK role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

ANONYMOUS · UNFILTERED

What do employees actually say about Annapurna Labs?

Real rants from real employees. Read before you apply.

Read Company Rants →