LiteLLM
Technology
EngineeringManager
Neural analysis suggests this role is
optimal for Manager candidates.
“Engineering Manager at LiteLLM. Skills: Engineering management, Team leadership, Technical roadmap, Open-source. Own team outcomes. Own team process”
What You'll Achieve.
Ship what they commit to; Scale the eng team
Industry & Context.
Root-cause analysis; Incident management
What They're Looking For.
Must Have
Engineering management experience, Managed and shipped through team, Stood up reliability metrics, Kept quality high, Drove incident rate down, Ran postmortems, Built tracking processes, Built review cadences, Built release processes, Improved on-time delivery, Improved commitment-hit rate, Owned enterprise escalations, Filled headcount plan, CS/engineering degree, Hands-on engineering background, Worked at startup, Familiar with messy codebases, Familiar with doing rewrites
Nice to Have
Managed at an open-source company, Scaled eng team at startup
What You'll Do.
Own engineering productivity
Own open-source community
Hold engineers accountable
Own enterprise relationship
Own technical roadmap
Keep big changes gradual
Own enterprise escalations
Analyze capacity needs
Look out for community
Protect open-source adoption
How You'll Work.
Team & Collaboration
Cross-functional teams
Communication Scope
Crisp updates
Process & Methodology
Roadmap planning
Full Job Description
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for an Engineering Manager to lead the team building the leading OSS AI gateway. About The Role You own the outcomes, the process, and the team. You won't write all the code, but you own how the team ships: engineering productivity, code quality, release health, hiring, and the open-source community. You'll hold engineers accountable to the metrics they set for themselves, keep quality high as we ship fast, and own the enterprise relationship when things get hairy. This is director-level scope with a direct line to Head of Engineering, reporting to the founder/CTO. It's a genuinely hard problem because the surface is very large: 100+ provider integrations, day-zero model launches the day a new model drops, and a Rust migration in flight. Responsibilities - Hold engineers accountable to the metrics they set for themselves, and own the team's goals so they ship what they commit to - Keep release health high as the team moves fast: stand up tracking, run root-cause on what slips through, own a weekly quality sync - Drive well-architected, consistent code patterns across the team - Own the technical roadmap with the CTO, including the Rust migration, and keep big changes gradual rather than overnight rewrites - Own enterprise escalations end to end: a clear plan, crisp updates, and a fast path to resolution - Analyze capacity needs, define the roles, and hire the engineers when more capacity is needed - Look out for the open-source community and protect open-source adoption as the team scales What We're Looking For - Been an EM before, with a track record of managing and shipping through a team - Metrics-driven: has stood up reliability or productivity metrics (on-time ship rate, regressions per release, MTTR) and used them to find root causes - Has k
Applying for this Engineering Manager role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Ashby
- Ashby is a fast modern ATS — most applications take under 3 minutes.
- The resume parser is strong; verify parsed experience dates and job titles.
- Custom screening questions are often scored algorithmically — answer completely.
- Location field affects geo-based screening; use your actual metro area.
ANONYMOUS · UNFILTERED
What do employees actually say about LiteLLM?
Real rants from real employees. Read before you apply.