LiteLLM

Technology

EngineeringManager

$250–300k San Francisco, California, United States FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Manager candidates.

The Brief

“Engineering Manager at LiteLLM. Skills: Engineering management, Team leadership, Technical roadmap, Open-source. Own team outcomes. Own team process”

What You'll Achieve.

Ship what they commit to; Scale the eng team

Industry & Context.

Technology
Problems you'll solve

Root-cause analysis; Incident management

What They're Looking For.

Must Have

Engineering management experience, Managed and shipped through team, Stood up reliability metrics, Kept quality high, Drove incident rate down, Ran postmortems, Built tracking processes, Built review cadences, Built release processes, Improved on-time delivery, Improved commitment-hit rate, Owned enterprise escalations, Filled headcount plan, CS/engineering degree, Hands-on engineering background, Worked at startup, Familiar with messy codebases, Familiar with doing rewrites

Nice to Have

Managed at an open-source company, Scaled eng team at startup

What You'll Do.

Own engineering productivity

Own open-source community

Hold engineers accountable

Own enterprise relationship

Own technical roadmap

Keep big changes gradual

Own enterprise escalations

Analyze capacity needs

Look out for community

Protect open-source adoption

How You'll Work.

Team & Collaboration

Cross-functional teams

Communication Scope

Crisp updates

Process & Methodology

Roadmap planning

Full Job Description

LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for an Engineering Manager to lead the team building the leading OSS AI gateway. About The Role You own the outcomes, the process, and the team. You won't write all the code, but you own how the team ships: engineering productivity, code quality, release health, hiring, and the open-source community. You'll hold engineers accountable to the metrics they set for themselves, keep quality high as we ship fast, and own the enterprise relationship when things get hairy. This is director-level scope with a direct line to Head of Engineering, reporting to the founder/CTO. It's a genuinely hard problem because the surface is very large: 100+ provider integrations, day-zero model launches the day a new model drops, and a Rust migration in flight. Responsibilities - Hold engineers accountable to the metrics they set for themselves, and own the team's goals so they ship what they commit to - Keep release health high as the team moves fast: stand up tracking, run root-cause on what slips through, own a weekly quality sync - Drive well-architected, consistent code patterns across the team - Own the technical roadmap with the CTO, including the Rust migration, and keep big changes gradual rather than overnight rewrites - Own enterprise escalations end to end: a clear plan, crisp updates, and a fast path to resolution - Analyze capacity needs, define the roles, and hire the engineers when more capacity is needed - Look out for the open-source community and protect open-source adoption as the team scales What We're Looking For - Been an EM before, with a track record of managing and shipping through a team - Metrics-driven: has stood up reliability or productivity metrics (on-time ship rate, regressions per release, MTTR) and used them to find root causes - Has k

Free ATS check

Applying for this Engineering Manager role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Ashby

  • Ashby is a fast modern ATS — most applications take under 3 minutes.
  • The resume parser is strong; verify parsed experience dates and job titles.
  • Custom screening questions are often scored algorithmically — answer completely.
  • Location field affects geo-based screening; use your actual metro area.

ANONYMOUS · UNFILTERED

What do employees actually say about LiteLLM?

Real rants from real employees. Read before you apply.

Read Company Rants →