Baseten
AI
EngineeringManager,ModelLibrary
Neural analysis suggests this role is
optimal for Senior candidates.
“Engineering Manager, Model Library at Baseten. Skills: Engineering Management, Product Management, AI/ML Domain. Lead and grow a team of engineers, including hiring, mentorship, and career development. Own the Model Library product area end-to-end — from discovery and evaluation experiences to the APIs and tooling developers use to integrate models”
What You'll Achieve.
define success metrics; ensure a consistent, high-quality developer experience
Industry & Context.
technical judgment
What They're Looking For.
Must Have
Experience managing engineers building developer-facing products: APIs, SDKs, or developer tooling, Product intuition and technical judgment, Technically hands-on enough to review designs, debug issues, and earn the trust of a IC team, written communication and cross-functional collaboration skills, Interest in AI/ML and the evolving model willingness to develop deep domain knowledge (ML expertise not required), Experience building or supporting self-serve workflows
Nice to Have
Background as an IC in developer tooling, APIs, or ML infrastructure before moving into management, Experience with model evaluation, benchmarking, or comparison frameworks, Familiarity with inference platforms, LLM runtimes, or the model ecosystem (open-source and frontier)
What You'll Do.
Lead and grow a team of engineers
and career development
Own the Model Library product area end-to-end — from discovery and evaluation experiences to the APIs and tooling developers use to integrate models
Maintain a high technical bar through design doc reviews
and hands-on architectural guidance
Drive product quality and reliability: define success metrics
establish feedback loops
and ensure a consistent
high-quality developer experience
How You'll Work.
Team & Collaboration
Partner with product, ML, and cross-functional stakeholders to define scope, prioritize work, and communicate progress; cross-functional collaboration skills; effective collaboration
Communication Scope
written communication; communicate progress
Process & Methodology
prioritize work, define scope
Full Job Description
ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $300M Series E https://www.baseten.co/blog/announcing-baseten-s-300m-series-e/, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products. THE ROLE: You'll lead the Model Library team at Baseten — a small, high-ownership team focused on helping developers discover, evaluate, and select the right models for their specific use cases. This role is for a product-minded engineering manager who thrives in ambiguous, high-impact environments and can guide a team from early-stage product thinking through production-quality execution. You'll stay technically grounded while driving the team's work across model discovery, evaluation frameworks, and the infrastructure that powers a best-in-class model library experience. EXAMPLE INITIATIVES: - Model APIs for frontier models https://www.baseten.co/products/model-apis/ - Model training built for production inference https://www.baseten.co/products/training/ - Introducing the Baseten Frontier Gateway https://www.baseten.co/blog/introducing-baseten-frontier-gateway/ RESPONSIBILITIES: - Lead and grow a team of engineers, including hiring, mentorship, and career development. - Own the Model Library product area end-to-end — from discovery and evaluation experiences to the APIs and tooling developers use to integrate models. - Partner with product, ML, and cross-functional stakeholders to define scope, prioritize work, and communicate progress. - Maintain a high technical bar through design doc reviews, code reviews, and hands-on architectural gu
Applying for this Engineering Manager, Model Library role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Ashby
- Ashby is a fast modern ATS — most applications take under 3 minutes.
- The resume parser is strong; verify parsed experience dates and job titles.
- Custom screening questions are often scored algorithmically — answer completely.
- Location field affects geo-based screening; use your actual metro area.
ANONYMOUS · UNFILTERED
What do employees actually say about Baseten?
Real rants from real employees. Read before you apply.