Baseten

Technology

EngineeringManager,RuntimeFabric

$165–330k San Francisco, California, United States FULL TIME Remote Friendly
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Manager candidates.

The Brief

“Engineering Manager, Runtime Fabric at Baseten. Skills: Container runtime, AI inference, Systems engineering, Open-source. Recruit and hire systems engineers. Develop high-performing team”

Industry & Context.

Technology
Problems you'll solve

Solve hard problems

What They're Looking For.

Must Have

Experience managing engineering teams, Systems programming in Go/C/C++, Familiarity with Linux container ecosystem, Written and verbal communication skills

Nice to Have

Experience with GPU device access, Familiarity with lazy-loading snapshotters, Experience with secure container runtimes, Understanding of containerd shim API, Background in multi-tenant infrastructure

What You'll Do.

Recruit and hire systems engineers

Develop high-performing team

Foster technical rigor

Foster open-source contribution

Foster continuous improvement

Provide coaching and feedback

Support career development

Partner with leadership

Define long-term vision

Define roadmap for infrastructure

Extend containerd and runc

Harden containerd and runc

Meet GPU-specific requirements

Oversee architecture evolution

Drive BDN architecture expansion

Provide technical oversight

Ensure end-to-end ownership

Champion contributions to open-source

Act as primary advocate

Ensure integration support

Collaborate with stakeholders

Prioritize investments

Communicate team progress

Communicate technical trade-offs

Communicate architectural decisions

How You'll Work.

Team & Collaboration

Cross-functional partnership; Engineering leadership; Product stakeholders; Upstream/downstream teams

Communication Scope

Written communication; Verbal communication; Influence without authority; Clear communication

Full Job Description

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $300M Series E https://www.baseten.co/blog/announcing-baseten-s-300m-series-e/, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products. THE ROLE Container runtimes were designed for general-purpose software workloads. AI inference is not a general-purpose workload. Running large models at production scale exposes cracks in every layer of the container stack: runtimes unaware of GPU memory constraints, images that take minutes to pull when a model needs to scale to thousands of replicas, and isolation mechanisms that weren't designed for the multi-tenant serving environments that production AI requires. The tools the industry has relied on for a decade weren't built for this, and patching around those limitations at higher layers only goes so far. Baseten owns the entire pipeline, from the moment a developer pushes a model to the moment a request gets a response. That vertical ownership means we can fix these problems at the root. The Runtime Fabrics team is doing exactly that: purpose-building the container runtime and storage layers for AI inference workloads, led by some of the world's top containerd maintainers. As Engineering Manager of the Runtime Fabrics team, you will lead this work, setting technical direction, growing a world-class team of systems engineers, and ensuring the team's output shapes not just Baseten's infrastructure but the open-source container ecosystem at large. If you've contributed to containerd, runc, or related OCI projects and are ready to lead

Free ATS check

Applying for this Engineering Manager, Runtime Fabric role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Ashby

  • Ashby is a fast modern ATS — most applications take under 3 minutes.
  • The resume parser is strong; verify parsed experience dates and job titles.
  • Custom screening questions are often scored algorithmically — answer completely.
  • Location field affects geo-based screening; use your actual metro area.

ANONYMOUS · UNFILTERED

What do employees actually say about Baseten?

Real rants from real employees. Read before you apply.

Read Company Rants →