Baseten
Technology
EngineeringManager,RuntimeFabric
Neural analysis suggests this role is
optimal for Manager candidates.
“Engineering Manager, Runtime Fabric at Baseten. Skills: Container runtime, AI inference, Systems engineering, Open-source. Recruit and hire engineers. Develop high-performing team”
Industry & Context.
Root cause analysis
What They're Looking For.
Must Have
Experience managing engineering teams, Systems programming in Go/C/C++, Experience with distributed storage systems, Understanding of container image structure
Nice to Have
Experience with GPU device access, Familiarity with lazy-loading snapshotters, Experience with secure container runtimes, Understanding of containerd shim API, Background in multi-tenant infrastructure
What You'll Do.
Recruit and hire engineers
Develop high-performing team
Foster technical rigor
Foster open-source contribution
Foster continuous improvement
Support career development
Define long-term vision
Provide technical oversight
Ensure end-to-end ownership
Champion contributions
Advocate for Runtime Fabrics
Ensure integration support
Prioritize investments
Communicate team progress
Communicate technical trade-offs
Communicate architectural decisions
How You'll Work.
Team & Collaboration
Cross-functional partnership; Engineering leadership; Product stakeholders; Upstream/downstream teams
Communication Scope
Written communication; Verbal communication; Influence without authority; Clear communication
Full Job Description
ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $300M Series E https://www.baseten.co/blog/announcing-baseten-s-300m-series-e/, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products. THE ROLE Container runtimes were designed for general-purpose software workloads. AI inference is not a general-purpose workload. Running large models at production scale exposes cracks in every layer of the container stack: runtimes unaware of GPU memory constraints, images that take minutes to pull when a model needs to scale to thousands of replicas, and isolation mechanisms that weren't designed for the multi-tenant serving environments that production AI requires. The tools the industry has relied on for a decade weren't built for this, and patching around those limitations at higher layers only goes so far. Baseten owns the entire pipeline, from the moment a developer pushes a model to the moment a request gets a response. That vertical ownership means we can fix these problems at the root. The Runtime Fabrics team is doing exactly that: purpose-building the container runtime and storage layers for AI inference workloads, led by some of the world's top containerd maintainers. As Engineering Manager of the Runtime Fabrics team, you will lead this work, setting technical direction, growing a world-class team of systems engineers, and ensuring the team's output shapes not just Baseten's infrastructure but the open-source container ecosystem at large. If you've contributed to containerd, runc, or related OCI projects and are ready to lead
Applying for this Engineering Manager, Runtime Fabric role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Ashby
- Ashby is a fast modern ATS — most applications take under 3 minutes.
- The resume parser is strong; verify parsed experience dates and job titles.
- Custom screening questions are often scored algorithmically — answer completely.
- Location field affects geo-based screening; use your actual metro area.
ANONYMOUS · UNFILTERED
What do employees actually say about Baseten?
Real rants from real employees. Read before you apply.