DigitalOcean

Technology

SeniorEngineer,InferenceControlPlane

$176–245k ~AI est. Seattle, Washington, United States FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Senior candidates.

The Brief

“Senior Engineer, Inference Control Plane at DigitalOcean. Skills: Inference Control Plane, Distributed systems, AI workloads. Design scalable services. Build scalable services”

Industry & Context.

Technology
Problems you'll solve

Debugging performance; Debugging scalability; Debugging reliability

Eligibility Requirements

On-call rotations

What They're Looking For.

Must Have

5+ years experience building multi-tenant platforms, 5+ years experience operating distributed backend systems, 1+ years Go/Golang experience, 1+ years Kubernetes experience, Experience debugging performance issues, Experience debugging scalability issues, Experience debugging reliability issues, Experience tracking inference metrics

Nice to Have

AI/ML framework knowledge, Experience with API gateways, Experience with traffic routing, Experience with service mesh technologies, Experience building inference optimization systems, Experience building rate limiting systems, Experience building workload orchestration systems

What You'll Do.

Design scalable services

Build scalable services

Design multi-tenant services

Build multi-tenant services

Develop distributed systems

Operate distributed systems

Strengthen platform resiliency

Improve observability

Improve capacity management

Improve operational tooling

Partner with platform teams

Partner with GPU teams

Partner with product teams

Deliver production-grade systems

Deliver highly available APIs

Raise engineering bar

Contribute to architecture decisions

Participate in on-call rotations

Lead efforts to reduce pain

Improve service health

Prevent recurring incidents

How You'll Work.

Team & Collaboration

Platform engineering teams; GPU infrastructure teams; Product engineering teams

Full Job Description

Dive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, naturally like to think big and bold, and are energized by the fast-paced environment of a true industry disruptor, you’ll find your place here. We value winning together—while learning, having fun, and making a profound difference for the dreamers and builders in the world. We are seeking a Senior Engineer to implement and contribute to the design and optimization of our Serverless Inference infrastructure and APIs. In this role, you will tackle the challenges of large-scale AI workloads, focusing on throughput, GPU utilization, and fault tolerance to support next-generation inference needs of AI native enterprises. What You'll Do: Design and build scalable, multi-tenant services that power AI inference and intelligent routing workloads. Develop and operate high-scale distributed systems with strong reliability, availability, and performance goals. Strengthen platform resiliency through improved observability, capacity management, automation, and operational tooling. Partner closely with platform, GPU infrastructure, and product engineering teams to deliver production-grade systems and highly available APIs. Raise the engineering bar through strong software design, operational discipline, incident management, and continuous improvement practices. Contribute to architecture decisions around traffic management, service orchestration, reliability, and platform scalability. Participate in on-call rotations and lead efforts to reduce operator pain, improve service health, and prevent recurring incidents. What You'll Bring: Required 5+ years of experience building and operating multi-tenant platforms or distributed backend systems Strong experience operating high-scale distributed services in production environments Deep understanding of SRE principles, includi

Free ATS check

Applying for this Senior Engineer, Inference Control Plane role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

ANONYMOUS · UNFILTERED

What do employees actually say about DigitalOcean?

Real rants from real employees. Read before you apply.

Read Company Rants →