DigitalOcean
Technology
SeniorEngineer,InferenceControlPlane
Neural analysis suggests this role is
optimal for Senior candidates.
“Senior Engineer, Inference Control Plane at DigitalOcean. Skills: Inference Control Plane, Distributed systems, AI workloads. Design scalable services. Build scalable services”
Industry & Context.
Debugging performance; Debugging scalability; Debugging reliability
On-call rotations
What They're Looking For.
Must Have
5+ years experience building multi-tenant platforms, 5+ years experience operating distributed backend systems, 1+ years Go/Golang experience, 1+ years Kubernetes experience, Experience debugging performance issues, Experience debugging scalability issues, Experience debugging reliability issues, Experience tracking inference metrics
Nice to Have
AI/ML framework knowledge, Experience with API gateways, Experience with traffic routing, Experience with service mesh technologies, Experience building inference optimization systems, Experience building rate limiting systems, Experience building workload orchestration systems
What You'll Do.
Design scalable services
Build scalable services
Design multi-tenant services
Build multi-tenant services
Develop distributed systems
Operate distributed systems
Strengthen platform resiliency
Improve observability
Improve capacity management
Improve operational tooling
Partner with platform teams
Partner with GPU teams
Partner with product teams
Deliver production-grade systems
Deliver highly available APIs
Raise engineering bar
Contribute to architecture decisions
Participate in on-call rotations
Lead efforts to reduce pain
Improve service health
Prevent recurring incidents
How You'll Work.
Team & Collaboration
Platform engineering teams; GPU infrastructure teams; Product engineering teams
Full Job Description
Dive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, naturally like to think big and bold, and are energized by the fast-paced environment of a true industry disruptor, you’ll find your place here. We value winning together—while learning, having fun, and making a profound difference for the dreamers and builders in the world. We are seeking a Senior Engineer to implement and contribute to the design and optimization of our Serverless Inference infrastructure and APIs. In this role, you will tackle the challenges of large-scale AI workloads, focusing on throughput, GPU utilization, and fault tolerance to support next-generation inference needs of AI native enterprises. What You'll Do: Design and build scalable, multi-tenant services that power AI inference and intelligent routing workloads. Develop and operate high-scale distributed systems with strong reliability, availability, and performance goals. Strengthen platform resiliency through improved observability, capacity management, automation, and operational tooling. Partner closely with platform, GPU infrastructure, and product engineering teams to deliver production-grade systems and highly available APIs. Raise the engineering bar through strong software design, operational discipline, incident management, and continuous improvement practices. Contribute to architecture decisions around traffic management, service orchestration, reliability, and platform scalability. Participate in on-call rotations and lead efforts to reduce operator pain, improve service health, and prevent recurring incidents. What You'll Bring: Required 5+ years of experience building and operating multi-tenant platforms or distributed backend systems Strong experience operating high-scale distributed services in production environments Deep understanding of SRE principles, includi
Applying for this Senior Engineer, Inference Control Plane role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about DigitalOcean?
Real rants from real employees. Read before you apply.