Capital One

banking

SeniorDistinguishedEngineer,AICompute

$286–327k San Francisco, California, United States; New York City, New York, United States FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Senior candidates.

The Brief

“Senior Distinguished Engineer, AI Compute at Capital One. Skills: AI Compute, Distributed Systems, Machine Learning Platform Engineering, Large-Scale Systems, High-Performance Computing, Cloud Infrastructure, LLM Training and Inference. Architect and build control and data plane implementations required to realize a highly available, multi-tenant, large scale and a secure machine learning platform. Develop Ray and Spark distributed compute engine solutions to accelerate diverse workloads from LL”

What You'll Achieve.

optimize business outcomes while driving towards technology solutions

Industry & Context.

banking

What They're Looking For.

Must Have

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 10 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies, At least 10 years of experience programming with Python, Go, Scala, or Java

Nice to Have

Master’s Degree in Computer Science or a Master’s Degree in Software Engineering, Hands on experience in the internals of Ray (Actors/GCS/Scheduling) or Spark (Query Optimizer/Memory Management), Experience building platforms that support LLM training, fine-tuning, or high-throughput inference, Hands-on experience with AWS-specific compute primitives (EKS, EC2 UltraClusters, Graviton) and cost-optimization strategies, History of upstream contributions to major distributed systems projects

What You'll Do.

Architect and build control and data plane implementations required to realize a highly available

large scale and a secure machine learning platform

Develop Ray and Spark distributed compute engine solutions to accelerate diverse workloads from LLM pre-training and reinforcement learning to large-scale data processing

while maximizing compute unit economics

Engineer systemic improvements for operational excellence including automating KTLO (Keep The Lights On) workflows

Direct the technical execution of a diverse project portfolio

collaborating with developers specializing in everything ranging from distributed microservices to running large foundation models

Share your passion for staying on top of tech trends

experimenting with and learning new technologies

participating in internal & external technology communities

and leading system design and code review sessions

Help elevate the Capital One Distinguished Engineering community and establish yourself as a go-to resource on given technologies and technology-enabled capabilities

Lead the way in creating next-generation talent

mentoring internal talent and actively recruiting external talent to bolster the Capital One tech talent pool

How You'll Work.

Team & Collaboration

collaborating with developers specializing in everything ranging from distributed microservices to running large foundation models; Work cross-functionally with product and program management disciplines, and stakeholder and partners across Capital One

Full Job Description

Senior Distinguished Engineer, AI Compute (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine learning — position us to be at the forefront of enterprises leveraging AI. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking. We are committed to continuing to build world-class applied science and engineering teams to deliver our industry leading capabilities with breakthrough product experiences and scalable, high-performance AI infrastructure. At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses who have come to love the products and services we build. **Team Description:** The Capital One machine learning platform organization manages our cloud-based enterprise AI+ML system delivering the high-scale developer and runtime environments required to build, orchestrate, and deploy compute and data intensive AI systems across real-time and batch workloads. We are seeking a Senior Distinguished Engineer, a hands-on technical leader passionate about distributed systems, to engineer and scale foundational compute capabilities for our platform. You will use your experience in building large scale, highly available and high performance systems to develop our common compute infrastructure on top of CPU and GPU substrates. Your contributions will power everything from developer notebooks to ML / DL model training, model inference and feature generation pipelines to pre-training and fine tuning Transformer-based models as well as generative AI inference and agentic applications.

Free ATS check

Applying for this Senior Distinguished Engineer, AI Compute role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Workday

  • Workday has a multi-step form — save your progress after every section.
  • "Apply With LinkedIn" can fail or lose data; manual entry is more reliable.
  • Watch for the "Submit for Review" final step — hitting "Save" alone does not submit.
  • Job requisition numbers are useful when following up with HR by email.

ANONYMOUS · UNFILTERED

What do employees actually say about Capital One?

Real rants from real employees. Read before you apply.

Read Company Rants →