Cerebras Systems

AI

AIEngineer,ModelQualityandPerformance

Sunnyvale, California, United States
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Mid candidates.

The Brief

“AI Engineer, Model Quality and Performance at Cerebras Systems. Skills: AI agents, Model quality and performance, AI-driven systems, Tooling design. Own model quality and performance for Cerebras' inference offerings. Define what 'good' looks like across the models we serve”

What You'll Achieve.

Define what 'good' looks like across the models we serve; Build AI-driven systems to measure quality at scale; Translate those signals into artifacts our customers and product team actually use; Automate the repetitive parts of release qual; Build performance datasets and benchmarking workflows for customer use cases; A system that runs itself between releases, not a script you re-run by hand; Model how fast customer-specific workloads will run in production; Synthesizes quality + performance data into a single, easy-to-use view

Industry & Context.

AI
Problems you'll solve

Translating signals into artifacts our customers and product team actually use; Automate the repetitive parts of release qual; Build automations to forecast and benchmark model performance

What They're Looking For.

Must Have

Experience building AI agents, Comfort with Docker, Git, and the standard automation stack, A taste for tooling design

Nice to Have

Performance-tuning experience on custom silicon, GPUs, or FPGAs, Experience designing evals for agentic / coding / long-context / multimodal use cases, Familiarity with open-source eval frameworks (EvalScope, lm-eval-harness, etc.), AI helped you ship it

What You'll Do.

Own model quality and performance for Cerebras' inference offerings

Define what 'good' looks like across the models we serve

Build AI-driven systems to measure quality at scale

Translate those signals into artifacts our customers and product team actually use

Use AI agents to spin up custom eval suites per customer use case

Mine trajectories for representative test data

Automate the repetitive parts of release qual

Help build performance datasets and benchmarking workflows for customer use cases

Design eval suites with AI agents in the loop

Curate a thoughtful mix of advanced

and customer-use-case-specific evals for every model release

Build custom evals for target customers by orchestrating AI agents to mine trajectories from their workloads and synthesize representative eval sets

Automate eval execution end-to-end with AI-driven pipelines on top of standard tooling (Docker

Build automations to forecast and benchmark model performance on Cerebras for our top customers

Build product-quality tooling that synthesizes quality + performance data into a single

How You'll Work.

Team & Collaboration

Sit between engineering, product, and customer-facing teams

Full Job Description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs. Cerebras' current customers include top model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference. Thanks to the groundbreaking wafer-scale architecture, Cerebras Inference offers the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation. About The Role You'll own model quality and performance for Cerebras' inference offerings. You will define what "good" looks like across the models we serve, building AI-driven systems to measure it at scale, and translating those signals into artifacts our customers and product team actually use. You'll use AI agents to spin up custom eval suites per customer use case, mine trajectories for representative test data, automate the repetitive parts of release qual, and help build performance datasets and benchmarking workflows for customer use cases. We want someone whose first instinct is "how do I get an AI agent to do this on a loop." You'll sit between engineering, product, and customer-facing teams. What You'll Do Design eval suites with AI agents in the loop. For every model release, curate a thoughtful mix of advanced, basic, long-context, and cu

Free ATS check

Applying for this AI Engineer, Model Quality and Performance role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Greenhouse

  • Create a Greenhouse profile before applying — it saves time across multiple applications.
  • Upload your resume as a PDF; the parser handles it better than Word.
  • Answer all knockout questions carefully — wrong answers auto-reject before a human sees you.
  • Enable email notifications to track application status in real time.

ANONYMOUS · UNFILTERED

What do employees actually say about Cerebras Systems?

Real rants from real employees. Read before you apply.

Read Company Rants →