Mercor

AI

SeniorSoftwareEngineer,AIData&Evaluation

$130–500k San Francisco, California, United States; United States; United Kingdom FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Senior candidates.

The Brief

“Senior Software Engineer, AI Data & Evaluation at Mercor. Skills: data infrastructure, evaluation systems, frontier AI models. Innovate and develop evaluation methodologies. Design and build synthetic data generation systems”

What You'll Achieve.

maximize throughput, efficiency, and quality; translate evolving model needs into robust, scalable engineering solutions; scaling production infrastructure

Industry & Context.

AI
Problems you'll solve

Systems thinking

What They're Looking For.

Must Have

software engineering skills, proven track record shipping production systems end-to-end, Deep interest in and experience with AI/ML data pipelines, evaluation frameworks, or training data systems, Systems thinking, Comfort operating with ownership and pragmatism in fast-moving, ambiguous environments, Effective communication and collaboration with engineering, research, and operations teams

Nice to Have

Experience with synthetic data generation, reinforcement learning environments, large-scale data quality systems

What You'll Do.

Innovate and develop evaluation methodologies

Design and build synthetic data generation systems

Architect and ship operational automation systems

Collaborate cross-functionally

Own end-to-end delivery of critical systems

How You'll Work.

Team & Collaboration

Collaborate cross-functionally with Operations, Research, and Product; collaboration with engineering, research, and operations teams

Communication Scope

Effective communication

Full Job Description

ABOUT MERCOR Mercor's mission is to organize human intelligence to power the AI economy. We partner with leading AI labs and enterprises to provide the human intelligence essential to AI development. Our vast talent network trains frontier AI models in the same way teachers teach students: by sharing knowledge, experience, and context that can't be captured in code alone. Today, more than 30,000 experts in our network collectively earn over $2 million a day. Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices. ABOUT THE ROLE As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data infrastructure and evaluation systems that power the next generation of frontier AI models. Our team's mission is to develop high-quality data types that push frontier models forward and drive the AI industry ahead. Software Engineers on this team are builders and innovators first. You will design and develop the evaluation methods and flywheels that drive continuous model improvement, engineer synthetic data pipelines and environments that generate high-signal training data at scale, and build the operational automation that keeps it all running with precision and efficiency. This role demands a product- and impact-oriented mindset, a bias toward shipping, and the ability to thrive at the intersection of data engineering, systems design, and applied AI research. YOU WILL - Innovate and develop evaluation methodologies and flywheels that continuously improve data quality and model performance at scale. - Design and build synthetic data generation systems and simulat

Free ATS check

Applying for this Senior Software Engineer, AI Data & Evaluation role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Ashby

  • Ashby is a fast modern ATS — most applications take under 3 minutes.
  • The resume parser is strong; verify parsed experience dates and job titles.
  • Custom screening questions are often scored algorithmically — answer completely.
  • Location field affects geo-based screening; use your actual metro area.

ANONYMOUS · UNFILTERED

What do employees actually say about Mercor?

Real rants from real employees. Read before you apply.

Read Company Rants →