Mercor
AI
SeniorSoftwareEngineer,AIData&Evaluation
Neural analysis suggests this role is
optimal for Senior candidates.
“Senior Software Engineer, AI Data & Evaluation at Mercor. Skills: data infrastructure, evaluation systems, frontier AI models. Innovate and develop evaluation methodologies. Design and build synthetic data generation systems”
What You'll Achieve.
maximize throughput, efficiency, and quality; translate evolving model needs into robust, scalable engineering solutions; scaling production infrastructure
Industry & Context.
Systems thinking
What They're Looking For.
Must Have
software engineering skills, proven track record shipping production systems end-to-end, Deep interest in and experience with AI/ML data pipelines, evaluation frameworks, or training data systems, Systems thinking, Comfort operating with ownership and pragmatism in fast-moving, ambiguous environments, Effective communication and collaboration with engineering, research, and operations teams
Nice to Have
Experience with synthetic data generation, reinforcement learning environments, large-scale data quality systems
What You'll Do.
Innovate and develop evaluation methodologies
Design and build synthetic data generation systems
Architect and ship operational automation systems
Collaborate cross-functionally
Own end-to-end delivery of critical systems
How You'll Work.
Team & Collaboration
Collaborate cross-functionally with Operations, Research, and Product; collaboration with engineering, research, and operations teams
Communication Scope
Effective communication
Full Job Description
ABOUT MERCOR Mercor's mission is to organize human intelligence to power the AI economy. We partner with leading AI labs and enterprises to provide the human intelligence essential to AI development. Our vast talent network trains frontier AI models in the same way teachers teach students: by sharing knowledge, experience, and context that can't be captured in code alone. Today, more than 30,000 experts in our network collectively earn over $2 million a day. Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices. ABOUT THE ROLE As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data infrastructure and evaluation systems that power the next generation of frontier AI models. Our team's mission is to develop high-quality data types that push frontier models forward and drive the AI industry ahead. Software Engineers on this team are builders and innovators first. You will design and develop the evaluation methods and flywheels that drive continuous model improvement, engineer synthetic data pipelines and environments that generate high-signal training data at scale, and build the operational automation that keeps it all running with precision and efficiency. This role demands a product- and impact-oriented mindset, a bias toward shipping, and the ability to thrive at the intersection of data engineering, systems design, and applied AI research. YOU WILL - Innovate and develop evaluation methodologies and flywheels that continuously improve data quality and model performance at scale. - Design and build synthetic data generation systems and simulat
Applying for this Senior Software Engineer, AI Data & Evaluation role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Ashby
- Ashby is a fast modern ATS — most applications take under 3 minutes.
- The resume parser is strong; verify parsed experience dates and job titles.
- Custom screening questions are often scored algorithmically — answer completely.
- Location field affects geo-based screening; use your actual metro area.
ANONYMOUS · UNFILTERED
What do employees actually say about Mercor?
Real rants from real employees. Read before you apply.