AfterQuery
Tech / AI / Software
ResearchScientist-PostTraining
Neural analysis suggests this role is
optimal for Entry candidates.
“Research Scientist - Post Training at AfterQuery. Skills: design and run training experiments, isolate the impact of our datasets on model behavior, SFT and RL-based post-training, measure how different data sources shift capability, generalization, and alignment, turn our datasets into clear, defensible evidence. Run controlled SFT and RL experiments to measure the impact of our datasets on model performance. Help build public evals and new data types that push the frontier”
What You'll Achieve.
prove that our data works; this data → this improvement → under these conditions
Industry & Context.
extract actionable insights from messy results
What They're Looking For.
Must Have
LLM training and evaluation methodologies, design lightweight experiments, move fast, extract actionable insights from messy results, working across domains, bias toward building over theorizing, undergrad research or master's research
What You'll Do.
Run controlled SFT and RL experiments to measure the impact of our datasets on model performance
Help build public evals and new data types that push the frontier
Publish external-facing research
and technical reports
Work with internal SPLs to iterate on data quality based on your results
How You'll Work.
Team & Collaboration
Working closely with partner labs; Work with internal SPLs
Communication Scope
Publish external-facing research, blog posts, and technical reports
Full Job Description
About AfterQuery AfterQuery builds the training data and evaluation infrastructure that frontier AI labs use to make their models better. We work with the world's leading labs to design high signal datasets and run rigorous evaluations that go beyond static benchmarks. We are a small, early team (post Series A) where individual contributors have a direct impact on how the next generation of models learn and improve. The Role Your job is to prove that our data works. You will design and run training experiments that isolate the impact of our datasets on model behavior. This includes SFT and RL-based post-training, where you’ll measure how different data sources shift capability, generalization, and alignment. Working closely with partner labs, you will turn our datasets into clear, defensible evidence: this data → this improvement → under these conditions. This is experimental, high-leverage work. What You'll Do - Run controlled SFT and RL experiments to measure the impact of our datasets on model performance. - Help build public evals and new data types that push the frontier. - Publish external-facing research, blog posts, and technical reports. - Work with internal SPLs to iterate on data quality based on your results. What We're Looking For - Strong familiarity with LLM training and evaluation methodologies. - Genuine obsession with how data structure, selection, and quality drive model behavior. - Ability to design lightweight experiments, move fast, and extract actionable insights from messy results. - Comfort working across domains (you'll touch finance, software engineering, policy, and more). - A bias toward building over theorizing. - Great candidates are undergrad research or master's research (but haven't done a phd). Compensation Structure: $250k-450k total compensation + equity
Applying for this Research Scientist - Post Training role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Ashby
- Ashby is a fast modern ATS — most applications take under 3 minutes.
- The resume parser is strong; verify parsed experience dates and job titles.
- Custom screening questions are often scored algorithmically — answer completely.
- Location field affects geo-based screening; use your actual metro area.
ANONYMOUS · UNFILTERED
What do employees actually say about AfterQuery?
Real rants from real employees. Read before you apply.