Roblox
Technology
SeniorDataScientist-GenerativeAI
Neural analysis suggests this role is
optimal for Senior candidates.
“Senior Data Scientist - Generative AI at Roblox. Skills: Generative AI, Evaluation frameworks, Experimentation, Causal inference. Develop evaluation systems for GenAI features. Develop evaluation systems for internal AI Agents”
What You'll Achieve.
Drive product decisions; Drive model improvements; Lift rigor and efficiency
Industry & Context.
Framing ambiguous problems; Designing analytical approaches; Solving open-ended data science problems
What They're Looking For.
Must Have
Master's or PhD degree, 5+ years of experience, Proficiency in SQL, Proficiency in Python or R, Grounding in experimentation, Grounding in causal inference, Grounding in statistical analysis
Nice to Have
PhD preferred, Expertise in model training lifecycle, Experience with engineering development workflows, Experience with engineering efficiency data
What You'll Do.
Develop evaluation systems for GenAI features
Develop evaluation systems for internal AI Agents
Design eval experiments
Analyze label reliability
Implement finetuning LLM-as-judge methods
Run online experiments
Conduct causal inference
Quantify impact of GenAI features
Quantify impact of AI-assisted coding tools
Identify opportunities
Ensure statistical rigor
Define leading indicators
Define lagging indicators
Build automated systems
Research methodologies
Build reproducible evaluation tooling
Build agentic workflows
Develop reporting frameworks
Translate data into recommendations
How You'll Work.
Team & Collaboration
Partner with cross-functional teams
Communication Scope
Translate complex data
Full Job Description
Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. WHY DATA SCIENCE & ANALYTICS? The Data Science & Analytics organization's mission is to increase our speed, frequency, and acumen in making decisions at scale by instilling a data-influenced approach to building products. We cover a wide area of the data spectrum, including analytical data engineering, product analytics, experimentation, causal inference, statistical modeling, and machine learning. Aligned and partnered with product verticals, we use this extensive tool belt to discover new opportunities and unmet use cases, influence and craft the product roadmap, and prioritize, build data products, and measure impact on our community of players and developers. WHY GENERATIVE AI? Our team’s mission is twofold: to enable Roblox Creators to bring GenAI capabilities to millions of users, and to empower Roblox Creators and our own engineers with AI-backed tools to deliver value faster. We drive this innovation with a core commitment to safety, responsibility, and quality. As a Senior Data Scientist, you will play a critical role in a key area within our Foundation AI team: Engineering Efficiency and Code Intelligence: Building the metrics, analytics, experimentation foundation, and AI workflow that power
Applying for this Senior Data Scientist - Generative AI role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about Roblox?
Real rants from real employees. Read before you apply.