Datadog
Observability
StaffAppliedScientistAgenticInterfaces
“Staff Applied Scientist - Agentic Interfaces at Datadog. Skills: Evaluation strategy, Measurement systems, Applied research, Technical leadership. Own evaluation strategy. Define metrics”
What You'll Achieve.
define what 'good' means for an Agentic interface; build the measurement systems that make it true; land the platform that lets every product group at Datadog ship integrations that are demonstrably better release over release; Drive measurable improvements to retrieval relevance, tool-selection accuracy, and context efficiency; catch quality changes before they hit customers
Industry & Context.
define what 'good' means; build the measurement systems; evaluate an agent end-to-end; score tool selection; build a measurement system that catches regressions
What They're Looking For.
Must Have
BS/MS/PhD in a scientific field, or equivalent experience, 10+ years of relevant engineering or applied science experience, time as a technical lead, Proven track record of leading ML or GenAI initiatives, Significant experience with evaluation, experimentation, or measurement of ML systems at scale, product mindset, comfortable driving initiatives across cross-functional teams, thrive in ambiguity, make sound technical calls
Nice to Have
PhD preferred, specific ML framework experience, cloud platform certs
What You'll Do.
Own evaluation strategy
Partner with AI engineers
Provide technical leadership
Represent team externally
How You'll Work.
Team & Collaboration
partnering closely with the AI engineers on the team; Partner with the Bits SRE, Bits Assistant, and Bits Dev Agent teams; technical leadership across the Agentic Interfaces team and the broader organization through design reviews, working groups, and mentorship
Communication Scope
technical leadership; design reviews; working groups; mentorship; represent the team externally through talks, blog posts, and contributions to the open agent ecosystem
Applying for this Staff Applied Scientist - Agentic Interfaces role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about Datadog?
Real rants from real employees. Read before you apply.