Jobber
Strategy & Analytics
DataScientist
Neural analysis suggests this role is
optimal for Mid+ candidates.
“Data Scientist at Jobber. Skills: ML model validation, ML model monitoring, LLM evaluation. Design ML model validation frameworks. Implement ML model validation frameworks”
Industry & Context.
Bias–variance tradeoff; Calibration; Confidence intervals; A/B testing; Data drift; Edge cases; Failure modes
What They're Looking For.
Must Have
Industry experience in data science, Machine learning experience, Python proficiency, Pandas proficiency, Scikit-Learn proficiency, XGBoost proficiency, Deep learning framework experience, Statistical concepts knowledge, LLM evaluation frameworks experience, Custom evaluation design experience, ML model architecture understanding, High proficiency in SQL, Exceptional attention to detail, Written communication skills, Verbal communication skills
Nice to Have
Model evaluation/monitoring in Snowflake experience, Snowpark (Python) familiarity, Model regression testing in CI/CD exposure, Prompt engineering familiarity, LLM-powered features evaluation strategies, SaaS environment experience, Appreciation for model quality impact
What You'll Do.
Design ML model validation frameworks
Implement ML model validation frameworks
Maintain ML model validation frameworks
Build regression test suites
Own regression test suites
Develop MCP evaluations
Execute MCP evaluations
Monitor models in production
Proactively surface issues
Contribute to ML model architectures
Document evaluation methodologies
Document test results
Document monitoring runbooks
Stay current with LLM evaluation techniques
Apply emerging best practices
Communicate findings clearly
Translate performance signals
How You'll Work.
Team & Collaboration
Senior data scientists; MLOps; Product teams; Technical stakeholders; Business stakeholders
Communication Scope
Presenting findings; Stakeholder communication
Full Job Description
ARE YOU PASSIONATE ABOUT ML MODEL QUALITY AND BUILDING TRUST IN AI SYSTEMS? If so, this might be the role for you! We’re looking for a Data Scientist to join our growing ML & AI practice. You will play a key role in ensuring the reliability, accuracy, and performance of our machine learning models, from evaluation framework design to ongoing production monitoring. If you’re someone who geeks out over loss functions, loves writing rigorous evals, and takes pride in knowing a model truly works before it ships, we want to hear from you! At Jobber, we don’t just build a product, we work on real problems that help people in small businesses become successful. We are inspired by our company values: be humble, be supportive, and give a shit, which are not just said but are lived. We work in a collaborative environment where teams make decisions with autonomy and contribute directly to shaping the company’s future. THE TEAM: Similar to how Jobber empowers small businesses with the tools and insights they need to succeed, the Strategy and Analytics Department ensures our people at Jobber have the tooling, data insights, and strategic direction to excel in our shared mission. We turn data into actionable insights, and critical business needs into impactful software, working with multiple teams and departments across the company. Strategy & Analytics serves as a central hub that drives business outcomes in all corners of Jobber’s ecosystem. THE ROLE: Reporting to the Director, Data Science, the Data Scientist will be a core contributor to the quality and reliability of our ML and AI systems. Your primary focus will be ML model validation and monitoring, designing and executing MCP (Model Context Protocol) evaluations, and building regression test suites that give the team confidence at every stage of the model lifecycle. You will work closely with senior data scientists, MLOps, and product teams to keep our models honest and our business protected. THE DATA SCIENTIST WILL: - D
Applying for this Data Scientist role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Ashby
- Ashby is a fast modern ATS — most applications take under 3 minutes.
- The resume parser is strong; verify parsed experience dates and job titles.
- Custom screening questions are often scored algorithmically — answer completely.
- Location field affects geo-based screening; use your actual metro area.
ANONYMOUS · UNFILTERED
What do employees actually say about Jobber?
Real rants from real employees. Read before you apply.