Autodesk

SeniorMachineLearningTestEngineer

£95–140k ~AI est. London, United Kingdom FULL TIME Remote Friendly
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Senior candidates.

The Brief

“Senior Machine Learning Test Engineer at Autodesk. Skills: Machine Learning, Quality Assurance, Test Automation, MLOps. Define ML quality strategy. Define acceptance criteria”

Industry & Context.

Problems you'll solve

Problem-solving skills; Root cause analysis

What They're Looking For.

Must Have

Bachelor’s degree in Computer Science, 7+ years of professional experience, Python programming skills, Experience in test automation, Familiarity with popular CAD environments tooling, Proficient in Automation and UAT test suite/framework, Experience designing QA frameworks, Excellent problem-solving skills, Attention to detail, Communication skills, Collaboration skills, Understanding of software architecture, Understanding of design patterns, Ability to work in agile development environment

Nice to Have

Experience with data validation tooling, Experience with labeling workflows, Familiarity with ML frameworks, Experience with CI/CD tools, Experience with CI/CD processes, Experience with data pipelines, Experience with orchestration tools, Familiarity with MLOps practices, Experience with ML evaluation methods, Experience with ML metrics, Experience with ML benchmarking, Passion for learning new technologies, Experience improving existing systems, Experience with cloud providers, Experience testing ML services in production, Knowledge of experiment tracking tools

What You'll Do.

Define ML quality strategy

Define acceptance criteria

Design model evaluation suites

Maintain model evaluation suites

Maintain test datasets

Evaluate CAD RL model outputs

Define structured rubrics

Automate ML QA workflows

Create test harnesses

Maintain test harnesses

Mentor teams on ML QA best practices

Mentor teams on evaluation standards

Contribute to multi-team projects

Contribute to codebases

Ensure code consistency

Participate in code reviews

Provide constructive feedback

How You'll Work.

Team & Collaboration

Work with researchers; Work with ML Engineers; Work with software engineers; Collaborate across research; Collaborate across product; Work across research; Work across product; Collaborate across global locations

Communication Scope

Present findings; Present ideas

Process & Methodology

Agile development environment

Full Job Description

**Job Requisition ID #** 26WD98891 **Position Overview** As a Senior Machine Learning QA Engineer in the Research Enablement team, you will work side-by-side with researchers, Machine Learning Engineers and software engineers to define and uphold quality standards for ML systems. You are a quality-focused engineer who is passionate about reliable, repeatable evaluation of ML models and data. Your skills span test strategy, automation, and a little MLOps, with a strong software engineering base. You are excited to collaborate across research and product to ship ML capabilities with clear quality gates. You are comfortable working at the intersection of research and product and are competent in using Autodesk CAD software. Reporting Structure: You will report to an Engineering Manager in Research Enablement. Location: United Kingdom We are a global team, located in London, San Francisco, Toronto, and remotely. Autodesk is a hybrid-first company, allowing workers to work remotely, in an office, or a mix of both. **Responsibilities** * Define ML quality strategy and acceptance criteria across data, model, and system levels * Design and maintain model evaluation suites, metrics, and test datasets * Evaluating CAD RL model outputs for geometric validity or policy stability * Defining structured rubrics that translate qualitative findings into measurable evaluation gates * Testing ML Models from product side * API Testing * Automate ML QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins) * Create and maintain test harnesses for ML services and APIs * Mentor teams on ML QA best practices and consistent evaluation standards * Build quality gates for training and deployment pipelines (e.g., regression checks, drift detection) * Contribute to multi-team projects and codebases, ensuring code quality and consistency * Participate in code reviews and provide constructive feedback to peers * Document and present findings and ideas across the company **Minimum Qualif

Free ATS check

Applying for this Senior Machine Learning Test Engineer role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Workday

  • Workday has a multi-step form — save your progress after every section.
  • "Apply With LinkedIn" can fail or lose data; manual entry is more reliable.
  • Watch for the "Submit for Review" final step — hitting "Save" alone does not submit.
  • Job requisition numbers are useful when following up with HR by email.

ANONYMOUS · UNFILTERED

What do employees actually say about Autodesk?

Real rants from real employees. Read before you apply.

Read Company Rants →