Artificial Analysis

Technology

SeniorAI/MLEngineer

A$165–235k ~AI est. Melbourne, Victoria, Australia FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Senior candidates.

The Brief

“Senior AI / ML Engineer at Artificial Analysis. Skills: AI benchmarking, ML engineering, Data analysis, Backend systems. Lead development benchmarking stack. Optimize benchmarking stack”

Industry & Context.

Technology
Problems you'll solve

Problem-solving skills; Distill complex concepts

What They're Looking For.

Must Have

3+ years software engineering, Proficiency Python libraries, Proficiency AI APIs, Familiarity cloud infrastructure, Familiarity orchestration tools, Familiarity monitoring tools, Experience visualizing data, Experience presenting data, Problem-solving skills, Distill complex concepts, Excellent communication skills, Excellent collaboration skills, Lead projects independently, Bachelor's or Master's

Nice to Have

Experience AI/ML frameworks, Experience PyTorch

What You'll Do.

Lead development benchmarking stack

Optimize benchmarking stack

Design backend systems

Drive projects concept to shipped

Implement Python solutions

Design user interfaces

Implement data visualizations

Conduct custom analyses

Provide actionable insights

Contribute benchmarking methodologies

Develop evaluation methodology

Embrace AI-native workflow

How You'll Work.

Team & Collaboration

Work with founders; Cross-functional teams

Communication Scope

Presenting data; Actionable insights

Process & Methodology

Lead projects

Full Job Description

ABOUT ARTIFICIAL ANALYSIS Artificial Analysis is the leading independent AI benchmarking company. We support labs, engineers and enterprises to understand AI capabilities and make critical decisions about their AI strategies. We are the go-to authority for understanding AI, from AI labs and enterprises to media, investors, and policymakers. Our benchmarks don't just measure the cutting edge of AI, they are actively shaping the frontier. Our benchmarks and analysis are trusted by hundreds of thousands of users and are the go-to reference for leading AI labs including OpenAI, Google, Meta, NVIDIA and Anthropic, and major publications including the Wall Street Journal, Bloomberg, the Financial Times and The Economist. We are a team of 35+, on track to triple by year end, backed by Nat Friedman (Github, Meta), Daniel Gross (SSI), Andrew Ng (Google Brain, DeepLearning.ai http://DeepLearning.ai, Amazon), Adam D'Angelo (Quora, Poe, OpenAI), Clem Delangue (Hugging Face) and other industry leaders. THE OPPORTUNITY We're looking for an Intermediate to Senior ML Engineer to join our team and lead projects in AI benchmarking and analysis. You'll work closely with our founders to build core parts of the software stack for our early stage start-up. The coming wave of AI scaling is going to change the world in ways we don't yet understand — and we're offering a front row seat. WHAT YOU’LL DO - Lead the development and optimization of aspects of our core benchmarking stack, focusing on data intensive backend systems and APIs, and driving projects from concept to shipped - Design and implement robust Python solutions for benchmarking, model evaluation and data analysis - Design and implement user interfaces and data visualizations that distill complex AI benchmarking data into intuitive, interactive experiences for thousands of daily users - Conduct custom analyses for enterprise customers, providing actionable insights to inform their AI strategies - Contribute to the evolution of

Free ATS check

Applying for this Senior AI / ML Engineer role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Ashby

  • Ashby is a fast modern ATS — most applications take under 3 minutes.
  • The resume parser is strong; verify parsed experience dates and job titles.
  • Custom screening questions are often scored algorithmically — answer completely.
  • Location field affects geo-based screening; use your actual metro area.

ANONYMOUS · UNFILTERED

What do employees actually say about Artificial Analysis?

Real rants from real employees. Read before you apply.

Read Company Rants →