Scarlet
healthcare
MedicalAIScientist
Neural analysis suggests this role is
optimal for Mid+ candidates.
“Medical AI Scientist at Scarlet. Skills: AI, ML, statistical analyses, clinical evidence evaluation. Evaluating whether AI model performance testing, datasets, and clinical evidence are appropriate to support clinical benefits and performance claims under medical device regulations. Critically evaluate AI/ML performance testing methodologies, outcome measures, datasets, and statistical analyses to determine whether they adequately support clinical and performance claims”
What You'll Achieve.
hasten the transition to universally accessible healthcare; assess and grant market access to medical AIs; enable market access, new device updates and ongoing surveillance of a growing portfolio of medical devices; provide support across all stages of the customer journey; support clinical benefits and performance claims under medical device regulations
Industry & Context.
identify and define scientific problems; defend a scientific position; ideate pragmatic solutions
representing Scarlet at events and conferences
What They're Looking For.
Must Have
PhD in the area of AI in healthcare or Master’s (or higher) in Health Data Science or AI-focused medical statistics, Experience evaluating AI/ML model performance metrics, validation methodologies, and training/testing datasets in healthcare or regulated environments, Experience critically assessing whether statistical analyses and performance testing appropriately support clinical benefit and performance claims, Experience communicating complex AI in healthcare topics to non-technical audiences
Nice to Have
Experience of designing or contributing to the development of interventional and non-interventional clinical studies, Experience appraising or analysing real-world data and observational studies, including familiarity with bias frameworks (e. g. ROBINS-I, GRADE for observational evidence), Experience with the deployment and evaluation of LLMs in healthcare
What You'll Do.
Evaluating whether AI model performance testing
and clinical evidence are appropriate to support clinical benefits and performance claims under medical device regulations
Critically evaluate AI/ML performance testing methodologies
and statistical analyses to determine whether they adequately support clinical and performance claims
Screen and action insights from the latest research on AI in healthcare
How You'll Work.
Team & Collaboration
Communicate complex statistical and AI/ML concepts clearly to internal teams, manufacturers, and customers; Work with our Product, Engineering, Design and Applied ML functions to build and improve our systems
Communication Scope
Communicate complex statistical and AI/ML concepts clearly to internal teams, manufacturers, and customers; Experience communicating complex AI in healthcare topics to non-technical audiences
Full Job Description
Our mission is to hasten the transition to universally accessible healthcare. We are authorised by governments to assess and grant market access to medical AIs. Our groundbreaking approach enables the most innovative technology to reach patients safely and quickly. Scarlet is the pre-eminent authority on AI medical devices. We serve customers that matter. Companies building bleeding-edge medical AI systems choose Scarlet. We are proud to count the world’s best resourced and most ambitious companies building medical AI as customers. You will be joining a team with product-market fit, flowing data, and exponentially growing revenue. Come help us bring the next generation of healthcare to the people who need it. About this role: Scarlet’s Devices function is a team of clinicians, AI experts, and software engineers, working together to assess and certify the most innovative and impactful medical device software. We pride ourselves on delivering fast and efficient assessments to enable market access, new device updates and ongoing surveillance of a growing portfolio of medical devices. As we continue to scale our activities and certify more and more medical devices, we need additional medical AI expertise to provide support across all stages of the customer journey. You will play a key role in evaluating whether AI model performance testing, datasets, and clinical evidence are appropriate to support clinical benefits and performance claims under medical device regulations. YOUR RESPONSIBILITIES: - Critically evaluate AI/ML performance testing methodologies, outcome measures, datasets, and statistical analyses to determine whether they adequately support clinical and performance claims - Communicate complex statistical and AI/ML concepts clearly to internal teams, manufacturers, and customers - Deploy your expertise externally by representing Scarlet at events and conferences - Screen and action insights from the latest research on AI in healthcare - Work with our Product
Applying for this Medical AI Scientist role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Ashby
- Ashby is a fast modern ATS — most applications take under 3 minutes.
- The resume parser is strong; verify parsed experience dates and job titles.
- Custom screening questions are often scored algorithmically — answer completely.
- Location field affects geo-based screening; use your actual metro area.
ANONYMOUS · UNFILTERED
What do employees actually say about Scarlet?
Real rants from real employees. Read before you apply.