Clinically AI
Healthcare AI
Quality&ReliabilityEngineer(AISystems&WorkflowAssurance)
Neural analysis suggests this role is
optimal for Mid candidates.
“Quality & Reliability Engineer (AI Systems & Workflow Assurance) at Clinically AI. Skills: Quality Engineering, AI Systems, Workflow Assurance, Reliability Engineering. Ensure stability, correctness, performance of AI-native healthcare workflows. Validate system correctness”
What You'll Achieve.
Ensure clinicians, administrators, compliance teams, and operational users can confidently rely on AI-powered systems
Industry & Context.
Analytical Judgment; isolate failures across frontend, backend, APIs, and distributed systems
Onsite work required Monday through Thursday
What They're Looking For.
Must Have
3+ years of experience in QA engineering, software testing, or reliability engineering roles in SaaS, web applications, or platform environments, Experience building automated test suites using Playwright or similar frameworks (Cypress, Selenium, WebdriverIO, etc. ), understanding of frontend behavior, browser debugging tools, and network inspection, Experience validating REST APIs, including authentication, permissions, and data integrity, Proficiency in JavaScript or TypeScript for test automation, Experience working within CI/CD pipelines (GitHub Actions preferred), ability to identify root causes and communicate technical findings clearly, Experience collaborating closely with engineering and product teams in agile environments, High ownership mindset and ability to operate in fast-paced, evolving systems
Nice to Have
Experience testing React applications, browser extensions, or real-time web systems, Exposure to mobile testing environments (iOS/Android), Experience with performance or load testing tools (k6, JMeter, Locust), Familiarity with cloud infrastructure and distributed systems, Experience working in regulated environments (HIPAA, SOC2, NIST), Experience testing AI/LLM-powered or non-deterministic systems
What You'll Do.
performance of AI-native healthcare workflows
Validate system correctness
Identify edge cases in workflow behavior
Improve release confidence
Ensure AI-driven outputs behave reliably
Validate AI-native systems
Design reliability strategy for AI-assisted workflow systems
How You'll Work.
Team & Collaboration
Work closely with product, engineering, implementation, and leadership teams; Collaborate across engineering, product, and implementation teams; Collaborating closely with engineering and product teams in agile environments
Communication Scope
communicate technical findings clearly; communicate effectively
Full Job Description
Clinically AI is a healthcare AI company transforming how clinicians, administrators, compliance teams, and healthcare organizations manage documentation, chart auditing, and operational workflows through artificial intelligence. We are seeking a Quality & Reliability Engineer to ensure the stability, correctness, and performance of AI-native healthcare workflows and operational systems across the Clinically AI platform. This is not a traditional QA role focused only on manual testing or end-of-cycle validation. This role sits at the intersection of software reliability, workflow systems testing, AI behavior validation, and operational quality engineering in complex healthcare environments. You will ensure that clinicians, administrators, compliance teams, and operational users can confidently rely on AI-powered systems in real-world healthcare workflows. This includes validating system correctness, identifying edge cases in workflow behavior, improving release confidence, and ensuring that AI-driven outputs behave reliably within operational constraints. The ideal candidate thinks deeply about systems, workflows, edge cases, failure modes, and operational behavior, not just test cases. You should be excited by ensuring reliability in AI-native systems where outputs may be probabilistic, workflows are complex, and correctness directly impacts clinical operations. This role will work closely with product, engineering, implementation, and leadership teams in a highly collaborative and fast-moving startup environment. KEY ATTRIBUTES TO SUCCEED - Systems Reliability Thinking You think beyond individual features and care deeply about how systems behave across workflows, services, and real-world usage conditions. - AI-Native Testing Mindset You understand how AI changes software behavior, especially in non-deterministic systems where outputs require workflow-aware validation. - Workflow Awareness You understand how clinicians, administrators, and operational teams interac
Applying for this Quality & Reliability Engineer (AI Systems & Workflow Assurance) role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Ashby
- Ashby is a fast modern ATS — most applications take under 3 minutes.
- The resume parser is strong; verify parsed experience dates and job titles.
- Custom screening questions are often scored algorithmically — answer completely.
- Location field affects geo-based screening; use your actual metro area.
ANONYMOUS · UNFILTERED
What do employees actually say about Clinically AI?
Real rants from real employees. Read before you apply.