Corto Pty Ltd
LegalTech
LeadQualityEngineer
“Lead Quality Engineer at Corto Pty Ltd. Skills: Quality Engineering, Test Automation, AI Testing, Agentic AI, Generative AI, CI/CD. Build our Automation from the ground-up. Design and build the quality foundations”
What You'll Achieve.
Streamline their workflow, boost productivity, and provide more efficient client service; Automate routine tasks, simplify document management, and enhance decision-making; Make sure that ‘fast’ stays ‘fast’ without turning into ‘fragile’; Ship products that lawyers actually trust with their work; Ship multiple times a day without breaking customer trust; Team learns fast and fixes faster; Catch AI product failures that traditional QA doesn't catch
Industry & Context.
Make ‘fast’ stay ‘fast’ without turning into ‘fragile’; Spotting the failure modes (plausible-but-wrong code, missing edge cases, silent regressions); Defaults to the customer – cares less about test coverage percentages and more about whether a lawyer using the product is going to trust what it does
Sydney-based, in-office three days a week
What They're Looking For.
Must Have
Experience shipping quality frameworks for products that went from zero to thousands of users, on small, fast-moving teams where you had to build the tooling yourself rather than hand specs to a QA team, Hands-on experience testing Generative AI or agentic systems in production – evals, LLM-as-judge, golden datasets, regression detection on non-deterministic output, cost and latency budgets, safety and hallucination checks, Deep fluency with modern test automation – unit, integration, contract, and end-to-end – across cloud services, APIs, and data pipelines, You write code, not just test plans, Worked on teams using AI-assisted coding (Claude Code, Cursor, Copilot, or similar) and have opinions on how quality practices need to adapt when humans are reviewing AI-generated code at volume
Nice to Have
Experience in document-heavy workflows, or SaaS, Experience testing document automation, forms, or structured extraction systems where correctness really matters, Experience in internal venture studios, innovation teams, startups, or product incubation environments, Background building out QE practice as the first quality hire on a team
What You'll Do.
Build our Automation from the ground-up
Design and build the quality foundations
Design and implement evaluation frameworks for agentic and generative AI features
Own the automated test stack across unit
and end-to-end layers
Build the CI/CD quality gates
Establish the feedback loops between production signals and the development cycle
Shape how the team uses AI-assisted coding tools safely
Present your thoughts
and progress clearly and confidently
How You'll Work.
Team & Collaboration
Partner with engineers to build the testing strategy, tooling, and automation; Collaborate to develop intelligent software; Work alongside our Sydney-based team; Work with engineers, product, and senior leadership alike; Gets quality work done across teams without direct authority
Communication Scope
Present your thoughts, findings, and progress clearly and confidently
Applying for this Lead Quality Engineer role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about Corto Pty Ltd?
Real rants from real employees. Read before you apply.