Julius Baer

Financial Services

SeniorAITestAutomationEngineer

€65–90k ~AI est. Madrid, Spain FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Senior candidates.

The Brief

“Senior AI Test Automation Engineer at Julius Baer. Skills: AI Test Automation, MLOps, Python Automation, CI/CD Integration. Define test automation approach. Evolve test automation framework architecture”

Industry & Context.

Financial Services
Problems you'll solve

Root cause analysis; Flaky test investigation; Defect triage

What They're Looking For.

Must Have

5-7 years Test Automation, Substantial hands-on Python, Framework design ownership, Test execution at scale, Python-based test automation, Playwright-Python, Behave or pytest-bdd, requests + pytest, Design and own test automation frameworks, Integrate and execute automated tests, Git and version control, Clean code principles, Code review culture, API design, Microservices, Event-driven architectures, Authentication layers, SAFe and DevOps experience, Jira for Story/Feature tracking, Test management integration, End-to-end thinking, Information security awareness, Data privacy awareness, Compliant test data handling, Bachelor's or Master's degree

Nice to Have

Kubernetes basics, Testing AI/ML systems, Experience with Jira, Test management integration (Xray, Agile Hive), Experience in a regulated environment, ISTQB certifications, SAFe certifications, DevOps disciplines certifications, Fluency in Spanish

What You'll Do.

Define test automation approach

Evolve test automation framework architecture

Design reusable test automation patterns

Analyse requirements for testability

Evaluate features for testability

Evaluate stories for testability

Select test techniques

Automate identified test cases

Apply clean code principles

Design AI/ML-specific test cases

Implement AI/ML evaluation pipelines

Maintain contract tests

Integrate automated tests

Orchestrate automated tests

Provision test environments

Plan automated test executions

Schedule automated test executions

Trigger automated test executions

Monitor execution health

Investigate flaky tests

Quarantine flaky tests

Maintain low false-positive rate

Triage execution results

Raise defects in Jira

Communicate quality signals

Produce execution evidence

Contribute to PI Planning

Contribute to System Demos

Contribute to Inspect & Adapt

Ensure end-to-end traceability

Maintain BDD scenarios

Collaborate with Product Owners

Collaborate with Scrum Masters

Collaborate with ML Engineers

Collaborate with MLOps Engineers

Collaborate with Data Engineers

Align work with Test Strategy

Support reporting requirements

Support audit-ready artefacts

Support traceability matrices

Support test progress reporting

Support root cause analysis

Consult squads on automation design

Consult squads on framework usage

Consult squads on tooling choices

Consult squads on test data strategy

Design AI/ML-specific test datasets

Ensure continued compliance

How You'll Work.

Team & Collaboration

Across squads; With Product Owners; With Scrum Masters; With ML Engineers; With MLOps Engineers; With Data Engineers; With Test Managers; With Architects

Communication Scope

Quality signals communication; Reporting

Process & Methodology

SAFe, Agile Release Train

Full Job Description

At Julius Baer, we celebrate and value the individual qualities you bring, enabling you to be impactful, to be entrepreneurial, to be empowered, and to create value beyond wealth. Let’s shape the future of wealth management together. You will join our ML & AI ART as a Senior AI Test Automation Engineer, responsible for the technical test automation solution supporting our AI and MLOps platform. The platform powers AI-driven capabilities across the Bank including RAG systems, LLM-based assistants, agentic workflows, and ML pipelines serving business-critical use cases. You will own the architecture, implementation, and execution of our test automation frameworks, covering both traditional software components (APIs, UIs, data pipelines) and emerging AI/ML-specific behaviour , and act as the Test Automation Ambassador within the ART. You will work within the Bank's Test Strategy, while owning the technical depth and hands-on delivery of automation for your platform. ## **YOUR CHALLENGE** * Define and evolve the technical test automation approach and framework architecture for the ML & AI ART, aligned with the Bank's Test Strategy and Test Policy * Design reusable, scalable test automation patterns (page objects, API clients, test data builders) that other engineers across squads can adopt, ensuring technical consistency of test automation across the ART * Analyse and evaluate requirements, Features, and Stories for testability during PI Planning, Backlog Refinement, and Iteration Planning * Derive test cases from technical and risk analysis of both functional and non-functional requirements (reliability, performance, security, usability, robustness), selecting appropriate test techniques and automation scope based on risk, coverage goals, and ROI * Automate identified test cases using Python-based frameworks — Playwright-Python for UI, requests + pytest for APIs, Behave or pytest-bdd for BDD/Gherkin — applying clean code principles, reusability, readability, and stabil

Free ATS check

Applying for this Senior AI Test Automation Engineer role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Workday

  • Workday has a multi-step form — save your progress after every section.
  • "Apply With LinkedIn" can fail or lose data; manual entry is more reliable.
  • Watch for the "Submit for Review" final step — hitting "Save" alone does not submit.
  • Job requisition numbers are useful when following up with HR by email.

ANONYMOUS · UNFILTERED

What do employees actually say about Julius Baer?

Real rants from real employees. Read before you apply.

Read Company Rants →