SIXT

mobility service provider

AIQAEngineer(m/f/d)

Lisbon, Portugal FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for mid candidates.

The Brief

“AI QA Engineer (m/f/d) at SIXT. Skills: AI QA, LLM testing, conversational AI, Python, REST API testing, LLMOps. Design and execute end-to-end test plans for customer service virtual agents (voice, chat, email). Build and maintain agentic AI test suites validating autonomous workflows (e. g. , booking changes, billing, damages)”

What You'll Achieve.

ensure that SIXT’s virtual agents and Generative-AI–powered workflows deliver reliable, safe, and delightful support across all customer service channels; automatically detect regressions

Industry & Context.

mobility service provider
Problems you'll solve

analytical skills

What They're Looking For.

Must Have

2/ 3 years of experience in software QA / test engineering, understanding of testing principles: functional, regression, integration, performance, Hands-on experience testing AI or ML systems such as LLM chatbots or recommendation engines, Scripting skills in Python, experience with REST API testing, Understanding of LLMOps / MLOps: versioning, monitoring, rollback strategies, Experience or interest in customer service processes and KPIs, Excellent analytical, documentation, and communication skills

Nice to Have

Fluency in German or additional languages a plus, Familiarity with key concepts of multi-agentic systems, agentic frameworks (e. g. , LangChain), AWS AgentCore

What You'll Do.

Design and execute end-to-end test plans for customer service virtual agents (voice

Build and maintain agentic AI test suites validating autonomous workflows (e. g.

Define and monitor AI quality metrics such as resolution rate

and safety violations

Develop test data and synthetic scenarios for edge cases

and multilingual requests

Evaluate agent behavior through reasoning traces

Implement and improve automated testing frameworks for conversational flows

Contribute to LLMOps / CI/CD pipelines to automatically detect regressions

and safety testing in line with SIXT policies and regulatory expectations

and insights clearly for stakeholders

How You'll Work.

Team & Collaboration

Collaborate with cross-functional teams to refine requirements and acceptance criteria

Communication Scope

Excellent analytical, documentation, and communication skills

Full Job Description

As a AI QA Engineer (m/f/d), you ensure that SIXT’s virtual agents and Generative-AI–powered workflows deliver reliable, safe, and delightful support across all customer service channels. You design and run intelligent test strategies for LLM- and agent-based systems, combining classic QA skills with a deep understanding of agentic automation, conversational AI, and customer service KPIs. YOUR ROLE AT SIXT * Design and execute end-to-end test plans for customer service virtual agents (voice, chat, email). Build and maintain agentic AI test suites validating autonomous workflows (e.g., booking changes, billing, damages). * Define and monitor AI quality metrics such as resolution rate, deflection, CSAT, and safety violations. Develop test data and synthetic scenarios for edge cases, ambiguous queries, and multilingual requests. * Evaluate agent behavior through reasoning traces, tool-use decisions, and memory usage. * Implement and improve automated testing frameworks for conversational flows, APIs, and integrations. Contribute to LLMOps / CI/CD pipelines to automatically detect regressions. * Perform bias, fairness, and safety testing in line with SIXT policies and regulatory expectations. Collaborate with cross-functional teams to refine requirements and acceptance criteria. * Document defects, test results, and insights clearly for stakeholders. YOUR SKILLS MATTER * Foundations 2/ 3 years of experience in software QA / test engineering. Strong understanding of testing principles: functional, regression, integration, performance. * AI Testing Hands-on experience testing AI or ML systems such as LLM chatbots or recommendation engines. Familiarity with key concepts of multi-agentic systems, agentic frameworks (e.g., LangChain), AWS AgentCore. * Automation Scripting skills in Python and experience with REST API testing. * LLMOps: Understanding of LLMOps / MLOps: versioning, monitoring, rollback strategies. * Customer Focus Experience or interest in customer service pro

Free ATS check

Applying for this AI QA Engineer (m/f/d) role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on SmartRecruiters

  • SmartRecruiters often includes a video screening step — check camera and mic permissions.
  • Link your GitHub or portfolio directly in the profile section for technical roles.
  • Applications may be reviewed by AI scoring before reaching a recruiter — use keywords from the job description.

ANONYMOUS · UNFILTERED

What do employees actually say about SIXT?

Real rants from real employees. Read before you apply.

Read Company Rants →