AIQAEngineer(m/f/d)

As a Customer Service Agentic AI QA Engineer (m/f/d), you ensure that SIXT’s virtual agents and Generative-AI–powered workflows deliver reliable, safe, and delightful support across all customer service channels. You design and run intelligent test strategies for LLM- and agent-based systems, combining classic QA skills with a deep understanding of agentic automation, conversational AI, and customer service KPIs. YOUR ROLE AT SIXT * Design and execute end-to-end test plans for customer service virtual agents (voice, chat, email). Build and maintain agentic AI test suites validating autonomous workflows (e.g., booking changes, billing, damages). * Define and monitor AI quality metrics such as resolution rate, deflection, CSAT, and safety violations. Develop test data and synthetic scenarios for edge cases, ambiguous queries, and multilingual requests. * Evaluate agent behavior through reasoning traces, tool-use decisions, and memory usage. * Implement and improve automated testing frameworks for conversational flows, APIs, and integrations. Contribute to LLMOps / CI/CD pipelines to automatically detect regressions. * Perform bias, fairness, and safety testing in line with SIXT policies and regulatory expectations. Collaborate with cross-functional teams to refine requirements and acceptance criteria. * Document defects, test results, and insights clearly for stakeholders. YOUR SKILLS MATTER * Foundations Several years of experience in software QA / test engineering. Strong understanding of testing principles: functional, regression, integration, performance. * AI Testing Hands-on experience testing AI or ML systems such as LLM chatbots or recommendation engines. Familiarity with key concepts of multi-agentic systems, agentic frameworks (e.g., LangChain), AWS AgentCore. * Automation Scripting skills in Python and experience with REST API testing. * LLMOps: Understanding of LLMOps / MLOps: versioning, monitoring, rollback strategies. * Customer Focus Experience or inte