Allegis Global Solutions
Technology
AIQualityEngineer
Neural analysis suggests this role is
optimal for mid candidates.
“AI Quality Engineer at Allegis Global Solutions. Skills: AI Quality Engineering, Test automation, Evaluation frameworks. Define testing strategies for AI agents. Design behavioral test suites”
Industry & Context.
Root cause analysis
What They're Looking For.
Must Have
Code, build evaluation pipelines, Create automated testing frameworks, Define quality for AI systems, Build systems to measure quality, Work across every solution
Nice to Have
Tested system where correct was hard to define, Write test code as clean as production, Think about edge cases, Explain why quality metric matters, Built test automation that caught regressions, Comfortable saying this isn't good enough
What You'll Do.
Define testing strategies for AI agents
Design behavioral test suites
Build evaluation frameworks
Identify AI failure modes
Develop testing approaches
Build automated evaluation pipelines
Create test harnesses for LLM systems
Develop regression suites
Build monitoring and alerting
Maintain test infrastructure
Define quality metrics
Build and maintain evaluation datasets
Conduct systematic prompt evaluation
Report quality metrics
How You'll Work.
Team & Collaboration
Partner with AI Solutions Engineers
Communication Scope
Report quality metrics
Full Job Description
Working at Allegis Global Solutions (AGS) is more than just a job. It’s a career. It’s a community of people who invest in your development and empower you to blaze your own trail. Each of us is here to create real, measurable impact that moves needles. We operate beyond "roles" or "jobs" to realize the opportunity to make meaningful contributions to a bigger idea. Because we believe that when you build a workforce that’s designed to harness human enterprise, you design a workforce that’s built for impact. At AGS, we help companies all over the world transform their people into a competitive advantage. It’s not about filling seats. It’s about designing workforces to meet missions and unleash the most transformative power in business today: The power of human enterprise. With services around the globe, we have a point of view on the future of work that enables us to be a transformative partner in the way work gets done for our clients’ organizations. Meeting clients where they are, we design a plan and guide them along a transformational journey, applying bold actions and diverse minds to solve the most complex challenges – from permanent and extended workforce management to services procurement, consulting, direct sourcing and our Universal Workforce Model™. We also represent over 100 countries and speak dozens of languages. So as you’re building relationships and doing your job, you’ll be exposed to other cultures and advancement opportunities while expanding your knowledge of global markets and strategies. As a workplace, we focus on relationships – with each other, our clients and our candidates - in fact serving others is one of our core values. We support open communication and recognize that giving constructive criticism can be even harder than receiving it. We appreciate the fearless and the passionate, who force us to be better. Everything we do sits on a pillar of diversity - diverse perspectives, backgrounds and ideas drive innovation and make us successfu
Applying for this AI Quality Engineer role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on SmartRecruiters
- SmartRecruiters often includes a video screening step — check camera and mic permissions.
- Link your GitHub or portfolio directly in the profile section for technical roles.
- Applications may be reviewed by AI scoring before reaching a recruiter — use keywords from the job description.
ANONYMOUS · UNFILTERED
What do employees actually say about Allegis Global Solutions?
Real rants from real employees. Read before you apply.