ADCI
Software Development, alexa and amazon devices
SDETSoftwareEngTest,AlexaAI
“SDET - Software Eng Test, Alexa AI at ADCI. Skills: LLM-based evaluation, Conversational intelligence, Automated systems, Prompt-driven evaluation. Design frameworks for conversational intelligence. Build frameworks for conversational intelligence”
What You'll Achieve.
Ensure assessments remain consistent; Ensure assessments remain explainable; Ensure assessments remain scalable; Ensure every voice interaction feels conversational
Industry & Context.
Root cause analysis
What They're Looking For.
Must Have
4+ years of experience as SDET, Proficiency in Java, Python, or JavaScript, Hands-on experience building automation frameworks, Understanding of API testing, Understanding of data-driven validation, Understanding of test metrics, Excellent problem-solving skills, Ability to dive deep into complex systems, Communication and collaboration skills
Nice to Have
Knowledge of system architecture, Knowledge of scalability, Knowledge of reliability, Knowledge of performance in database environment, Experience with security in service-oriented architectures, Experience with security in web services, Master's degree in Computer Science, Experience with AWS or cloud technologies, Experience with LLM-based evaluation, Experience with prompt-driven testing, Experience with LLM-as-a-Judge frameworks, Hands-on experience using AI frameworks, Hands-on experience using LLM-based frameworks, Ability to design semantic validation, Ability to design behavioral validation, Proven record of collaborating with scientists, Proven record of collaborating with engineers, Define measurable AI quality metrics
What You'll Do.
Design frameworks for conversational intelligence
Build frameworks for conversational intelligence
Engineer automated systems to assess AI responses
Assess accuracy of AI responses
Assess reasoning depth of AI responses
Assess tone of AI responses
Assess responsiveness of AI responses
Automate detection of conversational regressions
Identify hallucinations
Identify degraded reasoning
Identify misaligned tones
Collaborate with prompt engineers
Collaborate with model developers
Collaborate with product teams
Establish testing methodologies
Ensure voice interaction feels conversational
How You'll Work.
Team & Collaboration
Partnering with scientists; Partnering with engineers; Collaborate with prompt engineers; Collaborate with model developers; Collaborate with product teams
Communication Scope
Communication skills
Applying for this SDET - Software Eng Test, Alexa AI role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about ADCI?
Real rants from real employees. Read before you apply.