Comcast
media and technology
DevelopmentEngineerinTest(SDET)–ML&LLMSystems
Neural analysis suggests this role is
optimal for Mid candidates.
“Development Engineer in Test (SDET) – ML & LLM Systems at Comcast. Skills: Machine Learning, LLM evaluation frameworks, test automation frameworks, CI/CD pipelines, API testing. Partner with product owners, engineers, and internal stakeholders to understand product functionality, technical requirements, and quality analyze testing needs and define appropriate automation strategies. Design, develop, and maintain robust automated test code using software engineering best practices, ensuring reusab”
What You'll Achieve.
ensure model reliability, performance, and responsible deployment; maintain release quality; ensure system reliability and rapid recovery; continuously improve test coverage, automation effectiveness, and end‑to‑end customer experience
Industry & Context.
Investigate failing tests; diagnose root causes; implement fixes to improve test stability and confidence; analytical
Must be able to work nights and weekends, variable schedule(s) and overtime as necessary
What They're Looking For.
Must Have
2+ years of industry experience as a Software Development Engineer in Test (SDET), experience with API testing, solid understanding of RESTful APIs, Hands-on experience with test processes, test design, test case creation, and defect management systems, coding skills with hands-on experience in Java and Spring Boot, and Python, Prior Experience with testing Machine Learning models, NLP services, Large Language Models (LLMs) and LLM evaluation frameworks, Demonstrated ability to design, build, and maintain test automation frameworks, Comfortable working in Linux, hands-on experience with container technologies such as Docker and Kubernetes, Experience building or working with CI/CD pipelines using tools such as Jenkins, Working knowledge of AWS services, including S3, Experience with NoSQL databases such as MongoDB, Familiarity with Agile development methodologies and working within cross-functional Scrum teams, written and verbal communication skills, Highly detail-oriented, analytical, and proactive, with a passion for quality, automation, and continuous improvement
Nice to Have
Prior Comcast experience preferred
What You'll Do.
Partner with product owners
and internal stakeholders to understand product functionality
technical requirements
and quality analyze testing needs and define appropriate automation strategies
and maintain robust automated test code using software engineering best practices
Develop and enhance automated test suites for functional
and performance testing across machine learning models
and supporting backend services
Execute automated and manual tests as part of build validation to ensure expected behavior and maintain release quality
Design and implement robust test strategies and automation frameworks to support evolving services
and ML model testing requirements
Develop and maintain automated validation pipelines for data ingestion
and anomaly detection across large-scale datasets
Perform model validation and verification
including accuracy benchmarking
and reproducibility checks before and after deployment
Investigate failing tests
and implement fixes to improve test stability and confidence
Review automation code contributed by peers
providing constructive feedback aligned with internal coding and quality standards
Coordinate QA and production build deployments in collaboration with engineering and infrastructure teams
Support triage and resolution of integration and production issues to ensure system reliability and rapid recovery
Communicate clearly and effectively with team members and leadership regarding risks
and quality improvements
Collaborate with engineering
and leadership partners to continuously improve test coverage
automation effectiveness
and end‑to‑end customer experience
Stay current with emerging test tools
and help evolve internal testing practices
Contribute to additional team initiatives and responsibilities as business needs evolve
consistent and punctual attendance
Must be able to work nights and weekends
variable schedule(s) and overtime as necessary
How You'll Work.
Team & Collaboration
Partner with product owners, engineers, and internal stakeholders; Collaborate with engineering, product, and leadership partners; Review automation code contributed by peers; Coordinate QA and production build deployments in collaboration with engineering and infrastructure teams
Communication Scope
written communication skills; verbal communication skills; ability to collaborate effectively across teams; Communicate clearly and effectively with team members and leadership regarding risks, test results, priorities, and quality improvements
Full Job Description
Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. Join us. You’ll do the best work of your career right here at Comcast. (In most cases, Comcast prefers to have employees on-site collaborating unless the team has been designated as virtual due to the nature of their work. If a position is listed with both office locations and virtual offerings, Comcast may be willing to consider candidates who live greater than 100 miles from the office for the remote option.) **Job Summary** This team operates at the forefront of applied machine learning, focusing on niche and highly specialized technologies such as NLP pipelines, large language model (LLM) evaluations, and ML quality frameworks. Unlike teams that primarily train or consume models, this group specializes in evaluating, validating, and measuring LLM behavior, playing a critical role in ensuring model reliability, performance, and responsible deployment. Engineers on the team gain deep, market‑relevant expertise by continuously adapting to rapidly evolving LLM architectures, evaluation metrics, and benchmarks. The work is fast‑moving, highly technical, and offers exposure to cutting‑edge challenges that few teams encounter, making it an exciting environment for engineers who want to stay ahead of the curve in the LLM and AI evaluation space. **Job Description** **Key Responsibilities** * Partner with product owners, engineers, and internal stakeholders to understand product functionality, technical requirements, and quality expe
Applying for this Development Engineer in Test (SDET) – ML & LLM Systems role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Workday
- Workday has a multi-step form — save your progress after every section.
- "Apply With LinkedIn" can fail or lose data; manual entry is more reliable.
- Watch for the "Submit for Review" final step — hitting "Save" alone does not submit.
- Job requisition numbers are useful when following up with HR by email.
ANONYMOUS · UNFILTERED
What do employees actually say about Comcast?
Real rants from real employees. Read before you apply.