Cogeco
Specialist,QATestAutomation
“Specialist, QA Test Automation at Cogeco. Skills: QA Test Automation, Python, Probabilistic Testing, AI Evaluation. Implement testing workflows for AI solutions. Build guardrails for model drift”
Industry & Context.
Analytical Deep-Dives; Debugging prompts; Troubleshooting technical blockers independently
What They're Looking For.
Must Have
College diploma or Degree in Computer Science, Engineering, or a related discipline (or equivalent practical experience), 3 + years of experience in Quality Assurance, Software Engineering, or Data Engineering, Experience in Python or JavaScript/TypeScript, Experience with test automation frameworks, API testing, code repositories (Git)
Nice to Have
Exposure to Golden Datasets: creating, maintenance, and/or scaling of high-quality golden datasets used as the source of truth for benchmarking model changes, Exposure to AI Eval Tooling: Champion programmatic evaluation tools such as Promptfoo, DeepEval, or Ragas to automate the assessment of prompt variants and model performance, CI/CD Familiarity: Experience working with pipeline tools (e. g. , Bitbucket pipelines, Google Cloud run, GitHub Actions, GitLab CI, Jenkins)
What You'll Do.
Implement testing workflows for AI solutions
Build guardrails for model drift
Create golden datasets
Champion programmatic evaluation tools
Translate AI QA frameworks into tasks
Provide feedback on strategy performance
Inject AI evaluation metrics into CI/CD
Validate data pipelines
How You'll Work.
Team & Collaboration
Work closely with Chapter Lead, QA; Embedded within Cogeco’s AI squads; Partner closely with the Chapter Lead, QA; Collaborate with DevOps specialists; Communicate technical testing gaps to AI developers; Communicate technical testing gaps to product owners; Squad Partner
Communication Scope
Communicate technical testing gaps clearly
Applying for this Specialist, QA Test Automation role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Workday
- Workday has a multi-step form — save your progress after every section.
- "Apply With LinkedIn" can fail or lose data; manual entry is more reliable.
- Watch for the "Submit for Review" final step — hitting "Save" alone does not submit.
- Job requisition numbers are useful when following up with HR by email.
ANONYMOUS · UNFILTERED
What do employees actually say about Cogeco?
Real rants from real employees. Read before you apply.