Cohere
Data Quality (Contract)
DataAnnotationSpecialist,Safety
Neural analysis suggests this role is
optimal for Entry candidates.
“Data Annotation Specialist, Safety at Cohere. Skills: Data annotation, Safety evaluation, Content moderation, LLM evaluation. Evaluate and improve model safety. Apply nuanced safety judgment”
What You'll Achieve.
improve Large Language Model’s performance; improve safety, quality, and policy alignment; uncover unsafe, evasive, over-refusing, or policy-inconsistent responses; improve data quality
Industry & Context.
exposure to explicit content, sexual, violent, or psychologically disturbing nature, BYOD (Bring Your Own Device)
What They're Looking For.
Must Have
1+ years of experience in Content Moderation, Trust and Safety, AI data annotation, LLM evaluation, related analytical role, quality assurance, red teaming, prompt engineering, applying detailed guidelines, complex and sensitive content, contextual and sociocultural judgment, manage personal bias, Emotional resilience, working with content that contains unsafe, explicit, and/or toxic content, sexual, violent, or psychologically disturbing nature, Excellent command of written English, clearly justify content evaluations, attention to detail, commitment to accuracy, maintain consistency, high-volume and monotonous tasks, execution in a remote environment, good time management, comfort using new tools, work independently, global, asynchronous team
Nice to Have
fluent in another language
What You'll Do.
Evaluate and improve model safety
Apply nuanced safety judgment
Create prompts and safety test cases
Support quality and calibration
Work with precision and independence
How You'll Work.
Team & Collaboration
working independently in a globally distributed, asynchronous team environment
Communication Scope
Excellent command of written English; clearly justify content evaluations
Full Job Description
Who are we? Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. We like to work hard and move fast to do what’s best for our customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products. Join us on our mission and shape the future! Why this role? We are on a mission to build machines that understand the world and make them safely accessible to all. Data quality is foundational to this process. Machines (or Large Language Models to be exact) learn in similar ways to humans: by way of feedback. By labeling, ranking, auditing, prompting, red teaming, and correcting output, you will improve Large Language Model’s performance for iterations to come, thus having a lasting impact on Cohere’s tech. Cohere is looking for Data Annotation Specialists with backgrounds and skills in Trust & Safety, Content Moderation, AI model evaluation, or related fields. This role is best suited for candidates who bring strong contextual judgment, cultural and bias sensitivity, and experience applying nuanced guidelines to complex or ambiguous content. Successful candidates will be highly detail-oriented, comfortable evaluating safety risks across different user intents and scenarios, and able to make consistent, well-reasoned decisions with a high degree of independence after onboarding. IMPORTANT CONTEXT ON THIS ROLE: In this position, you will be asked to en
Applying for this Data Annotation Specialist, Safety role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Ashby
- Ashby is a fast modern ATS — most applications take under 3 minutes.
- The resume parser is strong; verify parsed experience dates and job titles.
- Custom screening questions are often scored algorithmically — answer completely.
- Location field affects geo-based screening; use your actual metro area.
ANONYMOUS · UNFILTERED
What do employees actually say about Cohere?
Real rants from real employees. Read before you apply.