Replit

Software Development Platform

StaffSoftwareEngineer,Trust&Safety

$250–315k Foster City, California, United States FULL TIME Remote Friendly
The Brief

“Staff Software Engineer, Trust & Safety at Replit. Skills: LLM Guardrails, AI-powered detection, Abuse detection systems, Automated response mechanisms. Design LLM guardrails. Build AI-powered detection systems”

What You'll Achieve.

Stay ahead of attackers; Ship systems that stop abuse at scale; Enforce platform policies without manual intervention; Turn investigation findings into new detection rules; Continuously monitor user activity; Meet tight performance SLAs; Measure detection effectiveness

Industry & Context.

Software Development Platform
Problems you'll solve

Investigate complex abuse patterns; Translate findings into automated defenses; Adapt defenses as attack patterns evolve

Eligibility Requirements

In-office requirement of Monday, Wednesday, and Friday

What They're Looking For.

Must Have

8+ years of experience in security engineering, anti-abuse, trust & safety, or fraud detection, programming skills in Python and/or TypeScript for building detection systems and automation, Experience with SQL and data analysis at scale (BigQuery, Snowflake, or similar), Experience building or fine-tuning ML/LLM-based classifiers for security or abuse detection, Ability to investigate complex abuse patterns and translate findings into automated defenses

Nice to Have

Experience at a platform company dealing with user-generated content or compute abuse, Background in fraud detection, payment abuse, or financial crime, Familiarity with device fingerprinting, IP reputation, and email validation services, Experience with CI/CD security tooling (SAST, SCA, Dependabot, Snyk), Knowledge of container security, Linux internals, or cloud infrastructure (GCP preferred), Prior work with abuse reporting pipelines, trust & safety tooling, or content moderation systems

What You'll Do.

Design LLM guardrails

Build AI-powered detection systems

Build abuse detection systems

Design automated response mechanisms

Own abuse response lifecycle

Analyze attack patterns

Maintain internal detection tools

Integrate security scanners

How You'll Work.

Team & Collaboration

Working across Security, Support, Legal, and Engineering teams; Partnering closely with Support, Legal, and cross-functional teams

Communication Scope

Clear communication skills

Free ATS check

Applying for this Staff Software Engineer, Trust & Safety role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Ashby

  • Ashby is a fast modern ATS — most applications take under 3 minutes.
  • The resume parser is strong; verify parsed experience dates and job titles.
  • Custom screening questions are often scored algorithmically — answer completely.
  • Location field affects geo-based screening; use your actual metro area.

ANONYMOUS · UNFILTERED

What do employees actually say about Replit?

Real rants from real employees. Read before you apply.

Read Company Rants →