EarnIn
GenAIContractor
Neural analysis suggests this role is
optimal for Mid+ candidates.
“GenAI Contractor at EarnIn. Skills: Gen AI, LLM evaluation, Analytics Engineering. Build and run evaluations for LLM-powered chatbot systems. Support design and calibration of LLM-as-judge scorers”
What You'll Achieve.
Deliver the best agentic experience; Make evals a standard practice; Align automated scoring with human ground truth; Detect chatbot performance degradation before customers feel it; Surface insights that drive chatbot improvements
Industry & Context.
Analytical thinking
Contract role from July 2026 to February 2027, Targeting university students, Two days a week in the office
What They're Looking For.
Must Have
Bachelor's Degree in Computer Science, Mathematics, Physics, or any engineering field, Familiarity with Python, Comfort working with APIs, Comfort working with data pipelines, Comfort working with scripting, Analytical thinking, Clear written and verbal communication
Nice to Have
Master's Degree, PhD, Basic understanding of NLP concepts, Hands-on experience with LLMs, Understanding of probability theory, Understanding of stochastic systems
What You'll Do.
Build and run evaluations for LLM-powered chatbot systems
Support design and calibration of LLM-as-judge scorers
Contribute to conversation simulation
Contribute to replay infrastructure
Assist with real-time observability tooling
Detect chatbot performance degradation
Analyze production conversations
Surface insights that drive chatbot improvements
Iterate on prompt mutations
Iterate on model changes
Iterate on evaluation pipelines
How You'll Work.
Team & Collaboration
Working closely with subject matter experts; Work alongside ML engineers; Work alongside analysts
Communication Scope
Translate findings for technical audiences; Translate findings for non-technical audiences
Full Job Description
About EarnIn As one of the first pioneers of earned wage access, our passion at EarnIn is building products that deliver real-time financial flexibility for those with the unique needs of living paycheck to paycheck. Our community members access their earnings as they earn them, with options to spend, save, and grow their money without mandatory fees, interest rates, or credit checks. We’re fortunate to have an incredibly experienced leadership team, combined with world-class funding partners like A16Z, Matrix Partners, DST, Ribbit Capital, and a very healthy core business with a tremendous runway. We’re growing fast and are excited to continue bringing world-class talent onboard to help shape the next chapter of our growth journey. Hiring Manager: Ziv Recruiter: Dilip Level: I1 POSITION SUMMARY EarnIn's Gen AI Team is on a mission to deliver the best agentic experience for our customers — accurate, fast, and set up for success. At the heart of that mission is Evaluation-Driven Development (EDD): a closed loop of human judgment and calibrated LLM scorers that lets us ship new chatbot capabilities with confidence, measure performance in real time, and tie every change to business outcomes. To help us execute on this vision, we are hiring a Gen AI Contractor for the Analytics Engineering Team. This position will be based in Bengaluru, India, as part of our expanding site, and is a contract role from July 2026 to February 2027, targeting university students. This role requires two days a week in the office as part of our growing site location. WHAT YOU'LL DO Help build and run evaluations for our LLM-powered chatbot systems, contributing to our goal of making evals a standard practice across all teams at EarnIn Support the design and calibration of LLM-as-judge scorers, working closely with subject matter experts (SMEs) to align automated scoring with human ground truth Contribute to conversation simulation and replay infrastructure — a core building block of our autom
Applying for this GenAI Contractor role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Greenhouse
- Create a Greenhouse profile before applying — it saves time across multiple applications.
- Upload your resume as a PDF; the parser handles it better than Word.
- Answer all knockout questions carefully — wrong answers auto-reject before a human sees you.
- Enable email notifications to track application status in real time.
ANONYMOUS · UNFILTERED
What do employees actually say about EarnIn?
Real rants from real employees. Read before you apply.