Lifted, an Upwork Company™
Staffing And Recruiting
AICodeReviewer&SystemsEvaluationEngineer
Neural analysis suggests this role is
optimal for not-applicable candidates.
“AI Code Reviewer & Systems Evaluation Engineer at Lifted, an Upwork Company™. Skills: backend engineering, AI automation, systems integration, programming languages, SQL databases, production-grade systems, live environments, multi-step interactions, multi-stage system workflows, integrating tools, APIs, databases, external platforms, system vulnerabilities, AI systems, agent-based workflows, persistent state tracking. Develop objective, verifiable evaluation criteria (rubrics) for system perfor”
What You'll Achieve.
improving advanced AI systems; training large language models to better understand software development practices, debugging, and code quality; enhancing how AI systems write, review, and optimize code in real-world scenarios; shaping how AI models evaluate performance, detect issues, and generate reliable outputs; improve reliability and code quality; optimize system behavior toward ideal outcomes
Industry & Context.
analyzing systems; improving code quality; working on complex technical challenges; refining logic; identifying potential vulnerabilities
Project-based engagement with no guaranteed hours, Work on tasks based on availability and project assignment, Payment is based on completed tasks only, Must accept project invitations before beginning work, Freelancers may accept or decline tasks depending on availability, No guaranteed volume may vary weekly
What They're Looking For.
Must Have
2+ years of experience in backend engineering, AI automation, or systems integration, proficiency in at least two programming languages (e. g. , Python, JavaScript, Go, Java), Experience working with SQL databases, Proven ability to build and maintain production-grade systems, Experience working in live (non-mocked) environments with multi-step interactions, analytical skills and attention to detail
Nice to Have
Experience with multi-stage system workflows and coordination tasks, Familiarity with integrating tools such as APIs, databases, or external platforms, Understanding of system vulnerabilities (e. g. , privacy leaks, prompt injection, access escalation), Experience working with AI systems or agent-based workflows, Comfort working with persistent state tracking or similar frameworks
What You'll Do.
verifiable evaluation criteria (rubrics) for system performance
Review system logs and execution paths to improve reliability and code quality
Refactor code and optimize system behavior toward ideal outcomes
Test systems for vulnerabilities
including data exposure and edge-case failures
high-quality feedback on system performance and outputs
contribute to AI training projects by evaluating outputs
and identifying potential vulnerabilities
How You'll Work.
Communication Scope
Provide detailed, high-quality feedback
Full Job Description
An enterprise client is currently seeking experienced software engineers to contribute to improving advanced AI systems through human feedback. This work supports leading AI organizations in training large language models to better understand software development practices, debugging, and code quality. This is part of a cutting-edge initiative focused on enhancing how AI systems write, review, and optimize code in real-world scenarios. You’ll play a key role in shaping how AI models evaluate performance, detect issues, and generate reliable outputs. This opportunity is ideal for engineers who enjoy analyzing systems, improving code quality, and working on complex technical challenges. You will contribute to AI training projects by evaluating outputs, refining logic, and identifying potential vulnerabilities. What You'll Do: * Develop objective, verifiable evaluation criteria (rubrics) for system performance * Review system logs and execution paths to improve reliability and code quality * Refactor code and optimize system behavior toward ideal outcomes * Test systems for vulnerabilities, including data exposure and edge-case failures * Provide detailed, high-quality feedback on system performance and outputs ## Qualifications Requirements: * 2+ years of experience in backend engineering, AI automation, or systems integration * Strong proficiency in at least two programming languages (e.g., Python, JavaScript, Go, Java) * Experience working with SQL databases * Proven ability to build and maintain production-grade systems * Experience working in live (non-mocked) environments with multi-step interactions * Strong analytical skills and attention to detail Nice to Haves: * Experience with multi-stage system workflows and coordination tasks * Familiarity with integrating tools such as APIs, databases, or external platforms * Understanding of system vulnerabilities (e.g., privacy leaks, prompt injection, access escalation) * Experience working with AI systems or agent-ba
Applying for this AI Code Reviewer & Systems Evaluation Engineer role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on SmartRecruiters
- SmartRecruiters often includes a video screening step — check camera and mic permissions.
- Link your GitHub or portfolio directly in the profile section for technical roles.
- Applications may be reviewed by AI scoring before reaching a recruiter — use keywords from the job description.
ANONYMOUS · UNFILTERED
What do employees actually say about Lifted, an Upwork Company™?
Real rants from real employees. Read before you apply.