Amazon.com Services LLC

Artificial General Intelligence

SoftwareDevEngineer(Contract)

$0–0k Bellevue, Washington, United States FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Mid candidates.

The Brief

“Software Dev Engineer (Contract) at Amazon.com Services LLC. Skills: Large language models, Code generation, AI evaluation. Analyze and evaluate LLM code responses. Select appropriate code solutions”

What You'll Achieve.

Refine and improve LLM output

Industry & Context.

Artificial General Intelligence
Problems you'll solve

Expert judgment; Informed decisions

Eligibility Requirements

12 to 24 months duration

What They're Looking For.

Must Have

Bachelor's degree or equivalent, 2+ years design or architecture experience, Experience programming at least one language

Nice to Have

3+ years full SDLC experience, Master's degree in computer science, Knowledge of professional software engineering practices, Experience evaluating AI systems, Understanding of machine learning concepts, Data analysis skills

What You'll Do.

Analyze and evaluate LLM code responses

Select appropriate code solutions

Make decisions for customers

Develop coding demonstrations

Provide feedback for evaluations

Collaborate with AI research team

Stay abreast of software engineering developments

How You'll Work.

Team & Collaboration

AI research team

Communication Scope

Detailed explanations

Full Job Description

**This is currently a temporary contract opportunity (12 to 24 months duration) based on business needs** Artificial General Intelligence (AGI) Data Services is at the forefront of AI innovation, specializing in the development and refinement of large language models (LLMs). Our mission is to create AI systems that can understand and generate high-quality code, revolutionizing the software development landscape. Key job responsibilities 1. Critically analyze and evaluate code responses generated by our LLMs across various programming languages and paradigms 2. Exercise expert judgment to select the most appropriate and efficient code solutions from multiple LLM-generated options 3. Make informed decisions on behalf of our customers, ensuring that selected code meets industry standards, best practices, and specific client needs 4. Develop and write coding demonstrations to illustrate "what good looks like" in AI-generated code, setting benchmarks for quality and efficiency 5. Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output 6. Collaborate with the AI research team to identify areas for improvement in the LLM's coding capabilities 7. Stay abreast of the latest developments in software engineering, coding standards, and AI to ensure our evaluations are accurate A day in the life As a SDE in Amazon AGI, you will play a crucial role in assessing and improving our language models' coding capabilities. Your expertise will be instrumental in evaluating LLM-generated code responses, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted coding. Basic Qualifications: - Bachelor's degree or equivalent - 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience - Experience programming with at least one software programming language Preferred Qualifications: - 3+ years of full softwar

Free ATS check

Applying for this Software Dev Engineer (Contract) role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

ANONYMOUS · UNFILTERED

What do employees actually say about Amazon.com Services LLC?

Real rants from real employees. Read before you apply.

Read Company Rants →