Amazon.com Services LLC
Artificial General Intelligence
SoftwareDevEngineer(Contract)
Neural analysis suggests this role is
optimal for Mid candidates.
“Software Dev Engineer (Contract) at Amazon.com Services LLC. Skills: Large language models, Code generation, AI evaluation. Analyze and evaluate LLM code responses. Select appropriate code solutions”
What You'll Achieve.
Refine and improve LLM output
Industry & Context.
Expert judgment; Informed decisions
12 to 24 months duration
What They're Looking For.
Must Have
Bachelor's degree or equivalent, 2+ years design or architecture experience, Experience programming at least one language
Nice to Have
3+ years full SDLC experience, Master's degree in computer science, Knowledge of professional software engineering practices, Experience evaluating AI systems, Understanding of machine learning concepts, Data analysis skills
What You'll Do.
Analyze and evaluate LLM code responses
Select appropriate code solutions
Make decisions for customers
Develop coding demonstrations
Provide feedback for evaluations
Collaborate with AI research team
Stay abreast of software engineering developments
How You'll Work.
Team & Collaboration
AI research team
Communication Scope
Detailed explanations
Full Job Description
**This is currently a temporary contract opportunity (12 to 24 months duration) based on business needs** Artificial General Intelligence (AGI) Data Services is at the forefront of AI innovation, specializing in the development and refinement of large language models (LLMs). Our mission is to create AI systems that can understand and generate high-quality code, revolutionizing the software development landscape. Key job responsibilities 1. Critically analyze and evaluate code responses generated by our LLMs across various programming languages and paradigms 2. Exercise expert judgment to select the most appropriate and efficient code solutions from multiple LLM-generated options 3. Make informed decisions on behalf of our customers, ensuring that selected code meets industry standards, best practices, and specific client needs 4. Develop and write coding demonstrations to illustrate "what good looks like" in AI-generated code, setting benchmarks for quality and efficiency 5. Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output 6. Collaborate with the AI research team to identify areas for improvement in the LLM's coding capabilities 7. Stay abreast of the latest developments in software engineering, coding standards, and AI to ensure our evaluations are accurate A day in the life As a SDE in Amazon AGI, you will play a crucial role in assessing and improving our language models' coding capabilities. Your expertise will be instrumental in evaluating LLM-generated code responses, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted coding. Basic Qualifications: - Bachelor's degree or equivalent - 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience - Experience programming with at least one software programming language Preferred Qualifications: - 3+ years of full softwar
Applying for this Software Dev Engineer (Contract) role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about Amazon.com Services LLC?
Real rants from real employees. Read before you apply.