Sr.SoftwareEngineer(ML),AGIFoundations

Are you passionate about advancing the accuracy and efficiency of Artificial General Intelligence (AGI) systems? If so, you're at the right place! Our team powers the Amazon Nova family of models, and we are looking for a driven and adaptable SDE to join us. As an SDE on our team, you will leverage your deep technical expertise to build reliable, scalable, and highly performant AI systems for inference and evaluation of Nova models. You will collaborate closely with the Applied Scientists to automate hosting of multimodal LLMs and run evaluations against industry standard as well as customized benchmarks to generate model cards, identify gaps in model performance, and inform strategies to bridge those gaps. We operate at Amazon's large scale with the energy of a nimble start-up. If you have a learner's mindset, enjoy solving challenging problems, and value an inclusive team culture, you will thrive in this role, and we hope to hear from you. Key job responsibilities The ideal candidate for this role has a demonstrable track record of delivering successfully in a hyper-growth ML/AI environment by leveraging their deep technical expertise and adapting deftly to rapidly-evolving priorities. Responsibilities - Lead the development and maintenance of key software components for inference and evaluation for Nova family of models. - Design and implement solutions that scale from running single evaluations to a whole suite of evaluations on a regular cadence for multiple models - Propose strategies to optimize the use of compute infrastructure to manage costs - Manage project prioritization, deliverables, and timelines. - Champion best practices for maintaining a high bar on operational excellence - Illuminate trade-offs, educate the team on best practices, and influence technical strategy. - Collaborate closely with Applied Scientists to investigate and plan experiments, prototype new technology, and evaluate technical feasibility. - Communicate effectively with both techn