MachineLearningPerformanceEngineer

Our team is responsible for the AWS Neuron software stack, which powers Generative AI and other advanced ML workloads on AWS's custom-built ML accelerators — Inferentia and Trainium. These accelerators deliver best-in-class performance and cost-efficiency for ML inference and training in the cloud. We're building a new core group of engineers in TLV (Tel Aviv) to drive innovation in ML systems performance and software. As a Machine Learning Performance Engineer, you'll help shape the direction of the team from the ground up and work on: Optimizing system performance across the entire ML software stack Analyzing high-performance ML workloads running on Annapurna hardware Developing high-performance kernels for critical ML operations Enhancing the Neuron SDK to improve developer experience and system capabilities Collaborating across Compiler, Frameworks, and Hardware teams to maximize end-to-end performance As part of the Performance Engineering Team, you'll contribute to projects involving instruction scheduling, memory management, parallelism, kernel optimization, and compiler enhancements to maximize end-to-end performance. This is a unique opportunity to be at the intersection of ML and systems within AWS, helping to build the future of AI infrastructure — right here in Tel Aviv. Key job responsibilities Our engineers collaborate across diverse teams, projects, and environments to have a firsthand impact on our global customer base. You will: Solve challenging technical problems, often ones not solved before, at every layer of the stack. Design, implement, test, deploy and maintain innovative software solutions to transform service performance, durability, cost, and security. Research implementations that deliver the best possible experiences for customers. A day in the life As you design and code solutions to help our team drive efficiencies in software architecture, you’ll create metrics, implement automation and other improvements, and resolve the root cause o