Amazon.com Services LLC
Software Development, consumer engagement
SeniorSoftwareDevelopmentEngineer,StoresFoundationalAIRufus
“Senior Software Development Engineer, Stores Foundational AI - Rufus at Amazon.com Services LLC. Skills: LLM inference, Kernel optimization, ML acceleration. Architect high-performance kernels. Design high-performance kernels”
What You'll Achieve.
Maximize hardware utilization; Minimize computational overhead; Unlock unprecedented LLM performance
Industry & Context.
What They're Looking For.
Must Have
5+ years software development experience, 5+ years programming experience, 5+ years leading design or architecture, Experience as a mentor, Experience as a tech lead, Experience leading an engineering team, Experience with vLLM, Experience with SGLang, Experience with TensorRT, Experience with CUDA kernels, Experience with ML kernels, Experience with low-level kernels
Nice to Have
5+ years full software development life cycle, Bachelor's degree in computer science, Machine Learning fundamentals, Large Language Model fundamentals, Model training lifecycles, Model inference lifecycles, Optimization of model execution
What You'll Do.
Architect high-performance kernels
Design high-performance kernels
Develop high-performance kernels
Optimize high-performance kernels
Create innovative kernels
Optimize innovative kernels
Create custom operators
Optimize custom operators
Create low-level optimizations
Optimize low-level optimizations
Establish best practices for kernel development
Establish best practices for memory management
Establish best practices for parallel computing
Reduce inference latency
Develop kernel fusion techniques
Optimize attention mechanisms
Accelerate matrix multiplication
Deliver measurable performance gains
Drive technical roadmap
Perform performance benchmarking
Focus on kernel-level improvements
How You'll Work.
Team & Collaboration
Working alongside scientists; Working alongside engineers; Working alongside TPMs; Partnering with engineers; Partnering with scientists
Applying for this Senior Software Development Engineer, Stores Foundational AI - Rufus role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about Amazon.com Services LLC?
Real rants from real employees. Read before you apply.