Amazon.com Services LLC

Applied Science, no business category

PrincipalAppliedScientist,MLCodesign

$309–700k Sunnyvale, California, United States FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Principal candidates.

The Brief

“Principal Applied Scientist, ML Codesign at Amazon.com Services LLC. Skills: ML Codesign, Compression science, Silicon design, Hardware architecture. Define hardware-aware compression roadmap. Work backward from accuracy targets”

Industry & Context.

Applied Science, no business category

What They're Looking For.

Must Have

Master's or PhD in Computer Science, Eight or more years of industry experience, Track record of first-author or senior-author publications, Demonstrated experience defining or co-defining a hardware architecture, Deep expertise in at least two of the following: low-bit quantization, structured and unstructured pruning, knowledge distillation, sparse computation, hardware-aware neural architecture search, Working knowledge of computer architecture fundamentals

Nice to Have

Direct experience contributing to silicon architecture, Published work demonstrating hardware-software codesign, Experience applying compression techniques at large-model scale, Familiarity with ASIC development flow, Familiarity with RTL review, Familiarity with compiler intermediate representations, Experience with Mixture-of-Experts (MoE) inference architectures, Track record of mentoring senior applied scientists, Shaping a multi-year research agenda, Prior experience with vertically integrated stacks

What You'll Do.

Define hardware-aware compression roadmap

Work backward from accuracy targets

Own joint optimization of compression algorithms

Represent applied science in silicon architecture reviews

Influence decisions across memory and compute subsystems

Set science roadmap for compression techniques

Mentor senior and mid-level applied scientists

Serve as technical leader for codesign agenda

Accountable to senior leadership review

How You'll Work.

Team & Collaboration

Applied Science team; Silicon Engineering team; Compiler and Runtime team

Full Job Description

Define the joint optimization of model compression and silicon architecture for Amazon's next generation of edge and cloud inference accelerators. Your work will set the technical targets that propagate across the model, compiler, runtime, and silicon stack. We are hiring a Principal Applied Scientist to be the technical leader who closes the loop between compression science and silicon design. Today's generation ships advanced quantization and large-model distillation in production, running multi-billion parameter language models at inference economics typical of much larger systems. Future generations target significantly larger models at the edge and in the cloud. You will be a principal architect of the next-generation accelerator and of the compression algorithms it executes natively. Few roles in the industry let one technical leader influence the model, the compiler, the runtime, and the silicon without organizational friction. This is one of them. You have spent the last several years thinking about why hardware decisions and accuracy decisions live in different teams, and you want to be the person who owns both. You have published at MLSys, ISCA, MICRO, NeurIPS, or ICML on quantization, pruning, or hardware-aware training, and you want your next paper to ship in a chip rather than in a benchmark suite. You want a vertical stack—model, compression, compiler, runtime, operating system, silicon—where the same engineering organization owns every layer and a principal architect can move all of them. Key job responsibilities • Define the hardware-aware compression roadmap for next-generation accelerators, working backward from accuracy targets on standard language and reasoning benchmarks including Massive Multitask Language Understanding (MMLU), GSM8K, HumanEval, and Instruction Following Evaluation (IFEval). • Own the joint optimization of compression algorithms (post-training quantization, quantization-aware training, knowledge distillation, structured pruning

Free ATS check

Applying for this Principal Applied Scientist, ML Codesign role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

ANONYMOUS · UNFILTERED

What do employees actually say about Amazon.com Services LLC?

Real rants from real employees. Read before you apply.

Read Company Rants →