NVIDIA
AI
SoftwareEngineer,AIandDLKernelLibrariesNewCollegeGrad2026
“Software Engineer, AI and DL Kernel Libraries - New College Grad 2026 at NVIDIA. Skills: AI systems, inference systems, GPU kernel technologies, LLM inference runtimes, Python, C/C++, GPU kernel development, performance optimizations. Innovating and developing new AI systems technologies for efficient inference. Designing, implementing, and optimizing kernels for high impact AI workloads”
What You'll Achieve.
accelerate for AI inference; accelerate large language models, agents, and other high-impact AI workloads
Industry & Context.
What They're Looking For.
Must Have
Masters degree in Computer Science, Electrical Engineering, or related field (or equivalent experience), 2 + years (academic/ industry) experience with ML/DL systems development preferable, experience in developing or using deep learning frameworks (e. g. PyTorch, JAX, TensorFlow, ONNX, etc), experience with inference engines and runtimes such as vLLM, SGLang, and MLC, Python and C/C++ programming skills, experience in GPU kernel development and performance optimizations (especially using CUDA C/C++, cuTile, Triton, or similar)
Nice to Have
PhD are preferred, Background in domain specific compiler and library solutions for LLM inference and training (e. g. FlashInfer, Flash Attention), Expertise in inference engines like vLLM and SGLang, Expertise in machine learning compilers (e. g. Apache TVM, MLIR), Open source project ownership or contributions
What You'll Do.
Innovating and developing new AI systems technologies for efficient inference
and optimizing kernels for high impact AI workloads
Designing and implementing extensible abstractions for LLM serving engines
Building efficient just-in-time domain specific compilers and runtimes
Contributing to open source communities like FlashInfer
How You'll Work.
Team & Collaboration
Collaborating closely with other engineers at NVIDIA across deep learning frameworks, libraries, kernels, and GPU arch teams
Applying for this Software Engineer, AI and DL Kernel Libraries - New College Grad 2026 role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Workday
- Workday has a multi-step form — save your progress after every section.
- "Apply With LinkedIn" can fail or lose data; manual entry is more reliable.
- Watch for the "Submit for Review" final step — hitting "Save" alone does not submit.
- Job requisition numbers are useful when following up with HR by email.
ANONYMOUS · UNFILTERED
What do employees actually say about NVIDIA?
Real rants from real employees. Read before you apply.