Home / Jobs / Inference Serving
Jobs by Role

Inference Serving
Jobs

No openings found right now · Updated daily

Active Inference Serving roles are indexed directly from company ATS systems — Greenhouse, Lever, Workday, Ashby, and 15+ others. Advertised salaries average $244k/year based on live listings. 78% of roles are remote-friendly. These listings don't come from other job boards — they're pulled from source, so many won't appear on LinkedIn, Indeed, or Glassdoor.

Open Roles

0

Avg Salary

$244k

Remote-Friendly

78%

Added This Week

1

Sectors Hiring Inference Servings
Global Elite Empire Consultants 32Technology 7Cloud Infrastructure 3Financial Services 3AI 2AI infrastructure 1Artificial Intelligence 1
Key Specialisations
distributed-systems 7llm-inference 6kubernetes 4ai-inference 4model-serving 4cloud-native-infrastructure 4performance-engineering 4machine-learning 4foundation-models 3gpu-infrastructure 3
In-Demand Skills
AI inferencemodel servingcloud-native infrastructureperformance engineeringDistributed systemsSchedulingKV cachingSpeculative decodingdistributed systemsLLM Inference
50 shown

Member of Technical Staff — Model Optimization and Inference

Nuance Labs

Seattle Onsite Direct
Apply →

AI Research Engineer, Inference

Hudson River Trading

New York, NY, United States Onsite Direct
Apply →

Software Engineer- BIS (Baseten Inference Stack)

Baseten

San Francisco Direct
Apply →

Software Engineer- BIS (Baseten Inference Stack)

Baseten

San Francisco Direct
Apply →

Staff + Sr. Software Engineer, Cloud Inference

Anthropic

San Francisco, California, United States Hybrid Senior Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Overland Park, Kansas Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Evansville, Indiana Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Lexington, Kentucky Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Rexburgh, Idaho Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Hailo, Hawaii Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

St. Petersburg, Florida Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Long Beach, California Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Belgrade, Montana Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Enterprise, Nevada Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Moore, Oklahoma Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Eugene, Oregon Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Pittsburgh, Pennsylvania Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Knoxville, Tennessee Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Milton, Vermont Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Alabaster, Alabama Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Joliet, Illinois Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Scarborough, Maine Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Glasgow, Delaware Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Baltimore, Maryland Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Grand Rapids, Michigan Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Hartford, Connecticut Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Bloomington, Minnesota Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Independence, Missouri Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Las Cruces, New Mexico Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Winston-Salem, North Carolina Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Cleveland, Ohio Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

South Kingston, Rhode Island Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Charleston, South Carolina Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

San Antonio, Texas Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

West Jordan, Utah Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Spokane, Washington Remote Direct
Apply →

Seeking Veterans to Serve Veterans

Global Elite Empire Consultants

Greenbay, Wisconsin Remote Direct
Apply →

AI Inference Performance Engineer - New College Grad 2026

AI Inference Performance Engineer

US, CA, Santa Clara Remote Entry Direct
Apply →

Product Manager - AI Inference & Model Serving

Mirantis

Austin, TX, United States Remote mid Direct
Apply →

Product Manager - AI Inference & Model Serving

Mirantis

Austin, TX, United States Remote mid Direct
Apply →

AI Inference Performance Engineer - New College Grad 2026

NVIDIA

US, CA, Santa Clara Remote Entry Direct
Apply →

Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform)

Capital One

San Jose, CA Onsite Lead Direct
Apply →

Product Manager - AI Inference & Model Serving

Mirantis

Austin, TX, United States mid Direct
Apply →

Product Manager - AI Inference & Model Serving

Mirantis

Austin, TX, United States mid Direct
Apply →

Lead AI Engineer (FM Hosting, LLM Inference)

Capital One

New York, NY Onsite Lead Direct
Apply →

Lead AI Engineer (FM Hosting, LLM Inference)

Capital One

New York, NY Onsite Lead Direct
Apply →

Engineering Manager, Inference Benchmarking

NVIDIA

US, CA, Santa Clara Lead Direct
Apply →

Lead Product Manager, Ad Serving & Ranking, Demand and Ads Team

Grab

Beijing, CN Onsite mid Direct
Apply →

Customer Support Engineer (Inference)

Together AI

San Francisco, California, United States Senior Direct
Apply →

Engineering Manager, Inference Benchmarking

NVIDIA

US, CA, Santa Clara Lead Direct
Apply →

Related Searches

Common Questions

How many Inference Serving jobs are available?
JobsGlitch lists active Inference Serving jobs sourced daily from Greenhouse, Lever, Ashby, Workday, and other top ATS platforms.
What skills are required for Inference Serving roles?
The most in-demand skills for Inference Serving roles are AI inference, model serving, cloud-native infrastructure, performance engineering, Distributed systems. Requirements vary by seniority and company.
What is the average salary for a Inference Serving?
The average salary for Inference Serving roles on JobsGlitch is approximately $244k/year. Compensation varies by location, seniority, and company.
Are there remote Inference Serving jobs?
Yes — 78% of Inference Serving jobs on JobsGlitch are remote-friendly. Browse remote Inference Serving jobs at jobsglitch.com/jobs/remote/inference-serving.