See your match scores
Inference Infrastructure Jobs in New York
No openings found
Active Inference Infrastructure roles in New York, indexed directly from company ATS systems — not reposted from LinkedIn, Indeed, or Glassdoor. Upload your resume to see your match score against open positions.
Staff + Senior Software Engineer, Inference
Anthropic
San Francisco, California, United States Hybrid Senior Direct
Distributed Training and Inference Engineer
Sciforium
San Francisco Senior Direct
Software engineer -AI/ML, AWS Neuron Inference, AWS Neuron Inference
Annapurna Labs (U. S. ) Inc.
Seattle, Washington, USA Onsite Senior Direct
Performance Engineer, On-Device Inference
Sarvam
Bengaluru Mid Direct
Research Intern, Inference (Fall 2026)
Together AI
San Francisco, California, United States Onsite Direct
Senior Machine Learning Engineer, ML Infrastructure
Unity Technologies
Shanghai, China Onsite Senior Direct
Senior Data Scientist, Causal Inference
Lyft
New York, New York, United States Hybrid Senior Direct
Senior Data Scientist, Causal Inference
Lyft
New York, New York, United States Hybrid Senior Direct
Senior Data Scientist, Causal Inference
Lyft
New York, New York, United States Hybrid Senior Direct
Software Development Manager, LLM Inference Model Enablement, Neuron SDK
Annapurna Labs
Cupertino, California, USA Onsite Manager Direct
Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference
Annapurna Labs (U. S. ) Inc.
Seattle, Washington, USA Onsite Senior Direct
Software Development Engineer, AI/ML, AWS Neuron, Model Inference
Amazon.com Services LLC
Cupertino, California, USA Onsite Direct
Senior Software Development Engineer - AI/ML, AWS Neuron, Multimodal Inference
Amazon.com Services LLC
Cupertino, California, USA Onsite Senior Direct
Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference
Annapurna Labs (U. S. ) Inc.
Cupertino, California, USA Onsite Senior Direct
Software Development Engineer - AI/ML, Amazon Neuron, Multimodal Inference
Annapurna Labs (U. S. ) Inc.
Seattle, Washington, USA Onsite Direct
Software Development Engineer - AI/ML, AWS Neuron, Multimodal Inference
Annapurna Labs (U. S. ) Inc.
Cupertino, California, USA Onsite Direct
Infrastructure Engineer
Electrosoft
Washington, DC Onsite Senior Direct
Infrastructure Architect
LTS
Herndon, VA Onsite Senior Direct
Machine Learning Engineer II - Autonomous Driving & Inference Runtime
May Mobility
Anywhere, USA Remote Mid Direct
Senior Applied Scientist - Systems for ML Inference and Training Optimization
Amazon Web Services Development Center Germany GmbH
Tübingen, Baden-Wurttemberg, DEU Onsite Senior Direct
Infrastructure Engineer
Amazon Development Center Taiwan Limited
Taipei City, TWN Onsite Direct
Principal Engineer - Systems for ML Inference and Training Optimization
Amazon Web Services Development Center Germany GmbH
Tübingen, Baden-Wurttemberg, DEU Onsite Senior Direct
Infrastructure Engineer
Nscale
US Direct
Infrastructure Lead
Whakarongorau Aotearoa
Auckland, Auckland, New Zealand Hybrid mid Direct
IT Infrastructure Manager
Saronic Technologies
Austin, TX Hybrid Manager Direct
AI Infrastructure Engineer
Swissquote
Gland, VD, CH Onsite mid Direct
Infrastructure Developer
Agoda
Bangkok, Thailand Onsite Direct
Sr. Bus Dev AI Infrastructure - Europe North, WWSO EMEA AI Infrastructure Business Development and Solutions Architecture
Amazon Web Services EMEA SARL, Dutch Branch
Amsterdam, North Holland, NLD Onsite Senior Direct
Infrastructure Manager
Strive Pharmacy
Mesa, Arizona, United States Hybrid Manager Direct
Software Engineer, Infrastructure
Sierra
San Francisco, CA Onsite Direct
Technical Infrastructure Program Manager, Infrastructure Capacity Management
Amazon Data Services, Inc.
Seattle, Washington, USA Onsite Manager Direct
Infrastructure Investments Analyst
GCM Grosvenor
New York, New York, United States Entry Direct
Infrastructure Engineer (Norway)
Nscale
Norway Flexible Direct
Infrastructure Deployment Engineer
Amazon Support Services Costa Rica SRL
San Jose, San Jose, CRI Onsite Direct
(Senior) Infrastructure Engineer
Nscale
Germany Flexible Senior Direct
Infrastructure Delivery Manager
Amazon Data Services, Inc.
Herndon, Virginia, USA Onsite Manager Direct
Data Infrastructure Engineer
Droyd
San Francisco, CA Onsite Senior Direct
Infrastructure Delivery Tech
Amazon Corporate Services Pty Ltd
Melbourne, Victoria, AUS Onsite Direct
Infrastructure Partner Manager
Amazon Connect Technology Services (Beijing) Co., Ltd.
Beijing, CHN Onsite Mid Direct
Infrastructure Engineer
Tenstreet
Tulsa, OK, United States Hybrid Direct
Infrastructure Delivery Manager
Amazon Data Services, Inc.
Herndon, Virginia, USA Onsite Manager Direct
Senior Infrastructure Engineer
Beyond ONE
Lahore, Punjab, Pakistan Hybrid Senior Direct
Water Infrastructure Manager
Amazon Data Services Spain, S. L.
Madrid, Community of Madrid, ESP Onsite Manager Direct
Infrastructure Support Engineer
Nscale
AMER Flexible Direct
Infrastructure Delivery Manager
Amazon Data Services, Inc.
Wharton, Texas, USA Onsite Manager Direct
Infrastructure & Vault Engineer
India-Karnataka-Bangalore Onsite Entry Direct
Infrastructure Delivery Manager
Amazon Data Services, Inc.
Wink, Texas, USA Onsite Manager Direct
Water Infrastructure Engineer
Amazon Data Services, Inc.
Arlington, Virginia, USA Onsite Direct
Infrastructure Delivery Manager
Amazon Data Services, Inc.
Wink, Texas, USA Onsite Manager Direct
Infrastructure Delivery Manager
Amazon Data Services, Inc.
Wharton, Texas, USA Onsite Manager Direct
See how you match these Inference Infrastructure roles
Upload your resume and get a skill match score for every job
Get match scores →Common Questions
- How many inference infrastructure jobs in new york are available?
- JobsGlitch lists active inference infrastructure jobs in new york sourced directly from company ATS platforms — not reposted from LinkedIn.
- Are these Inference Infrastructure roles actually hiring in New York?
- Yes — every listing is indexed directly from company career pages (Greenhouse, Lever, Workday, Ashby). These are not aggregated from other job boards, so they reflect live hiring intent.
- What skills do Inference Infrastructure jobs in New York require?
- Required skills vary by employer and seniority. Browse the listings above to see the specific requirements for each open role.
- How do I apply for inference infrastructure jobs in new york?
- Click any job listing to view the full description and apply directly on the company's career page. Upload your resume on JobsGlitch first to see your match score before applying.