Vercel

Tech / AI / Software

SoftwareEngineer,AIGateway

$196–294k san francisco, california, united states Remote Friendly
The Brief

“Software Engineer, AI Gateway at Vercel. Skills: AI Gateway platform development, unified API endpoints, rate limit management, intelligent failover mechanisms, low-latency responses, stability for high-volume AI inference requests, integrating new AI providers and models. developing and enhancing our AI Gateway platform. provides a unified API for accessing hundreds of AI models from multiple providers”

What You'll Achieve.

enable the world to ship the best products; create a place where everyone can do their best work; ship things; boost uptime and reliability; enable developers to ship AI-powered applications without managing provider-specific complexities

Industry & Context.

Tech / AI / Software

What They're Looking For.

Must Have

5+ years of relevant experience, proficiency in JavaScript/TypeScript, experience with backend development, experience with APIs, experience with cloud infrastructure, Experience with AI/ML integrations, Experience with API gateways, Experience with distributed systems, Experience handling high-throughput services (e.g., rate limiting, caching, failovers)

Nice to Have

Experience contributing to or participating in open source projects

What You'll Do.

developing and enhancing our AI Gateway platform

provides a unified API for accessing hundreds of AI models from multiple providers

low-latency systems that handle rate limiting

intelligent failovers

and seamless integrations

ensuring production-ready reliability for AI workloads

automatic fallbacks during outages

consistent performance across providers

Contribute to the design

and maintenance of the AI Gateway platform

emphasizing features like unified API endpoints

rate limit management

and intelligent failover mechanisms to boost uptime and reliability

and well-documented code

conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests

integrate new AI providers and models

addressing scalability and performance challenges

Engage with the open-source community

contribute to AI SDK and related projects

Gather user feedback and analytics to drive innovations in AI Gateway

enhanced billing unification

provider-agnostic authentication

analytics for usage insights

How You'll Work.

Team & Collaboration

Collaborate with a remote and distributed team of engineers; Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers; work effectively in a collaborative team environment

Communication Scope

Excellent communication skills

Free ATS check

Applying for this Software Engineer, AI Gateway role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Greenhouse

  • Create a Greenhouse profile before applying — it saves time across multiple applications.
  • Upload your resume as a PDF; the parser handles it better than Word.
  • Answer all knockout questions carefully — wrong answers auto-reject before a human sees you.
  • Enable email notifications to track application status in real time.

ANONYMOUS · UNFILTERED

What do employees actually say about Vercel?

Real rants from real employees. Read before you apply.

Read Company Rants →