ngrok Inc.
SoftwareEngineerIII/Senior,AIGateway
Neural analysis suggests this role is
optimal for Senior candidates.
“Software Engineer III/Senior, AI Gateway at ngrok Inc.. Skills: AI Gateway, Go, Kubernetes, AWS. Build AI Gateway components. Classify AI traffic”
What You'll Achieve.
prevent runaway costs; prevent misuse; prevent accidental exposure; ensure AI usage data aligns; ensure policy enforcement aligns; ensure billing signals align
Industry & Context.
resolve unexpected model behavior; resolve misconfigured policies; resolve customer questions
US-based, legally authorized to work in the United States, no visa sponsorship
What They're Looking For.
Must Have
statically typed, compiled language, Go, Rust, C++, Java, AI/LLMs, developer experience, thoughtful abstractions, defining system behavior, retries, limits, costs, systems that move complexity, US-based, legally authorized to work in the United States
Nice to Have
Go, AI platforms, inference infrastructure, API gateways, Usage limits, quotas, billing-adjacent systems, Customer-facing observability tools
What You'll Do.
Build AI Gateway components
Own AI traffic policy enforcement
Design Traffic Policy Objects
Implement Traffic Policy Objects
Make AI behavior observable
Make AI behavior explainable
Design gateway primitives
Ship customer trust systems
How You'll Work.
Team & Collaboration
collaborate with product; collaborate with design; collaborate with Gateway teams; collaborate with Customer Data teams; collaborate with Platform teams
Full Job Description
About ngrok Inc. ngrok is an all-in-one cloud networking platform that secures, transforms, and routes traffic to services running anywhere. Instead of cobbling together nginx, NLBs, VPNs, model routers, and oodles of other tools, developers solve every networking problem with one gateway. Doesn’t matter if they’re sharing localhost or running AI workloads in production. We're trusted by more than 9 million developers at companies like GitHub, Okta, HashiCorp, and Twilio. What started as a way to put your local app on a public URL has grown into a universal gateway for API delivery, AI inference, device fleets, and site-to-site connectivity. It’s the same ngrok that millions of developers have loved and leaned on every day for years, now with the power to run production traffic at scale. A few things you should know: We are obsessed with our pets, Viper sunglasses and Bufo (yes, the toad) We have a designated Chief Emoji Officer - they are vital to our success! We like software that’s serious and culture that’s not Still reading? Good. There's more below worth your time. About the AI Gateway Team Our AI Gateway team builds the systems that define how AI traffic is identified, controlled, and understood as it passes through ngrok. We own the AI-specific control plane at the gateway layer: policies, usage tracking, and enforcement that sit directly on live customer traffic. Our systems must behave correctly under real-world conditions—traffic spikes, unexpected model behavior, misconfigured policies, and customers asking, “Why was this blocked?” or “Where did my tokens go?” What You’ll Actually Do Build and evolve the AI Gateway: You’ll work on the AI-aware gateway components that classify and handle AI traffic in real time. This code runs directly in the request path and must be fast, safe, and predictable. Own AI traffic policy enforcement: You’ll design and implement AI Gateway Traffic Policy Objects—rate limits, usage caps, and access rules specific to AI workload
Applying for this Software Engineer III/Senior, AI Gateway role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Greenhouse
- Create a Greenhouse profile before applying — it saves time across multiple applications.
- Upload your resume as a PDF; the parser handles it better than Word.
- Answer all knockout questions carefully — wrong answers auto-reject before a human sees you.
- Enable email notifications to track application status in real time.
ANONYMOUS · UNFILTERED
What do employees actually say about ngrok Inc.?
Real rants from real employees. Read before you apply.