ngrok Inc.
cloud networking
SoftwareEngineerIII/Senior,AIGateway
“Software Engineer III/Senior, AI Gateway at ngrok Inc.. Skills: AI Gateway, AI traffic classification, AI traffic handling, AI traffic policy enforcement, AI usage tracking, AI token consumption measurement, AI behavior observability, AI behavior explainability. Build and evolve the AI Gateway. Own AI traffic policy enforcement”
What You'll Achieve.
prevent runaway costs; prevent misuse; prevent accidental exposure without breaking legitimate traffic; customers can understand how their AI systems behave and what they’re consuming; customers can turn these features on with confidence
Industry & Context.
US-based, legally authorized to work in the United States, authorized to work in the United States on a permanent, ongoing basis without the need for current or future sponsorship
What They're Looking For.
Must Have
US-based, legally authorized to work in the United States, authorized to work in the United States on a permanent, ongoing basis without the need for current or future sponsorship
Nice to Have
Go, worked with AI/LLMs, care about developer experience and thoughtful abstractions, enjoy defining system behavior, not just plumbing, thought about retries, limits, and costs before being asked, like systems that move complexity from the user to the system, worked on AI platforms or inference infrastructure, worked on API gateways with product-level opinions, worked on usage limits, quotas, or billing-adjacent systems, worked on customer-facing observability tools
What You'll Do.
Build and evolve the AI Gateway
Own AI traffic policy enforcement
Track AI usage and token consumption
Make AI behavior observable and explainable
Design abstractions that hide complexity
Ship systems customers trust in production
How You'll Work.
Team & Collaboration
collaborate with product and design; collaborate closely with Gateway, Customer Data, and Platform teams
Applying for this Software Engineer III/Senior, AI Gateway role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Greenhouse
- Create a Greenhouse profile before applying — it saves time across multiple applications.
- Upload your resume as a PDF; the parser handles it better than Word.
- Answer all knockout questions carefully — wrong answers auto-reject before a human sees you.
- Enable email notifications to track application status in real time.
ANONYMOUS · UNFILTERED
What do employees actually say about ngrok Inc.?
Real rants from real employees. Read before you apply.