ngrok Inc.
SoftwareEngineerIII/Senior,AIGateway
“Software Engineer III/Senior, AI Gateway at ngrok Inc.. Skills: AI Gateway, Go, Kubernetes, AWS. Build AI Gateway components. Classify AI traffic”
What You'll Achieve.
prevent runaway costs; prevent misuse; prevent accidental exposure; ensure AI usage data aligns; ensure policy enforcement aligns; ensure billing signals align
Industry & Context.
resolve unexpected model behavior; resolve misconfigured policies; resolve customer questions
US-based, legally authorized to work in the United States, no visa sponsorship
What They're Looking For.
Must Have
statically typed, compiled language, Go, Rust, C++, Java, AI/LLMs, developer experience, thoughtful abstractions, defining system behavior, retries, limits, costs, systems that move complexity, US-based, legally authorized to work in the United States
Nice to Have
Go, AI platforms, inference infrastructure, API gateways, Usage limits, quotas, billing-adjacent systems, Customer-facing observability tools
What You'll Do.
Build AI Gateway components
Own AI traffic policy enforcement
Design Traffic Policy Objects
Implement Traffic Policy Objects
Make AI behavior observable
Make AI behavior explainable
Design gateway primitives
Ship customer trust systems
How You'll Work.
Team & Collaboration
collaborate with product; collaborate with design; collaborate with Gateway teams; collaborate with Customer Data teams; collaborate with Platform teams
Applying for this Software Engineer III/Senior, AI Gateway role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Greenhouse
- Create a Greenhouse profile before applying — it saves time across multiple applications.
- Upload your resume as a PDF; the parser handles it better than Word.
- Answer all knockout questions carefully — wrong answers auto-reject before a human sees you.
- Enable email notifications to track application status in real time.
ANONYMOUS · UNFILTERED
What do employees actually say about ngrok Inc.?
Real rants from real employees. Read before you apply.