Otter. ai
Tech / AI / Software
SeniorSoftwareEngineer,Backend(Product)
Neural analysis suggests this role is
optimal for Senior candidates.
“Senior Software Engineer, Backend (Product) at Otter. ai. Skills: AI-native product experiences, AI capabilities translate into real user value, full lifecycle of AI-driven features, design the systems that power them, AI outputs are reliable, performant, and aligned with real user needs, complex, ambiguous problems, concept to production, thoughtful tradeoffs across latency, cost, and quality, how LLMs, retrieval systems, and structured data come together, cohesive product experiences, summarie”
Industry & Context.
take on complex, ambiguous problems; drive them from concept to production; making thoughtful tradeoffs across latency, cost, and quality; Break down ambiguous problems, define approaches, and guide execution
What They're Looking For.
Must Have
5+ years of experience building and scaling product-facing systems, track record of owning complex features or product areas end-to-end, Writes clean, maintainable code, makes architecture and design decisions across a modern web stack, high bar for product quality, not just system correctness, experience working with AI/LLM-powered systems, or can ramp quickly and contribute meaningfully to shaping their behavior in production, Drives projects from idea → production with ownership, Thrives in ambiguous, fast-moving environments, can set technical direction, not just execute within it
Nice to Have
Experience building or experimenting with LLM-powered features (prompting, evaluation, RAG, etc.), Experience designing systems that balance latency, cost, and quality, Exposure to user feedback loops, experimentation, or evaluation frameworks
What You'll Do.
Own end-to-end delivery of AI product features
Lead the design and implementation of complex features—from initial concept through production—ensuring high quality and user impact
Drive system design for AI-backed experiences
Architect systems that orchestrate LLMs
making thoughtful tradeoffs between flexibility
Establish and improve feedback loops (evaluation frameworks
experimentation) to systematically improve AI output quality
Lead technical direction within a product area
Break down ambiguous problems
and guide execution across multiple engineers
Provide guidance on code quality
and product help less experienced engineers operate more effectively in an AI-driven environment
Model effective use of modern AI tools to improve iteration speed
and overall team productivity
How You'll Work.
Team & Collaboration
Working closely with product, design, and AI teams; help less experienced engineers operate more effectively; mentorship; technical leadership
Process & Methodology
Drive projects from idea → production with ownership, Break down ambiguous problems, define approaches, and guide execution across multiple engineers
Full Job Description
The Opportunity We’re building the next generation of AI-native product experiences, where conversations turn directly into outcomes. As a Senior Software Engineer on our Product teams, you’ll own significant areas of the product and play a key role in shaping how AI capabilities translate into real user value. You’ll work across the full lifecycle of AI-driven features—from data ingestion and model orchestration to output structuring and delivery into user-facing product surfaces. In this role, you’ll not only build features, but also design the systems that power them—ensuring that AI outputs are reliable, performant, and aligned with real user needs. You’ll take on complex, ambiguous problems and drive them from concept to production, making thoughtful tradeoffs across latency, cost, and quality. This includes defining how LLMs, retrieval systems, and structured data come together to create cohesive product experiences. Working closely with product, design, and AI teams, you’ll rapidly prototype and iterate on features like summaries, action items, and intelligent workflows—while helping establish patterns and best practices that other engineers can build on. You’ll also play a key role in elevating the team: guiding technical decisions, mentoring engineers, and raising the bar for both product thinking and engineering quality. Your Impact Own end-to-end delivery of AI product features Lead the design and implementation of complex features—from initial concept through production—ensuring high quality and strong user impact. Drive system design for AI-backed experiences Architect systems that orchestrate LLMs, retrieval, and structured data, making thoughtful tradeoffs between flexibility, reliability, and performance. Elevate product quality through iteration and evaluation Establish and improve feedback loops (evaluation frameworks, user signals, experimentation) to systematically improve AI output quality. Lead technical direction within a product area Break do
Applying for this Senior Software Engineer, Backend (Product) role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about Otter. ai?
Real rants from real employees. Read before you apply.