Lilly

healthcare

Sr.StaffSoftwareEngineer-AIChat

$126–224k Indianapolis, Indiana, United States FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Lead candidates.

The Brief

“Sr. Staff Software Engineer - AI Chat at Lilly. Skills: AI Chat platform, routing engine, integration layer, experience layer, conversation routing engine, agent integration layer, streaming chat interfaces, scalable services, Kubernetes, LLM capabilities, model gateway, multi-model routing, fallback, load balancing, MCP integrations, agentic coding tools. define the architecture and drive implementation of ChatNow's conversation routing engine. own the agent integration layer, designing how Cha”

What You'll Achieve.

ship code that the entire company uses every day; deliver ChatNow's core platform; make life better for people around the world

Industry & Context.

healthcare

What They're Looking For.

Must Have

10+ years of professional software engineering experience, with demonstrated technical leadership at scale, 5+ years in TypeScript/JavaScript, Python and Go (with ability to use AI coding tools proficiently), architecting and building production web applications with React or equivalent, 5+ years experience designing RESTful or GraphQL APIs at scale, Deep hands-on experience with Kubernetes — not just deploying, but operating, debugging, and tuning, CI/CD and GitOps practices, Bachelor's degree in Computer Science, Software Engineering, or a related field

Nice to Have

Experience integrating LLM APIs into production — streaming, function calling, tool use, Hands-on work with conversational AI systems: routing, intent classification, context management, or multi-agent orchestration, Experience with real-time systems: WebSockets, SSE, event-driven architectures, or workflow orchestration, Familiarity with MCP, A2A, or emerging AI interoperability protocols, Active use of agentic coding tools in your daily workflow, A track record of shipping user-facing products with high reliability and polish, Experience setting technical direction across multiple teams or workstreams

What You'll Do.

define the architecture and drive implementation of ChatNow's conversation routing engine

own the agent integration layer

designing how ChatNow connects to Lilly's expanding network of specialized AI agents on Cortex

build streaming chat interfaces in React and TypeScript

backed by scalable services that handle thousands of concurrent sessions with low latency across multiple AI providers

own features end to end: Design

operate ChatNow on Cortex and Hangar — Lilly's enterprise Kubernetes platform

instrumented with LGTM observability so you can see exactly how routing

and agent performance behave in production

integrate LLM capabilities through Cortex's model gateway

supporting multi-model routing with fallback and load balancing

implement MCP integrations that connect agents to enterprise data sources and tools

use agentic coding tools like Claude Code and GitHub Copilot as a daily force multiplier

shape how agents are registered

and invoked on Cortex — defining the framework that the rest of the organization builds on

How You'll Work.

Team & Collaboration

make technical decisions that ripple across teams

Full Job Description

At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities through philanthropy and volunteerism. We give our best effort to our work, and we put people first. We’re looking for people who are determined to make life better for people around the world. ChatNow is how Lilly talks to AI. Every day, tens of thousands of employees open ChatNow to get work done — asking questions, running analyses, invoking specialized agents. It's the front door to Cortex, Lilly's enterprise AI platform. And it needs to be fast, intuitive, and relentlessly reliable. We're looking for a Senior Staff Software Engineer to own the technical direction and delivery of ChatNow's core platform: the routing engine that matches intent to the right agent, the integration layer that connects a growing ecosystem of AI capabilities, and the experience layer that makes it all feel effortless. You'll set the technical bar for one of Lilly's most visible AI products — and ship code that the entire company uses every day. **What You 'll Do** You'll define the architecture and drive implementation of ChatNow's conversation routing engine — the system that takes a user's intent and connects it to the right AI agent, model, or workflow. You'll own the agent integration layer, designing how ChatNow connects to Lilly's expanding network of specialized AI agents on Cortex. You'll build streaming chat interfaces in React and TypeScript, backed by scalable services that handle thousands of concurrent sessions with low latency across multiple AI providers. You'll own features end to end. Design, build, test, deploy, monitor. No hand-offs. You'll operate ChatNow on Cortex and Hangar — Lilly's enterprise Kubernetes platform

Free ATS check

Applying for this Sr. Staff Software Engineer - AI Chat role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Workday

  • Workday has a multi-step form — save your progress after every section.
  • "Apply With LinkedIn" can fail or lose data; manual entry is more reliable.
  • Watch for the "Submit for Review" final step — hitting "Save" alone does not submit.
  • Job requisition numbers are useful when following up with HR by email.

ANONYMOUS · UNFILTERED

What do employees actually say about Lilly?

Real rants from real employees. Read before you apply.

Read Company Rants →