Lilly
healthcare
Sr.StaffSoftwareEngineer-AIChat
Neural analysis suggests this role is
optimal for Lead candidates.
“Sr. Staff Software Engineer - AI Chat at Lilly. Skills: AI Chat platform, routing engine, integration layer, experience layer, conversation routing engine, agent integration layer, streaming chat interfaces, scalable services, Kubernetes, LLM capabilities, model gateway, multi-model routing, fallback, load balancing, MCP integrations, agentic coding tools. define the architecture and drive implementation of ChatNow's conversation routing engine. own the agent integration layer, designing how Cha”
What You'll Achieve.
ship code that the entire company uses every day; deliver ChatNow's core platform; make life better for people around the world
Industry & Context.
What They're Looking For.
Must Have
10+ years of professional software engineering experience, with demonstrated technical leadership at scale, 5+ years in TypeScript/JavaScript, Python and Go (with ability to use AI coding tools proficiently), architecting and building production web applications with React or equivalent, 5+ years experience designing RESTful or GraphQL APIs at scale, Deep hands-on experience with Kubernetes — not just deploying, but operating, debugging, and tuning, CI/CD and GitOps practices, Bachelor's degree in Computer Science, Software Engineering, or a related field
Nice to Have
Experience integrating LLM APIs into production — streaming, function calling, tool use, Hands-on work with conversational AI systems: routing, intent classification, context management, or multi-agent orchestration, Experience with real-time systems: WebSockets, SSE, event-driven architectures, or workflow orchestration, Familiarity with MCP, A2A, or emerging AI interoperability protocols, Active use of agentic coding tools in your daily workflow, A track record of shipping user-facing products with high reliability and polish, Experience setting technical direction across multiple teams or workstreams
What You'll Do.
define the architecture and drive implementation of ChatNow's conversation routing engine
own the agent integration layer
designing how ChatNow connects to Lilly's expanding network of specialized AI agents on Cortex
build streaming chat interfaces in React and TypeScript
backed by scalable services that handle thousands of concurrent sessions with low latency across multiple AI providers
own features end to end: Design
operate ChatNow on Cortex and Hangar — Lilly's enterprise Kubernetes platform
instrumented with LGTM observability so you can see exactly how routing
and agent performance behave in production
integrate LLM capabilities through Cortex's model gateway
supporting multi-model routing with fallback and load balancing
implement MCP integrations that connect agents to enterprise data sources and tools
use agentic coding tools like Claude Code and GitHub Copilot as a daily force multiplier
shape how agents are registered
and invoked on Cortex — defining the framework that the rest of the organization builds on
How You'll Work.
Team & Collaboration
make technical decisions that ripple across teams
Full Job Description
At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities through philanthropy and volunteerism. We give our best effort to our work, and we put people first. We’re looking for people who are determined to make life better for people around the world. ChatNow is how Lilly talks to AI. Every day, tens of thousands of employees open ChatNow to get work done — asking questions, running analyses, invoking specialized agents. It's the front door to Cortex, Lilly's enterprise AI platform. And it needs to be fast, intuitive, and relentlessly reliable. We're looking for a Senior Staff Software Engineer to own the technical direction and delivery of ChatNow's core platform: the routing engine that matches intent to the right agent, the integration layer that connects a growing ecosystem of AI capabilities, and the experience layer that makes it all feel effortless. You'll set the technical bar for one of Lilly's most visible AI products — and ship code that the entire company uses every day. **What You 'll Do** You'll define the architecture and drive implementation of ChatNow's conversation routing engine — the system that takes a user's intent and connects it to the right AI agent, model, or workflow. You'll own the agent integration layer, designing how ChatNow connects to Lilly's expanding network of specialized AI agents on Cortex. You'll build streaming chat interfaces in React and TypeScript, backed by scalable services that handle thousands of concurrent sessions with low latency across multiple AI providers. You'll own features end to end. Design, build, test, deploy, monitor. No hand-offs. You'll operate ChatNow on Cortex and Hangar — Lilly's enterprise Kubernetes platform
Applying for this Sr. Staff Software Engineer - AI Chat role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Workday
- Workday has a multi-step form — save your progress after every section.
- "Apply With LinkedIn" can fail or lose data; manual entry is more reliable.
- Watch for the "Submit for Review" final step — hitting "Save" alone does not submit.
- Job requisition numbers are useful when following up with HR by email.
ANONYMOUS · UNFILTERED
What do employees actually say about Lilly?
Real rants from real employees. Read before you apply.