ServiceNow
Tech / AI / Software
StaffSoftwareEngineer-Microservices
Neural analysis suggests this role is
optimal for not-applicable candidates.
“Staff Software Engineer - Microservices at ServiceNow. Skills: Microservices, AI Agents framework, agent reasoning, memory, orchestration, evaluation, LLMs, Agentic AI, LangChain, LangGraph, OpenAI, Anthropic. Lead the design and architecture of AI solutions, shaping how reasoning, memory, and orchestration come together in production systems.. Own end-to-end delivery —from design through deployment—ensuring solutions are scalable, reliable, and performant.”
What You'll Achieve.
measurable impact
Industry & Context.
problem-solving abilities with a bias for action; Demonstrated analytical skills in evaluating model performance, optimizing inference latency and cost, and improving system efficiency end-to-end.
What They're Looking For.
Must Have
Experience in leveraging and critically evaluating AI integration into work processes, decision-making, and problem-solving., 9+ years of experience designing and implementing complex enterprise applications, with proven success in conversational AI and NLP platforms., development skills in Java and Python, including building production-grade AI/ML systems., Hands-on expertise in LLM-powered applications and tooling, including frameworks such as LangChain and LangGraph, and vendor APIs such as OpenAI and Anthropic., Deep understanding of agentic reasoning pipelines, evaluation frameworks, and advanced NLP techniques., problem-solving abilities with a bias for action, a customer-first mindset, and the ability to operate effectively in fast-paced environments., Demonstrated analytical skills in evaluating model performance, optimizing inference latency and cost, and improving system efficiency end-to-end., Proven ability to translate complex AI concepts into clear business value and communicate effectively with both technical and non-technical stakeholders., Experience providing technical leadership and guiding successful AI/ML engineering projects across teams or domains.
Nice to Have
Publications, technical blogs, conference talks, or open-source contributions in LLMs, GenAI, or AI systems engineering.
What You'll Do.
Lead the design and architecture of AI solutions
shaping how reasoning
and orchestration come together in production systems.
Own end-to-end delivery —from design through deployment—ensuring solutions are scalable
Work hands-on with modern AI frameworks and open-source SDKs
with a emphasis on prompt engineering and pipeline optimization.
Stay current with emerging advancements in LLMs and Agentic AI
integrating relevant techniques into our platform roadmap.
Champion observability and evaluation for AI systems
and automated evaluation frameworks for production workloads.
How You'll Work.
Team & Collaboration
Partner with product managers, architects, and leadership to translate business requirements into robust technical solutions with measurable impact.
Communication Scope
communicate effectively with both technical and non-technical stakeholders
Process & Methodology
Own end-to-end delivery —from design through deployment—ensuring solutions are scalable, reliable, and performant.
Full Job Description
It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500®. Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work. But this is just the beginning of our journey. Join us as we pursue our purpose to make the world work better for everyone. About the team: The Agentic AI team is a platform engineering group responsible for building ServiceNow's AI Agents framework —the foundational infrastructure that enables product teams and customers to create intelligent, autonomous agents. We design and develop agentic pipelines using Python and Java , delivering capabilities such as agent reasoning, memory, orchestration, and evaluation at enterprise scale. Beyond core platform development, engineers on this team have the opportunity to contribute to research initiatives in agent learning, agentic evaluation methodologies, and analytics. We embrace the rapidly evolving landscape of LLMs and Agentic AI while maintaining the reliability and performance standards required to operate at ServiceNow's scale. What you get to do in this role: * Lead the design and architecture of AI solutions , shaping how reasoning, memory, and orchestration come together in production systems. * Own end-to-end delivery —from design through deployment—ensuring solutions are scalable, reliable, and performant. * Work hands-on with modern AI frameworks and open-source SDKs , with a strong emphasis on prompt engineering and pipeline optimization. * Stay current with emerging advancements in LLMs and Agentic AI , integrating relevant techniques into our platform roadmap. * Provide technical leadership by mentoring engineers, conducting code reviews, and de
Applying for this Staff Software Engineer - Microservices role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on SmartRecruiters
- SmartRecruiters often includes a video screening step — check camera and mic permissions.
- Link your GitHub or portfolio directly in the profile section for technical roles.
- Applications may be reviewed by AI scoring before reaching a recruiter — use keywords from the job description.
ANONYMOUS · UNFILTERED
What do employees actually say about ServiceNow?
Real rants from real employees. Read before you apply.