BlueAlly

Technology

SeniorAIEngineer

$135–195k ~AI est. Atlanta, Georgia, United States FULL TIME Remote Friendly
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for mid candidates.

The Brief

“Senior AI Engineer at BlueAlly. Skills: AI systems, LLM inference, RAG applications, MLOps. Lead AI systems design. Build AI systems”

What You'll Achieve.

Raise client capability; Raise BlueAlly practice

Industry & Context.

Technology
Problems you'll solve

Troubleshooting; Root cause analysis

Eligibility Requirements

On-call rotation

What They're Looking For.

Must Have

7+ years software engineering, 3+ years AI/LLM systems, Production-quality Python, Deep production Linux, Deep Docker proficiency, Server-platform skills, Hands-on AI Factory platforms, Production vLLM experience

Nice to Have

Certified Kubernetes Administrator, Certified Kubernetes Application Developer, Cloud certifications, Linux certifications, NVIDIA certifications, HPE platform certifications, Dell Technologies certifications, Nutanix platform certifications

What You'll Do.

Lead AI systems design

Engineer LLM inference

Tune inference performance

Architect MLOps pipelines

Operate MLOps pipelines

Design RAG applications

Engineer RAG applications

Build prompt patterns

Design LLM evaluation

Maintain LLM evaluation

Operate Kubernetes clusters

Build container images

Maintain container images

Build CI/CD pipelines

Maintain CI/CD pipelines

Implement capacity planning

Engage client stakeholders

Mentor junior engineers

Author reference architectures

Lead knowledge transfer

How You'll Work.

Team & Collaboration

Client architects; Data scientists; Application teams; Executives; Junior engineers

Communication Scope

Client-facing communication; Status reporting; Root cause analysis; Options communication; Recommendations communication; Technical communication

Process & Methodology

Roadmap planning

Full Job Description

At BlueAlly, our mission is to make technology more accessible, more certain, and more impactful for every organization. From cloud to cybersecurity, infrastructure to application modernization, we thrive on cutting-edge technologies and services. Elevate the impact of technology across your enterprise with world-class expertise that produces game-changing insights. Turn complex decisions into clear opportunities with a trusted guide to technology that ensures the next digital advance will be your decisive advantage. Trade IT complexity for capability with solutions that elevate possibilities, and advance with certainty, knowing you have BlueAlly as your ally in next. BlueAlly. Conquer Complexity. We are hiring a Senior AI Engineer to design, build, and operate enterprise AI systems across our client portfolio. You will work end-to-end across the AI stack — from inference engines and platform infrastructure (vLLM, KV cache, Dynamo-style serving, GPU-accelerated AI Factory platforms) up through application-level engineering (RAG pipelines, agent workflows, prompt engineering, evaluation methodology). This role is for an engineer who can lead workstreams independently, mentor more junior engineers, and serve as the technical authority that clients trust to deliver production AI outcomes. You'll engage directly with client architects, data scientists, application teams, and executives — and you'll leave each engagement having raised both the client's capability and BlueAlly's practice. Key Responsibilities: * Lead end-to-end design, build, and operation of AI systems on AI Factory platforms (HPE PCAI, Dell AI Factory, Nutanix Enterprise AI, and adjacent ecosystem layers) across multiple client engagements. * Engineer and tune LLM inference serving stacks — primary depth in vLLM with breadth across the inference ecosystem — for client latency, throughput, and cost targets. * Tune inference performance through KV cache management, paged attention, batching strategies, an

Free ATS check

Applying for this Senior AI Engineer role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on SmartRecruiters

  • SmartRecruiters often includes a video screening step — check camera and mic permissions.
  • Link your GitHub or portfolio directly in the profile section for technical roles.
  • Applications may be reviewed by AI scoring before reaching a recruiter — use keywords from the job description.

ANONYMOUS · UNFILTERED

What do employees actually say about BlueAlly?

Real rants from real employees. Read before you apply.

Read Company Rants →