BlueAlly

Technology

SeniorAIEngineer

$145–210k ~AI est. Atlanta, Georgia, United States FULL TIME Remote Friendly
The Brief

“Senior AI Engineer at BlueAlly. Skills: AI systems, LLM inference, MLOps, RAG applications. Lead AI systems design. Build AI systems”

What You'll Achieve.

Deliver production AI outcomes; Raise client capability; Raise BlueAlly practice

Industry & Context.

Technology
Problems you'll solve

Troubleshooting; Root cause analysis

Eligibility Requirements

On-call rotation

What They're Looking For.

Must Have

7+ years software, data, or infrastructure engineering, 3+ years AI / LLM systems, Production-quality Python, Deep production Linux experience, Deep proficiency with Docker, Server-platform skills, Hands-on AI Factory platforms experience, Production vLLM experience, High-throughput, low-latency storage and network fabrics experience, Practical MLOps tooling and patterns experience, Hands-on vector databases and RAG pipelines experience, Production prompt engineering experience, Demonstrated LLM evaluation harnesses experience, Demonstrated client stakeholder engagement ability

Nice to Have

Certified Kubernetes Administrator (CKA) or Certified Kubernetes Application Developer (CKAD), Cloud certifications, Linux certifications, NVIDIA certifications, HPE, Dell Technologies, or Nutanix platform certifications

What You'll Do.

Lead AI systems design

Engineer LLM inference serving stacks

Tune inference performance

Architect MLOps pipelines

Operate MLOps pipelines

Design RAG applications

Engineer RAG applications

Build prompt-engineering patterns

Tune prompt-engineering patterns

Design LLM evaluation harnesses

Maintain LLM evaluation harnesses

Engineer high-performance storage

Engineer high-performance networking

Operate Kubernetes clusters

Build container images

Maintain container images

Build CI/CD pipelines

Maintain CI/CD pipelines

Implement capacity planning

Engage client stakeholders

Communicate root cause

Communicate recommendations

Mentor junior engineers

Code-review junior engineers

Author reference architectures

Author knowledge base

Lead knowledge transfer

Lead enablement sessions

Participate in on-call rotation

Participate in incident response

Contribute reusable patterns

Contribute reusable tooling

Contribute reusable reference designs

How You'll Work.

Team & Collaboration

Client architects; Data scientists; Application teams; Client executives; Junior engineers

Communication Scope

Client-facing communication; Technical communication; Executive communication

Process & Methodology

Workstreams

Free ATS check

Applying for this Senior AI Engineer role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on SmartRecruiters

  • SmartRecruiters often includes a video screening step — check camera and mic permissions.
  • Link your GitHub or portfolio directly in the profile section for technical roles.
  • Applications may be reviewed by AI scoring before reaching a recruiter — use keywords from the job description.

ANONYMOUS · UNFILTERED

What do employees actually say about BlueAlly?

Real rants from real employees. Read before you apply.

Read Company Rants →