Julius

applied AI lab

SoftwareEngineer-Infrastructure(Mid-Senior)

$150–200k San Francisco, California, United States; New York, New York, United States FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Mid candidates.

The Brief

“Software Engineer - Infrastructure (Mid - Senior) at Julius. Skills: container infrastructure, cloud deployments, observability, optimization. Build and scale the code‑execution sandboxes. Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling”

Industry & Context.

applied AI lab

What They're Looking For.

Must Have

Production Kubernetes, container internals (Docker/containerd), networking fundamentals, Cloud (AWS/GCP/Azure), IaC (Terraform/Helm), Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector), Security best practices for containerized, multi-tenant systems

Nice to Have

gVisor/Kata/Firecracker, Cilium/eBPF, GPU serverless autoscaling (KEDA/Knative/Karpenter), You’ve built an AI side project, enjoy tinkering with LLMs

What You'll Do.

Build and scale the code‑execution sandboxes

Design and operate secure

multi‑tenant container infrastructure with fast startup and smart autoscaling

Ship cloud deployments (Helm/Terraform) with SSO

Drive observability (metrics

build fair‑use and rate‑limiting controls

Full Job Description

Compensation: Competitive base salary and meaningful equity Benefits: Health & dental insurance, gym reimbursement, daily team meals, commuter benefits We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes (isolated remote containers) that we manage. We’re revenue‑generating and backed by AI Grant, YCombinator, Bessemer Venture Partners and the founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox. The Role Build and scale the code‑execution sandboxes that power Julius across cloud environments (AWS and GCP). We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute. What You’ll Do - Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling. - Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging. - Drive observability (metrics, traces, logs) with clear SLOs; lead incident response. - Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls. What You Bring - Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals. - Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm). - Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector). - Security best practices for containerized, multi‑tenant systems. Nice to Have - gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter). - You’ve built an AI side project and enjoy tinkering with LLMs. Why Julius Small, senior team; massive impact surface; hard infra problems at meaningful scale.

Free ATS check

Applying for this Software Engineer - Infrastructure (Mid - Senior) role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Ashby

  • Ashby is a fast modern ATS — most applications take under 3 minutes.
  • The resume parser is strong; verify parsed experience dates and job titles.
  • Custom screening questions are often scored algorithmically — answer completely.
  • Location field affects geo-based screening; use your actual metro area.

ANONYMOUS · UNFILTERED

What do employees actually say about Julius?

Real rants from real employees. Read before you apply.

Read Company Rants →