Company

Engineering

SystemsEngineer(C++)

$175–275k Atlanta, Georgia, United States; New York City, New York, United States FULL TIME
Market Sentiment
HIGH DEMAND

Neural analysis suggests this role is
optimal for Mid candidates.

The Brief

“Systems Engineer (C++). Skills: C++, Systems Software, Performance Optimization. Design, build, and optimize core native runtime. Work across runtime, LLM engines, integrations”

What You'll Achieve.

Make local AI fast and dependable; Ensure software is well architected and maintainable; Deliver cohesive and recognizable user experiences

Industry & Context.

Engineering
Problems you'll solve

Reason about performance; Reason about reliability; Reason about user experience

Eligibility Requirements

Onsite interview in New York office

What They're Looking For.

Must Have

4+ years building production C++ systems software across macOS or Linux, C++11 (or newer) expertise with RAII as a default mindset and modern language/library proficiency, Deep knowledge of concurrency, memory management, file systems, and network protocols, Experience optimizing performance with profilers, tracing, and hardware counters

Nice to Have

Thinks in systems and knows how to reason about performance, reliability, and user experience end-to-end, Proven maturity designing internal and external APIs that are ergonomic, maintainable, and stable over time

What You'll Do.

and optimize core native runtime

Wire C++ runtime to GPU backends

Integrate vendor SDKs

Integrate operating-system services

Implement system-level code

Integrate platform acceleration paths

Profile execution paths

Debug execution paths

Contribute to C++ runtime

Extend LLM engine integrations

Build platform-aware performance features

Implement resilient IPC

Implement resource management

Implement scheduling logic

Improve build infrastructure

Improve packaging infrastructure

Improve release infrastructure

How You'll Work.

Team & Collaboration

Collaborate with the rest of the team to deliver cohesive and recognizable user experiences

Full Job Description

THE ROLE We are hiring a C++ Systems Software Engineer in New York City. You design, build, and optimize the core native runtime that powers LM Studio and the C++ libraries powering the app and our APIs. You will work across our runtime, LLM engines, llama.cpp/MLX integrations, build infrastructure, and the future of our on-device AI software. Your work centers on system and library integration: wiring our C++ runtime to GPU backends, vendor SDKs, and operating-system services to support user-facing applications. You will implement and harden system-level code (threading, memory, files, IPC, scheduling) and integrate platform acceleration paths (Metal, CUDA, Vulkan) across macOS, Windows, and Linux. You will profile, debug, and tune the execution paths that make local AI fast and dependable, and our software well architected and maintainable.   RESPONSIBILITIES - Contribute to the C++ runtime that powers LM Studio - Extend our LLM engine integrations and build platform-aware performance features for desktop operating systems. - Implement resilient IPC, resource management, and scheduling logic to support concurrent model execution. - Improve our build, packaging, and release infrastructure for native components. - Collaborate with the rest of the team to deliver cohesive and recognizable user experiences. QUALIFICATIONS - 4+ years building production C++ systems software across macOS or Linux. - Thinks in systems and knows how to reason about performance, reliability, and user experience end-to-end. - Proven maturity designing internal and external APIs that are ergonomic, maintainable, and stable over time. - C++11 (or newer) expertise with RAII as a default mindset and modern language/library proficiency. - Deep knowledge of concurrency, memory management, file systems, and network protocols. - Experience optimizing performance with profilers, tracing, and hardware counters.   BENEFITS - Competitive salary and generous equity grants - Great medical, vision, dental

Free ATS check

Applying for this Systems Engineer (C++) role?

Most applicants get filtered before a human reads their resume. See if yours makes the cut.

How to Apply on Ashby

  • Ashby is a fast modern ATS — most applications take under 3 minutes.
  • The resume parser is strong; verify parsed experience dates and job titles.
  • Custom screening questions are often scored algorithmically — answer completely.
  • Location field affects geo-based screening; use your actual metro area.

ANONYMOUS · UNFILTERED

What do employees actually say about this company?

Real rants from real employees. Read before you apply.

Read Company Rants →