Anyscale
AI
SoftwareEngineer,PlatformInfrastructure(Foundations)
Neural analysis suggests this role is
optimal for Mid candidates.
“Software Engineer, Platform Infrastructure (Foundations) at Anyscale. Skills: Kubernetes, Cloud-native, Go, Python. Design, build, and scale services. Orchestrate Ray clusters”
Industry & Context.
On-call support
What They're Looking For.
Must Have
3+ years of experience writing high-quality production code, Hands-on experience in building and maintaining highly available, scalable, and performant distributed system, Expertise in cloud-native technologies (AWS, Azure, GCP) and Kubernetes-based deployments, Deep understanding of networking, security, and authentication mechanisms in cloud environment, Proficiency in Go and Python, Knowledge of low-level operating system foundations (Linux kernel, file systems, containers)
Nice to Have
Familiarity with observability stacks (Prometheus, Grafana etc)
What You'll Do.
Orchestrate Ray clusters
Optimize control plane components
Build scheduling and resource management systems
Develop features for reliability
Support and optimize accelerator integration
Handle container image management
Participate in code reviews
Provide on-call support
Collaborate with experts
How You'll Work.
Team & Collaboration
Work closely with customer and field teams; Collaborate with leading distributed systems and machine learning experts
Full Job Description
About Anyscale: At Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date. About the role: Anyscale is looking for a Software Engineer to join the Infrastructure team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. As part of the Infra team, we build the scalable, secure, and robust backbone that enables this vision. Our team is responsible for both the control plane, which orchestrates cluster management, scheduling, and user access, and the data plane, which ensures high-performance execution of distributed workloads. We are seeking a talented Software Engineer with a strong background in control p
Applying for this Software Engineer, Platform Infrastructure (Foundations) role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Ashby
- Ashby is a fast modern ATS — most applications take under 3 minutes.
- The resume parser is strong; verify parsed experience dates and job titles.
- Custom screening questions are often scored algorithmically — answer completely.
- Location field affects geo-based screening; use your actual metro area.
ANONYMOUS · UNFILTERED
What do employees actually say about Anyscale?
Real rants from real employees. Read before you apply.