Software Engineer, Infrastructure Data Plane

About Anyscale:

At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

Anyscale is based in San Francisco, CA. Employees are required to come in office 3x a week.

About the role

Anyscale is looking for a Software Engineer to join the Infrastructure Data Plane team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. At the Cloud Platform Data Plane team, we build the scalable, secure, and robust backbone to realize this vision.

We are seeking a talented Software Engineer with a strong background in data plane development and expertise in container technologies. As part of our engineering team, you will play a crucial role in designing, implementing, and optimizing data plane solutions that power our cutting-edge products.

You will be able to work on the open-source Ray, our major infinite laptop proprietary product, and the integration and interaction between the two as well as critical customer features.

As part of your role, you will

Design and develop components to manage Ray applications and auxiliary containers running on the data plane

Create cutting-edge features to enhance reliability, performance, scalability, and observability of Anyscale-managed Ray workloads

Implement and maintain accelerator support

Manage and optimize storage, networking, and security aspects of the data plane

Handle dependencies and container image management

Participate in code reviews, design discussions, and architecture planning sessions

Provide on-call support and collaborate with customer and field teams to troubleshoot data plane issues

Work with a team of leading distributed systems and machine learning experts

We'd love to hear from you if you have

Bachelor's degree in Computer Science, Engineering, or equivalent practical experience

3+ years of experience writing high-quality production code

Hands-on experience building high-performance distributed systems at scale

Proficiency in Go and Python

In-depth knowledge of low-level operating system foundations (Linux kernel, file systems, containers)

Comprehensive understanding of network protocols and associated tools

Ability to work independently and collaboratively in a fast-paced environment

Customer-focused mindset with excellent communication skills

Bonus

Master's degree in Computer Science or related technical field

Contributions to open-source projects in dataplane or container technologies

Familiarity with cloud platforms (AWS, Google Cloud, Azure) and Kubernetes

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish

Apply for this job

Software Engineer, Infrastructure Data Plane

Other AI Jobs like this

Senior Software Engineer, Infrastructure

Software Engineer, Core Infrastructure

Software Engineer — Infrastructure

Engineering

Data

Other Roles

Locations