Anyscale

Software Engineer (Ray Data)

Job Description

Posted on: 
April 5, 2023

Ray aims to provide a universal API for building distributed applications (e.g. a machine learning pipeline of feature engineering, model training, and evaluation). Data is usually a core element connecting these different stages, and therefore plays a critical role in Ray’s usability, performance, and stability. We are looking for strong engineers to build, optimize, and scale Ray’s Datasets library and data processing capabilities in general.

Responsibilities

  • Develop high quality open source software to simplify distributed programming (Ray)
  • Identify, implement, and evaluate architectural improvements to Ray core and Datasets
  • Improve the testing process for Ray to make releases as smooth as possible
  • Communicate your work to a broader audience through talks, tutorials, and blog posts

Job Requirements

  • At least 2 year of relevant work experience
  • Solid background in algorithms, data structures, system design
  • Experience in building scalable and fault-tolerant distributed systems
  • Experience with data processing, database internals including Spark or Dask (streaming is a plus)
Apply now

More job openings