Software Engineer (ML Platform)

Job Description

• Develop a highly available service for ML model serving. • Enhance Ray Serve and our other libraries to simplify the development of next-generation ML applications in production. • Improve our autoscaling capabilities to drive performance enhancements and cost savings. • Optimize latency and throughput for both single- and multi-model serving scenarios.

Qualifications

• A solid background in algorithms, data structures, and system design. • Experience working with modern machine learning tooling, including PyTorch, TensorFlow, and JAX. • At least 2+ year of relevant work experience.

Benefits

• Stock Options • Healthcare plans, with premiums covered by Anyscale at 99% • 401k Retirement Plan • Wellness stipend • Education stipend • Paid Parental Leave • Flexible Time Off • Commute reimbursement • 100% of in office meals covered