Software Engineer, Platform Infrastructure (Foundations)

Ovii's Interpretation of the Role

Software Engineer on Anyscale's Infrastructure team building the control‑plane and data‑plane backbone for Ray. You’ll design, implement, and scale cloud‑native services that run distributed AI/ML workloads.

Role Snapshot

• Build and scale Ray cluster orchestration services
• Optimize control‑plane components for large AI workloads
• Develop scheduling and resource management for heterogeneous clusters
• Enhance reliability, performance, and observability of the platform
• Provide on‑call support for customers and field teams

Must-Have Requirements

• Go
• Python
• Kubernetes
• AWS
• Azure
• GCP
• Distributed systems
• Networking/security/authentication in cloud
• Observability (Prometheus, Grafana)
• Linux fundamentals
• production‑grade code
• highly available, scalable distributed systems
• Bachelor's degree in Computer Science, Engineering, or equivalent
• Location: Bengaluru, Karnataka

Work Setup

• Location: Bengaluru, India
• Work mode: ONSITE
• Employment type: Full-Time

Eligibility Gates

• Visa sponsorship: unknown

Not Specified in JD

• Salary range
• Visa sponsorship
• Remote eligibility
• Equity
• Bonus
• Travel
• Security clearance
• Coding test

What You'll Likely Work On

• Design services that orchestrate Ray clusters across cloud and on‑prem environments
• Scale control‑plane components to handle large AI/ML workloads
• Build intelligent scheduling and resource management for heterogeneous compute clusters
• Improve reliability, performance, scalability, and observability of Ray workloads
• Integrate accelerator support (GPUs, TPUs) and manage container images
• Participate in code reviews, architecture discussions, and on‑call incident response

Good Fit If You Have

• Enjoys collaborating with distributed‑systems and ML experts
• Comfortable troubleshooting infrastructure issues with customers
• Passionate about open‑source contributions and cloud‑native platforms