- Raydar
- New York, NY
- Full-Time
- 23 days ago
- $200,000–$280,000 / year
Senior Software Engineer, Infrastructure.
Before you go
Before you leave us, sign up for our email alerts
We don't do job spam, just the best digital jobs delivered straight to your inbox.
Senior Software Engineer, Infrastructure: our view in 3 lines...
- The Role:This is a senior infrastructure software engineering role focused on a platform for running stateful workloads for AI systems.
- The Person:The person will scale workload dispatch, design system-limit tests and evaluation approaches, add environment types and orchestration integrations, and extend the platform as the field evolves.
- Requirements:The ideal candidate has built production backend systems handling heavy traffic and large data volumes, and has experience with cluster management tooling, event-driven system design, distributed services, LLM workloads, and Kubernetes.
About the role
About the company
Our client is a data infrastructure company.
The role
Raydar is recruiting for this role on behalf of our client. Own the platform that runs many concurrent, stateful workloads for AI systems. The work covers job dispatch and reliability, designing realistic test scenarios, and extending the platform with new integrations as the field evolves.
What you'll do
- Run and scale the dispatch layer for many parallel, stateful workloads, including queueing, concurrency control and failure handling.
- Design realistic environments and test scenarios that probe system limits and measure what matters, not only what is easy to measure.
- Build new evaluation approaches and extend the platform to support additional environment types.
- Ship integrations with external orchestration frameworks.
- Keep pace with a fast-moving area and bring new ideas into the platform.
Requirements
What we're looking for
- A track record of designing, launching and growing production backend systems that handle heavy traffic and large volumes of data.
- Background at a startup that grew quickly or at a fast-paced large technology company.
- Comfort with cluster management tooling and event-driven system design.
- Experience maintaining distributed services and infrastructure for large language model workloads.
Bonus points
- Experience running AI or machine learning workloads at scale.
- Experience at both an early-stage startup and a large technology company.
- Extensive hands-on experience with Kubernetes.
Benefits
Compensation and benefits
- Base salary: USD 200,000 to 280,000 per year
- Equity
Location and work model
- New York, NY, United States
- Hybrid, 2-3 days per week in the office
- Remote option may be available for strong candidates
- Full-time