- Mayo Clinic
- Rochester, NY
- Full-Time
- 69 days ago
- $141,000–$204,500
Senior Software Engineer - AI Platform Engineering.
Before you go
Before you leave us, sign up for our email alerts
We don't do job spam, just the best digital jobs delivered straight to your inbox.
Senior Software Engineer - AI Platform Engineering: our view in 3 lines...
- The Role:This role is for a senior software engineer building AI platform infrastructure for model and agent runtimes in a healthcare environment.
- The Person:The person will design and build hosting environments, scale multi-tenant hybrid-cloud capabilities, implement monitoring and tracing, support platform operations, and work with cross-functional AI teams.
- Requirements:The ideal candidate has experience with scalable back-end systems, Kubernetes, LLMs, autonomous agents, inference optimization, RAG architectures, and observability in distributed environments.
About the role
The Role
As a Senior Software Engineer for AI Platform Engineering, you will bridge the gap between high-scale systems architecture and frontier AI. You will be one of architects and builders of our Model & Agent Runtimes—the specialized engines that govern how models and autonomous agents execute across our hybrid-cloud footprint.
This isn't just about deployment; it’s about a platform-first mindset. You will ensure that AI capabilities are scalable, secure, and governed through world-class AgentOps, LLMOps, and MLOps practices.
What You’ll Do
- Architect the Future of Runtimes: Design and implement high-performance hosting environments for both specialized models and autonomous agents.
- Scale Hybrid-Cloud Infrastructure: Build multi-tenant platform capabilities that support seamless agent and model execution across diverse cloud and on-prem environments.
- Drive Operational Excellence: Implement robust solutions for real-time monitoring, distributed tracing, and automated evaluation of agents & models in production.
- Operational Stewardship: Act as a member of our rotational platform operational team, ensuring the reliability and uptime of critical AI services.
- Collaborate & Advocate: Partner with cross-functional AI teams to identify system friction, streamlining their workflows and accelerating the delivery of AI-driven value.
What You’ll Bring
- Deep Systems Expertise: Proven experience building scalable back-end systems, ideally with a focus on containerization and orchestration (Kubernetes).
- AI/ML Fluency: Strong understanding of the lifecycle of LLMs and autonomous agents, including inference optimization and RAG architectures.
- Operational Rigor: A track record of implementing observability (logging, metrics, tracing) in complex, distributed environments.
- Problem-Solving Mindset: The ability to turn abstract AI research into production-grade, hardened platform features.
Why this team? We are moving beyond simple model serving. We are building the foundational "nervous system" for autonomous agents in a high-stakes environment where performance and governance are non-negotiable.
This vacancy is not eligible for sponsorship/ we will not sponsor or transfer visas for this position. Also, Mayo Clinic DOES NOT participate in the F-1 STEM OPT extension program.
Mayo Clinic is top-ranked in more specialties than any other care provider according to U.S. News & World Report. As we work together to put the needs of the patient first, we are also dedicated to our employees, investing in competitive compensation and comprehensive benefit plans – to take care of you and your family, now and in the future. And with continuing education and advancement opportunities at every turn, you can build a long, successful career with Mayo Clinic.
- Medical: Multiple plan options.
- Dental: Delta Dental or reimbursement account for flexible coverage.
- Vision: Affordable plan with national network.
- Pre-Tax Savings: HSA and FSAs for eligible expenses.
- Retirement: Competitive retirement package to secure your future.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, protected veteran status or disability status. Learn more about the "EOE is the Law". Mayo Clinic participates in E-Verify and may provide the Social Security Administration and, if necessary, the Department of Homeland Security with information from each new employee's Form I-9 to confirm work authorization.