← Back to opportunities

Senior Software Engineer - AI Inference

📍 Location
New York
⏰ Job Type
Full-time
📅 Posted
June 17, 2026

About the Role

Senior Software Engineer - AI Inference

Location

New York

Business Area

Engineering and CTO

Ref #

10050779

**Description & Requirements**

**Our team:**
Join the team that is building the core infrastructure for AI at Bloomberg. The Bloomberg AI Inference Platform provides production-grade managed infrastructure for hosting, deploying, and serving all machine learning models, both predictive and cutting-edge generative models. We abstract away infrastructure complexity, empowering engineering teams to focus on creating intelligent applications with guaranteed scalability, performance, and governance. Our platform is built on the open-source KServe project, and the CNCS AI Inference team is a primary contributor to its development.

**We'll trust you to:**

+ Design and build scalable infrastructure for both online and offline inference workloads.
+ Lead integration of high-performance inference...

Ready to Join Through a Referral?

Apply now and get connected directly with the hiring team

Apply for this Position