Reduce GPU waste and optimize costs with StormForge GPU Optimization. Now available close-btn
Videos, demos, webinars

Emerging Kubernetes tools for AI and optimizing GPU workloads

John Platt, CTO of StormForge, as he speaks to KubeFM on the latest Kubernetes tools and how Kubernetes is evolving to support AI/ML workloads.

Podcast – Emerging Kubernetes tools for AI and optimizing GPU workloads

Discover how Kubernetes is evolving to support AI/ML workloads in this interview with John Platt, CTO at StormForge (now part of CloudBolt) on KubeFM’s podcast series.

This episode will cover:
 

  • Notable new Kubernetes tools, such as in-place pod resizing for smoother workload rightsizing, EKS Auto Mode to streamline node management, and NOS for simplifying GPU virtualization.
  • The growing adoption of Kubernetes as the preferred platform for AI/ML workloads, delivering substantial cost savings (up to 90%) over managed services like OpenAI, along with enhanced scalability and flexibility.
  • Key obstacles to running AI on Kubernetes, including managing GPU drivers, ensuring CUDA version compatibility, and accommodating very large models that may exceed tens of gigabytes.
Sign up for our newsletter

Exclusive insights and strategies for cloud pros. Delivered straight to your inbox.


AUTHOR
CloudBolt
  Learn more

Related Blogs

 
thumbnail
KubeCon 2026: How AI is Changing the Kubernetes Optimization Conversation

I’ve been going to KubeCon for five years now, talking to people about rightsizing. Each year people come in knowing…

 
thumbnail
How CloudBolt’s MCP server keeps AI agents inside your guardrails

By now, most of us have watched an AI agent spin up a VM from a chat window. It’s a…

 
thumbnail
Watch an AI agent provision a server with ServiceNow approval

In this demo, a standard user asks Claude for a server and gets one back about six minutes later. CloudBolt…