Interview

The hidden data bottleneck in AI factories

Sven Breuner

Field CTO, VAST Data

35 minHosted by Kim Isenberg

Watch on YouTube

About this conversation

Everyone talks about GPUs. But in real-world AI infrastructure, the bottleneck is often somewhere else: the data layer. Kim Isenberg speaks with Sven Breuner from VAST Data about the infrastructure behind modern AI systems — from GPU utilization and storage architecture to HPC, inference, data movement and the concept of AI factories.

As companies invest billions into GPUs, many discover that compute alone is not enough: if data cannot move fast enough, GPUs sit idle, training becomes inefficient and inference struggles to scale.

Topics

  • Why GPUs often wait for data
  • How AI workloads differ from traditional HPC workloads
  • When storage, metadata and networking become bottlenecks
  • Why the data layer matters for both training and inference
  • What VAST means by an “AI Operating System”
  • What to consider before buying more GPUs

Kim Isenberg is co-founder and Editor-in-Chief of Superintelligence, an AI newsletter published every weekday.

Read the Newsletter

More interviews

All interviews