My podcast guest is Andy Hock, Chief Strategy Officer at Cerebras.  Andy and I discuss the the revolutionary details of the Cerebras Wafer-Scale Engine (WSE). We also explore where the next major competitive frontier lies for AI hardware, how the latest WSE addresses the critical latency and energy efficiency challenges of deploying massive AI models for inference and Cerebras’ role in democratizing access to large-scale AI research and deployment.

… Read More → "Democratizing Large-Scale AI: The Future of AI Hardware with Andy Hock from Cerebras"

This week, we’re diving into the hidden challenges of AI infrastructure with David Driggers, CEO of Cirrascale. David and I chat about the surprising failure points that traditional data center planning often misses when it comes to large-scale AI deployments, why old assumptions about power, cooling, and networking simply don’t hold up anymore and why the “just add GPUs” strategy can be a recipe for disaster without a true systems-thinking approach. Also this week, I check out a massive breakthrough where physicists are using AI to uncover entirely new laws … Read More → "The Hidden Truths of AI Infrastructure: Why “Just Add GPUs” Always Fails"

This week, I’m excited to welcome Sandra Rivera from VSORA! We dive into a discussion on why AI inference is essential for deployment at scale, specifically focusing on how VSORA’s patented software architecture addresses the “memory wall” by collapsing memory layers. We explore their recent tape-out,  the need for low latency and high determinism, future plans for OEM modules and MLPerf benchmarking, and even get a brief look into Sandra’s family llama farm.

… Read More → "Solving the Memory Wall: A Deep Dive into AI Inference with Sandra Rivera"