AI Factories Explained: What’s Actually New?

AI factory is one of those terms that seemed to appear overnight. Vendors are talking about it. Enterprises are investing in it. Governments are funding it.

But what is an AI factory, really?

In this episode of the TWIML Briefing Room, recorded live at HPE Discover 2026, I sit down with Thierry Pienaar, CTO of AI & HPC at HPE, and Kaushik Shirhatti, VP of AI Factory at NVIDIA, to unpack what’s actually changing in enterprise AI infrastructure.

We discuss:

• Why inference—not training—is reshaping enterprise AI
• The real difference between cloud, on-prem, and hybrid AI deployments
• Why data, governance, and organizational alignment matter as much as GPUs
• The rise of sovereign AI and what it means for governments and enterprises
• Why AI factories are about much more than racks of GPUs

Whether you’re building AI systems, leading AI initiatives, or trying to separate lasting trends from industry buzzwords, this conversation offers a practical look at where enterprise AI infrastructure is headed.

🔔 Subscribe to TWIML AI Podcast for more deep dives into Machine Learning and AI: https://twimlai.com/

⏱️ Chapters:
0:00 – Introduction: What exactly is an AI Factory?
0:41 – The 5 Layers of the AI Factory Stack
1:28 – Private Cloud vs. AI Factory: Scaling for the Enterprise
2:06 – The Shift from Training to Inference & Cost Optimization
3:18 – Enterprise Challenges: Data, ROI, and Prioritization
5:29 – Optimizing vs. Reimagining Workflows
6:46 – On-Prem vs. Cloud: Why AI is breaking down IT silos
9:27 – Sovereign AI: Strategic Autonomy and National Security
11:34 – Sovereign AI in Action: The TELUS Use Case
13:40 – Spicy Takes: Liquid Cooling, Agentic AI, and Physical Robots

🔗 Links:

Check out the TWIML Blog for more analysis: https://twimlai.com/articles
Learn more about AI Factories: https://www.hpe.com/us/en/solutions/artificial-intelligence/nvidia-collaboration.html?utm_campaign=FY26_Q3_AI_GB_GD_WW_WW_Speed_Time_to_AI_Value&utm_medium=DD&utm_source=HIP&utm_content=521229221&crid=%ecid!&plid=%epid!