Understanding the inner thoughts of AI

What if you were to peer inside the ‘mind’ of AI? You wouldn’t find fully formed thoughts, just vast arrays of numbers. In this episode, Professor Hannah Fry is joined by Neel Nanda, to shine a light on an ongoing open area of research, interpretability. Neel and his team are trying to do something phenomenally difficult: understand an intelligence that didn’t come with a manual.

Together, they explore the cutting-edge "neuroscience" of artificial intelligence—revealing the surprising, elegant structures being discovered inside these networks (like spare auto encoders), the inherent limits of looking under the hood, and why interpretability is absolutely essential if we are to build safe, aligned and trustworthy AI as we move towards AGI.

Learn more about this area of research via https://deepmind.google/

00:00 Introduction
02:41 Motivation for interpretability research
04:01 Mechanistic interpretability
08:14 Chain of thought monitoring
18:14 Interpretability techniques
35:00 Auditing models for safety
48:53 What comes next for interpretability

Intro visuals from Winston Duke for Visualising AI: https://winstonduke.com/Google-Deepmind-Visualising-AI

___

Subscribe to our channel https://www.youtube.com/@googledeepmind
Find us on X https://x.com/GoogleDeepMind
Follow us on Instagram https://instagram.com/googledeepmind
Add us on Linkedin https://www.linkedin.com/company/deepmind/