Nick Bostrom is an AI philosopher and the author of Superintelligence and Deep Utopia. Bostrom joins Big Technology to discuss whether the rise of autonomous AI agents is making the technology’s existential risks more concrete. Tune in to hear his assessment of the alignment problem, recursive self-improvement, and humanity’s chances of steering superintelligence toward a positive outcome. We also cover whether we have reached AGI, the case for a precisely timed AI pause, biological threats, AI consciousness, and the moral status of digital minds. Hit play for a clear-eyed conversation about AI’s greatest dangers and its potential to radically improve human life. --- Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice. Watch the full documentary here: https://www.gravitee.io/ai-agent-documentary Want a discount for Big Technology on Substack + Discord? Here’s 25% off for the first year: https://www.bigtechnology.com/subscribe?coupon=0843016b 0:00 Why AI Risk Feels More Concrete 4:07 The Paperclip Maximizer Becomes Real 7:41 Open-Weight Models and Misuse 11:40 Did We Waste Time on AI Safety? 14:57 Can Humanity Steer AI Safely? 20:36 AI Offense vs. Defense 22:43 Why Biological Risk Is Different 25:31 Recursive Self-Improvement 29:38 When an AI Pause Could Help 37:02 Break 38:21 Have We Reached AGI? 44:53 Can AI Be Conscious? 48:57 Do Digital Minds Deserve Rights? 52:07 How Humans Should Treat AI