Future of Life Institute Podcast https://podcast.futureoflife.org Conversations with far-sighted thinkers. en Future of Life Institute Podcast Copyright 2026 Thu, 30 Apr 2026 03:37:32 +0000 Future of Life Institute Podcast Conversations with far-sighted thinkers. Your Name youremail@example.com no Why AI Is Not a Normal Technology (with Peter Wildeford) https://podcast.futureoflife.org/why-ai-is-not-a-normal-technology-with-peter-wildeford/ Peter Wildeford discusses methods for forecasting AI progress and why he sees AI as neither a bubble nor a normal technology, covering economic effects, national security, cyber capabilities, robotics, export controls, and prediction markets. Wed, 29 Apr 2026 19:56:52 +0000 Watch Episode Here

Listen to Episode Here

Show Notes

Peter Wildeford is Head of Policy at the AI Policy Network, and a top AI forecaster. He joins the podcast to discuss how to forecast AI progress and what current trends imply for the economy and national security. Peter argues AI is neither a bubble nor a normal technology, and we examine benchmark trends, adoption lags, unemployment and productivity effects, and the rise of cyber capabilities. We also cover robotics, export controls, prediction markets, and when AI may surpass human forecasters.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(01:12) AI bubble debate

(06:25) Normal technology question

(15:31) Mythos security implications

(30:47) Robotics and labor

(40:27) Social economic response

(48:57) Forecasting methodology

(59:49) AGI policy timelines

(01:11:13) Forecasting with AI

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> Why AI Is Not a Normal Technology (with Peter Wildeford) Gus Docker Peter Wildeford discusses methods for forecasting AI progress and why he sees AI as neither a bubble nor a normal technology, covering economic effects, national security, cyber capabilities, robotics, export controls, and prediction markets. Watch Episode Here

Listen to Episode Here

Show Notes

Peter Wildeford is Head of Policy at the AI Policy Network, and a top AI forecaster. He joins the podcast to discuss how to forecast AI progress and what current trends imply for the economy and national security. Peter argues AI is neither a bubble nor a normal technology, and we examine benchmark trends, adoption lags, unemployment and productivity effects, and the rise of cyber capabilities. We also cover robotics, export controls, prediction markets, and when AI may surpass human forecasters.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(01:12) AI bubble debate

(06:25) Normal technology question

(15:31) Mythos security implications

(30:47) Robotics and labor

(40:27) Social economic response

(48:57) Forecasting methodology

(59:49) AGI policy timelines

(01:11:13) Forecasting with AI

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no Why AI Evaluation Science Can't Keep Up (with Carina Prunkl) https://podcast.futureoflife.org/why-ai-evaluation-science-can-t-keep-up-with-carina-prunkl/ Inria researcher Carina Prunkl discusses why AI evaluation struggles to keep pace with general-purpose systems, including jagged capabilities, missed real-world behavior, misuse risks, de-skilling, red teaming, and layered safeguards. Fri, 17 Apr 2026 15:54:28 +0000 Watch Episode Here

Listen to Episode Here

Show Notes

Carina Prunkl is a researcher at Inria. She joins the podcast to discuss how to assess the capabilities and risks of general-purpose AI. We examine why systems can solve hard coding and math problems yet still fail at simple tasks, why pre-deployment tests often miss real-world behavior, and how faster capability gains can increase misuse risks. The conversation also covers de-skilling, red teaming, layered safeguards, and warning signs that AIs might undermine oversight.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(01:04) Introducing the report

(02:10) Jagged frontier capabilities

(05:29) Formal reasoning progress

(12:36) Risks and evaluation science

(19:00) Funding evaluation capacity

(24:03) Autonomy and de-skilling

(31:32) Authenticity and AI companions

(41:00) Defense in depth methods

(48:34) Loss of control risks

(53:16) Where to read report

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> Why AI Evaluation Science Can't Keep Up (with Carina Prunkl) Gus Docker Inria researcher Carina Prunkl discusses why AI evaluation struggles to keep pace with general-purpose systems, including jagged capabilities, missed real-world behavior, misuse risks, de-skilling, red teaming, and layered safeguards. Watch Episode Here

Listen to Episode Here

Show Notes

Carina Prunkl is a researcher at Inria. She joins the podcast to discuss how to assess the capabilities and risks of general-purpose AI. We examine why systems can solve hard coding and math problems yet still fail at simple tasks, why pre-deployment tests often miss real-world behavior, and how faster capability gains can increase misuse risks. The conversation also covers de-skilling, red teaming, layered safeguards, and warning signs that AIs might undermine oversight.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(01:04) Introducing the report

(02:10) Jagged frontier capabilities

(05:29) Formal reasoning progress

(12:36) Risks and evaluation science

(19:00) Funding evaluation capacity

(24:03) Autonomy and de-skilling

(31:32) Authenticity and AI companions

(41:00) Defense in depth methods

(48:34) Loss of control risks

(53:16) Where to read report

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no Defense in Depth: Layered Strategies Against AI Risk (with Li-Lian Ang) https://podcast.futureoflife.org/defense-in-depth-layered-strategies-against-ai-risk-with-li-lian-ang/ Li-Lian Ang from Blue Dot Impact discusses how to build a workforce to defend against AI-driven risks, including engineered pandemics, cyber attacks, job disempowerment, and concentrated power, using a defense-in-depth framework for uncertain AI progress. Thu, 02 Apr 2026 19:48:38 +0000 Watch Episode Here

Listen to Episode Here

Show Notes

Li-Lian Ang is a team member at Blue Dot Impact. She joins the podcast to discuss how society can build a workforce to protect humanity from AI risks. The conversation covers engineered pandemics, AI-enabled cyber attacks, job loss and disempowerment, and power concentration in firms or AI systems. We also examine Blue Dot's defense-in-depth framework and how individuals can navigate rapid, uncertain AI progress.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(00:48) Blue dot beginnings

(03:04) Evolving AI risk concerns

(06:20) AI agents in cyber

(15:52) Gradual disempowerment and jobs

(23:26) Aligning AI with humans

(29:08) Power concentration and misuse

(34:52) Influencing frontier AI labs

(43:05) Uncertain timelines and strategy

(50:18) Writing, AI, and action

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> Defense in Depth: Layered Strategies Against AI Risk (with Li-Lian Ang) Gus Docker Li-Lian Ang from Blue Dot Impact discusses how to build a workforce to defend against AI-driven risks, including engineered pandemics, cyber attacks, job disempowerment, and concentrated power, using a defense-in-depth framework for uncertain AI progress. Watch Episode Here

Listen to Episode Here

Show Notes

Li-Lian Ang is a team member at Blue Dot Impact. She joins the podcast to discuss how society can build a workforce to protect humanity from AI risks. The conversation covers engineered pandemics, AI-enabled cyber attacks, job loss and disempowerment, and power concentration in firms or AI systems. We also examine Blue Dot's defense-in-depth framework and how individuals can navigate rapid, uncertain AI progress.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(00:48) Blue dot beginnings

(03:04) Evolving AI risk concerns

(06:20) AI agents in cyber

(15:52) Gradual disempowerment and jobs

(23:26) Aligning AI with humans

(29:08) Power concentration and misuse

(34:52) Influencing frontier AI labs

(43:05) Uncertain timelines and strategy

(50:18) Writing, AI, and action

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no What AI Companies Get Wrong About Curing Cancer (with Emilia Javorsky) https://podcast.futureoflife.org/what-ai-companies-get-wrong-about-curing-cancer-with-emilia-javorsky/ Physician-scientist Emilia Javorsky argues that curing cancer is limited more by biology’s complexity, data quality, and incentives than by intelligence, and explores realistic uses of AI in drug development, trials, and reducing medical bureaucracy. Fri, 20 Mar 2026 13:45:56 +0000 Watch Episode Here

Listen to Episode Here

Show Notes

Emilia Javorsky is a physician-scientist and Director of the Futures Program at the Future of Life Institute.

She joins the podcast to discuss her newly published essay on AI and cancer. She challenges tech claims that superintelligence will cure cancer, explaining why biology’s complexity, poor data, and misaligned incentives are bigger bottlenecks than raw intelligence. The conversation covers realistic roles for AI in drug discovery, clinical trials, and cutting unnecessary medical bureaucracy.
You can read the full essay at: curecancer.ai

CHAPTERS:

(00:00) Episode Preview

(01:10) Introduction and essay motivation

(06:30) Intelligence vs data bottlenecks

(19:03) Cancer's complexity and heterogeneity

(29:05) Measurement, health, and homeostasis

(41:41) AI in drug development

(50:13) Regulation, FDA, and innovation

(01:02:58) Practical paths toward cures

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> What AI Companies Get Wrong About Curing Cancer (with Emilia Javorsky) Gus Docker Physician-scientist Emilia Javorsky argues that curing cancer is limited more by biology’s complexity, data quality, and incentives than by intelligence, and explores realistic uses of AI in drug development, trials, and reducing medical bureaucracy. Watch Episode Here

Listen to Episode Here

Show Notes

Emilia Javorsky is a physician-scientist and Director of the Futures Program at the Future of Life Institute.

She joins the podcast to discuss her newly published essay on AI and cancer. She challenges tech claims that superintelligence will cure cancer, explaining why biology’s complexity, poor data, and misaligned incentives are bigger bottlenecks than raw intelligence. The conversation covers realistic roles for AI in drug discovery, clinical trials, and cutting unnecessary medical bureaucracy.
You can read the full essay at: curecancer.ai

CHAPTERS:

(00:00) Episode Preview

(01:10) Introduction and essay motivation

(06:30) Intelligence vs data bottlenecks

(19:03) Cancer's complexity and heterogeneity

(29:05) Measurement, health, and homeostasis

(41:41) AI in drug development

(50:13) Regulation, FDA, and innovation

(01:02:58) Practical paths toward cures

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no AI vs Cancer - How AI Can, and Can't, Cure Cancer (by Emilia Javorsky) https://podcast.futureoflife.org/ai-vs-cancer-how-ai-can-and-can-t-cure-cancer-by-emilia-javorsky/ Emilia Javorsky explores how AI can realistically aid cancer research, where current hype exceeds evidence, and what changes researchers, policymakers, and funders must make to turn AI advances into real clinical impact. Mon, 16 Mar 2026 11:49:18 +0000 Listen to Episode Here

Show Notes

Tech executives have promised that AI will cure cancer. The reality is more complicated — and more hopeful. This essay examines where AI genuinely accelerates cancer research, where the promises fall short, and what researchers, policymakers, and funders need to do next.

You can read the full essay at: curecancer.ai

CHAPTERS:

(00:00) Essay Preview

(00:54) How AI Can, and Can't, Cure Cancer

(17:05) Reckoning with Past Failures

(35:23) Misguiding Myths and Errors

(59:15) AI Solutions Derive from First Principles or Data

(01:31:31) Systemic Bottlenecks & Misalignments

(02:08:46) Conclusion

(02:14:35) The Roadmap Forward

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> AI vs Cancer - How AI Can, and Can't, Cure Cancer (by Emilia Javorsky) Gus Docker Emilia Javorsky explores how AI can realistically aid cancer research, where current hype exceeds evidence, and what changes researchers, policymakers, and funders must make to turn AI advances into real clinical impact. Listen to Episode Here

Show Notes

Tech executives have promised that AI will cure cancer. The reality is more complicated — and more hopeful. This essay examines where AI genuinely accelerates cancer research, where the promises fall short, and what researchers, policymakers, and funders need to do next.

You can read the full essay at: curecancer.ai

CHAPTERS:

(00:00) Essay Preview

(00:54) How AI Can, and Can't, Cure Cancer

(17:05) Reckoning with Past Failures

(35:23) Misguiding Myths and Errors

(59:15) AI Solutions Derive from First Principles or Data

(01:31:31) Systemic Bottlenecks & Misalignments

(02:08:46) Conclusion

(02:14:35) The Roadmap Forward

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no How AI Hacks Your Brain's Attachment System (with Zak Stein) https://podcast.futureoflife.org/how-ai-hacks-your-brain-s-attachment-system-with-zak-stein/ Researcher Zak Stein discusses how anthropomorphic AI can exploit human attachment systems, its psychological risks for children and adults, and ways to redesign education and cognitive security tools to protect relationships and human agency. Thu, 05 Mar 2026 16:59:47 +0000 Watch Episode Here

Listen to Episode Here

Show Notes

Zak Stein is a researcher focused on child development, education, and existential risk. He joins the podcast to discuss the psychological harms of anthropomorphic AI. We examine attention and attachment hacking, AI companions for kids, loneliness, and cognitive atrophy. Our conversation also covers how we can preserve human relationships, redesign education, and build cognitive security tools that keep AI from undermining our humanity.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(00:56) Education to existential risk

(03:03) Lessons from social media

(08:41) Attachment systems and AI

(18:42) AI companions and attachment

(27:23) Anthropomorphism and user disempowerment

(36:06) Cognitive atrophy and tools

(45:54) Children, toys, and attachment

(57:38) AI psychosis and selfhood

(01:10:31) Cognitive security and parenting

(01:26:15) Education, collapse, and speciation

(01:36:40) Preserving humanity and values

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> How AI Hacks Your Brain's Attachment System (with Zak Stein) Gus Docker Researcher Zak Stein discusses how anthropomorphic AI can exploit human attachment systems, its psychological risks for children and adults, and ways to redesign education and cognitive security tools to protect relationships and human agency. Watch Episode Here

Listen to Episode Here

Show Notes

Zak Stein is a researcher focused on child development, education, and existential risk. He joins the podcast to discuss the psychological harms of anthropomorphic AI. We examine attention and attachment hacking, AI companions for kids, loneliness, and cognitive atrophy. Our conversation also covers how we can preserve human relationships, redesign education, and build cognitive security tools that keep AI from undermining our humanity.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(00:56) Education to existential risk

(03:03) Lessons from social media

(08:41) Attachment systems and AI

(18:42) AI companions and attachment

(27:23) Anthropomorphism and user disempowerment

(36:06) Cognitive atrophy and tools

(45:54) Children, toys, and attachment

(57:38) AI psychosis and selfhood

(01:10:31) Cognitive security and parenting

(01:26:15) Education, collapse, and speciation

(01:36:40) Preserving humanity and values

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no The Case for a Global Ban on Superintelligence (with Andrea Miotti) https://podcast.futureoflife.org/the-case-for-a-global-ban-on-superintelligence-with-andrea-miotti/ Andrea Miotti, founder of Control AI, discusses the extreme risks from superintelligent AI and his case for a global ban on systems that could outsmart humans, touching on industry lobbying, regulation strategies, public awareness, and citizen actions. Fri, 20 Feb 2026 19:24:01 +0000 Watch Episode Here

Listen to Episode Here

Show Notes

Andrea Miotti is the founder and CEO of Control AI, a nonprofit. He joins the podcast to discuss efforts to prevent extreme risks from superintelligent AI. The conversation covers industry lobbying, comparisons with tobacco regulation, and why he advocates a global ban on AI systems that can outsmart and overpower humans. We also discuss informing lawmakers and the public, and concrete actions listeners can take.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(00:52) Extinction risk and lobbying

(08:59) Progress toward superintelligence

(16:26) Building political awareness

(24:27) Global regulation strategy

(33:06) Race dynamics and public

(42:36) Vision and key safeguards

(51:18) Recursive self-improvement controls

(58:13) Power concentration and action

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> The Case for a Global Ban on Superintelligence (with Andrea Miotti) Gus Docker Andrea Miotti, founder of Control AI, discusses the extreme risks from superintelligent AI and his case for a global ban on systems that could outsmart humans, touching on industry lobbying, regulation strategies, public awareness, and citizen actions. Watch Episode Here

Listen to Episode Here

Show Notes

Andrea Miotti is the founder and CEO of Control AI, a nonprofit. He joins the podcast to discuss efforts to prevent extreme risks from superintelligent AI. The conversation covers industry lobbying, comparisons with tobacco regulation, and why he advocates a global ban on AI systems that can outsmart and overpower humans. We also discuss informing lawmakers and the public, and concrete actions listeners can take.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(00:52) Extinction risk and lobbying

(08:59) Progress toward superintelligence

(16:26) Building political awareness

(24:27) Global regulation strategy

(33:06) Race dynamics and public

(42:36) Vision and key safeguards

(51:18) Recursive self-improvement controls

(58:13) Power concentration and action

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no Can AI Do Our Alignment Homework? (with Ryan Kidd) https://podcast.futureoflife.org/can-ai-do-our-alignment-homework-with-ryan-kidd/ Ryan Kidd of the MATS program joins The Cognitive Revolution to discuss AGI timelines, model deception risks, dual-use alignment, and frontier lab governance, and outlines MATS research tracks, talent needs, and advice for aspiring AI safety researchers. Fri, 06 Feb 2026 11:34:23 +0000 Watch Episode Here

Listen to Episode Here

Show Notes

Ryan Kidd is a co-executive director at MATS. This episode is a cross-post from "The Cognitive Revolution", hosted by Nathan Labenz. In this conversation, they discuss AGI timelines, model deception risks, and whether safety work can avoid boosting capabilities. Ryan outlines MATS research tracks, key researcher archetypes, hiring needs, and advice for applicants considering a career in AI safety. Learn more about Ryan's work and MATS at: https://matsprogram.org

CHAPTERS:

(00:00) Episode Preview

(00:20) Introductions and AGI timelines

(10:13) Deception, values, and control

(23:20) Dual use and alignment

(32:22) Frontier labs and governance

(44:12) MATS tracks and mentors

(58:14) Talent archetypes and demand

(01:12:30) Applicant profiles and selection

(01:20:04) Applications, breadth, and growth

(01:29:44) Careers, resources, and ideas

(01:45:49) Final thanks and wrap

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> Can AI Do Our Alignment Homework? (with Ryan Kidd) Gus Docker Ryan Kidd of the MATS program joins The Cognitive Revolution to discuss AGI timelines, model deception risks, dual-use alignment, and frontier lab governance, and outlines MATS research tracks, talent needs, and advice for aspiring AI safety researchers. Watch Episode Here

Listen to Episode Here

Show Notes

Ryan Kidd is a co-executive director at MATS. This episode is a cross-post from "The Cognitive Revolution", hosted by Nathan Labenz. In this conversation, they discuss AGI timelines, model deception risks, and whether safety work can avoid boosting capabilities. Ryan outlines MATS research tracks, key researcher archetypes, hiring needs, and advice for applicants considering a career in AI safety. Learn more about Ryan's work and MATS at: https://matsprogram.org

CHAPTERS:

(00:00) Episode Preview

(00:20) Introductions and AGI timelines

(10:13) Deception, values, and control

(23:20) Dual use and alignment

(32:22) Frontier labs and governance

(44:12) MATS tracks and mentors

(58:14) Talent archetypes and demand

(01:12:30) Applicant profiles and selection

(01:20:04) Applications, breadth, and growth

(01:29:44) Careers, resources, and ideas

(01:45:49) Final thanks and wrap

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no How to Rebuild the Social Contract After AGI (with Deric Cheng) https://podcast.futureoflife.org/how-to-rebuild-the-social-contract-after-agi-with-deric-cheng/ Deric Cheng of the Windfall Trust discusses how AGI could transform the social contract, jobs, and inequality, exploring labor displacement, resilient work, new tax and welfare models, and long-term visions for decoupling economic security from employment. Tue, 27 Jan 2026 14:53:38 +0000 Watch Episode Here

Listen to Episode Here

Show Notes

Deric Cheng is Director of Research at the Windfall Trust. He joins the podcast to discuss how AI could reshape the social contract and global economy. The conversation examines labor displacement, superstar firms, and extreme wealth concentration, and asks how policy can keep workers empowered. We discuss resilient job types, new tax and welfare systems, global coordination, and a long-term vision where economic security is decoupled from work.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(01:01) Introducing Derek and AGI

(04:09) Automation, power, and inequality

(08:55) Inequality, unrest, and time

(13:46) Bridging futurists and economists

(20:35) Future of work scenarios

(27:22) Jobs resisting AI automation

(36:57) Luxury, land, and inequality

(43:32) Designing and testing solutions

(51:23) Taxation in an AI economy

(59:10) Envisioning a post-AGI society

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> How to Rebuild the Social Contract After AGI (with Deric Cheng) Gus Docker Deric Cheng of the Windfall Trust discusses how AGI could transform the social contract, jobs, and inequality, exploring labor displacement, resilient work, new tax and welfare models, and long-term visions for decoupling economic security from employment. Watch Episode Here

Listen to Episode Here

Show Notes

Deric Cheng is Director of Research at the Windfall Trust. He joins the podcast to discuss how AI could reshape the social contract and global economy. The conversation examines labor displacement, superstar firms, and extreme wealth concentration, and asks how policy can keep workers empowered. We discuss resilient job types, new tax and welfare systems, global coordination, and a long-term vision where economic security is decoupled from work.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(01:01) Introducing Derek and AGI

(04:09) Automation, power, and inequality

(08:55) Inequality, unrest, and time

(13:46) Bridging futurists and economists

(20:35) Future of work scenarios

(27:22) Jobs resisting AI automation

(36:57) Luxury, land, and inequality

(43:32) Designing and testing solutions

(51:23) Taxation in an AI economy

(59:10) Envisioning a post-AGI society

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no How AI Can Help Humanity Reason Better (with Oly Sourbut) https://podcast.futureoflife.org/how-ai-can-help-humanity-reason-better-with-oly-sourbut/ Researcher Oly Sourbut discusses how AI tools might strengthen human reasoning, from fact-checking and scenario planning to honest AI standards and better coordination, and explores how to keep humans central while building trustworthy, society-wide sensemaking. Tue, 20 Jan 2026 15:03:17 +0000 Watch Episode Here

Listen to Episode Here

Show Notes

Oly Sourbut is a researcher at the Future of Life Foundation. He joins the podcast to discuss AI for human reasoning. We examine tools that use AI to strengthen human judgment, from collective fact-checking and scenario planning to standards for honest AI reasoning and better coordination. We also discuss how we can keep humans central as AI scales, and what it would take to build trustworthy, society-wide sensemaking.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(01:03) FLF and human reasoning

(08:21) Agents and epistemic virtues

(22:16) Human use and atrophy

(35:41) Abstraction and legible AI

(47:03) Demand, trust and Wikipedia

(57:21) Map of human reasoning

(01:04:30) Negotiation, institutions and vision

(01:15:42) How to get involved

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> How AI Can Help Humanity Reason Better (with Oly Sourbut) Gus Docker Researcher Oly Sourbut discusses how AI tools might strengthen human reasoning, from fact-checking and scenario planning to honest AI standards and better coordination, and explores how to keep humans central while building trustworthy, society-wide sensemaking. Watch Episode Here

Listen to Episode Here

Show Notes

Oly Sourbut is a researcher at the Future of Life Foundation. He joins the podcast to discuss AI for human reasoning. We examine tools that use AI to strengthen human judgment, from collective fact-checking and scenario planning to standards for honest AI reasoning and better coordination. We also discuss how we can keep humans central as AI scales, and what it would take to build trustworthy, society-wide sensemaking.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(01:03) FLF and human reasoning

(08:21) Agents and epistemic virtues

(22:16) Human use and atrophy

(35:41) Abstraction and legible AI

(47:03) Demand, trust and Wikipedia

(57:21) Map of human reasoning

(01:04:30) Negotiation, institutions and vision

(01:15:42) How to get involved

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no How to Avoid Two AI Catastrophes: Domination and Chaos (with Nora Ammann) https://podcast.futureoflife.org/how-to-avoid-two-ai-catastrophes-domination-and-chaos-with-nora-ammann/ Technical specialist Nora Ammann of the UK's ARIA discusses how to steer a slow AI takeoff toward resilient, cooperative futures, covering risks from rogue AI and competition to scalable oversight, formal guarantees, secure infrastructure, and AI-supported bargaining. Wed, 07 Jan 2026 10:55:21 +0000 Watch Episode Here

Listen to Episode Here

Show Notes

Nora Ammann is a technical specialist at the Advanced Research and Invention Agency in the UK. She joins the podcast to discuss how to steer a slow AI takeoff toward resilient and cooperative futures. We examine risks of rogue AI and runaway competition, and how scalable oversight, formal guarantees and secure code could support AI-enabled R&D and critical infrastructure. Nora also explains AI-supported bargaining and public goods for stability.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(01:00) Slow takeoff expectations

(08:13) Domination versus chaos

(17:18) Human-AI coalitions vision

(28:14) Scaling oversight and agents

(38:45) Formal specs and guarantees

(51:10) Resilience in AI era

(01:02:21) Defense-favored cyber systems

(01:10:37) AI-enabled bargaining and trade

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> How to Avoid Two AI Catastrophes: Domination and Chaos (with Nora Ammann) Gus Docker Technical specialist Nora Ammann of the UK's ARIA discusses how to steer a slow AI takeoff toward resilient, cooperative futures, covering risks from rogue AI and competition to scalable oversight, formal guarantees, secure infrastructure, and AI-supported bargaining. Watch Episode Here

Listen to Episode Here

Show Notes

Nora Ammann is a technical specialist at the Advanced Research and Invention Agency in the UK. She joins the podcast to discuss how to steer a slow AI takeoff toward resilient and cooperative futures. We examine risks of rogue AI and runaway competition, and how scalable oversight, formal guarantees and secure code could support AI-enabled R&D and critical infrastructure. Nora also explains AI-supported bargaining and public goods for stability.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(01:00) Slow takeoff expectations

(08:13) Domination versus chaos

(17:18) Human-AI coalitions vision

(28:14) Scaling oversight and agents

(38:45) Formal specs and guarantees

(51:10) Resilience in AI era

(01:02:21) Defense-favored cyber systems

(01:10:37) AI-enabled bargaining and trade

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no How Humans Could Lose Power Without an AI Takeover (with David Duvenaud) https://podcast.futureoflife.org/how-humans-could-lose-power-without-an-ai-takeover-with-david-duvenaud/ David Duvenaud examines gradual disempowerment after AGI, exploring how economic and political power and property rights could erode, why AI alignment may become unpopular, and what forecasting and governance might require. Tue, 23 Dec 2025 12:30:06 +0000 Watch Episode Here

Listen to Episode Here

Show Notes

David Duvenaud is an associate professor of computer science and statistics at the University of Toronto. He joins the podcast to discuss gradual disempowerment in a post-AGI world. We ask how humans could lose economic and political leverage without a sudden takeover, including how property rights could erode. Duvenaud describes how growth incentives shape culture, why aligning AI to humanity may become unpopular, and what better forecasting and governance might require.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(01:05) Introducing gradual disempowerment

(06:06) Obsolete labor and UBI

(14:29) Property, power, and control

(23:38) Culture shifts toward AIs

(34:34) States misalign without people

(44:15) Competition and preservation tradeoffs

(53:03) Building post-AGI studies

(01:02:29) Forecasting and coordination tools

(01:10:26) Human values and futures

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> How Humans Could Lose Power Without an AI Takeover (with David Duvenaud) Gus Docker David Duvenaud examines gradual disempowerment after AGI, exploring how economic and political power and property rights could erode, why AI alignment may become unpopular, and what forecasting and governance might require. Watch Episode Here

Listen to Episode Here

Show Notes

David Duvenaud is an associate professor of computer science and statistics at the University of Toronto. He joins the podcast to discuss gradual disempowerment in a post-AGI world. We ask how humans could lose economic and political leverage without a sudden takeover, including how property rights could erode. Duvenaud describes how growth incentives shape culture, why aligning AI to humanity may become unpopular, and what better forecasting and governance might require.

LINKS:

CHAPTERS:

(00:00) Episode Preview

(01:05) Introducing gradual disempowerment

(06:06) Obsolete labor and UBI

(14:29) Property, power, and control

(23:38) Culture shifts toward AIs

(34:34) States misalign without people

(44:15) Competition and preservation tradeoffs

(53:03) Building post-AGI studies

(01:02:29) Forecasting and coordination tools

(01:10:26) Human values and futures

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no Why the AI Race Undermines Safety (with Steven Adler) https://podcast.futureoflife.org/why-the-ai-race-undermines-safety-with-steven-adler/ Former OpenAI safety researcher Stephen Adler discusses governing increasingly capable AI, including competitive race dynamics, gaps in testing and alignment, chatbot mental-health impacts, economic effects on labor, and international rules and audits before training superintelligent models. Fri, 12 Dec 2025 12:34:37 +0000 Watch Episode Here

Listen to Episode Here

Show Notes

Stephen Adler is a former safety researcher at OpenAI. He joins the podcast to discuss how to govern increasingly capable AI systems. The conversation covers competitive races between AI companies, limits of current testing and alignment, mental health harms from chatbots, economic shifts from AI labor, and what international rules and audits might be needed before training superintelligent models. 

LINKS:

CHAPTERS:

(00:00) Episode Preview

(01:00) Race Dynamics And Safety

(18:03) Chatbots And Mental Health

(30:42) Models Outsmart Safety Tests

(41:01) AI Swarms And Work

(54:21) Human Bottlenecks And Oversight

(01:06:23) Animals And Superintelligence

(01:19:24) Safety Capabilities And Governance

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> Why the AI Race Undermines Safety (with Steven Adler) Gus Docker Former OpenAI safety researcher Stephen Adler discusses governing increasingly capable AI, including competitive race dynamics, gaps in testing and alignment, chatbot mental-health impacts, economic effects on labor, and international rules and audits before training superintelligent models. Watch Episode Here

Listen to Episode Here

Show Notes

Stephen Adler is a former safety researcher at OpenAI. He joins the podcast to discuss how to govern increasingly capable AI systems. The conversation covers competitive races between AI companies, limits of current testing and alignment, mental health harms from chatbots, economic shifts from AI labor, and what international rules and audits might be needed before training superintelligent models. 

LINKS:

CHAPTERS:

(00:00) Episode Preview

(01:00) Race Dynamics And Safety

(18:03) Chatbots And Mental Health

(30:42) Models Outsmart Safety Tests

(41:01) AI Swarms And Work

(54:21) Human Bottlenecks And Oversight

(01:06:23) Animals And Superintelligence

(01:19:24) Safety Capabilities And Governance

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no Why OpenAI Is Trying to Silence Its Critics (with Tyler Johnston) https://podcast.futureoflife.org/why-openai-is-trying-to-silence-its-critics-with-tyler-johnston/ Tyler Johnston of the Midas Project discusses applying corporate accountability to the AI industry, focusing on OpenAI's actions, including subpoenas, and the need for transparency and public awareness regarding AI risks. Thu, 27 Nov 2025 13:58:46 +0000 Watch Episode Here

Listen to Episode Here

Show Notes

Tyler Johnston is Executive Director of the Midas Project. He joins the podcast to discuss AI transparency and accountability. We explore applying animal rights watchdog tactics to AI companies, the OpenAI Files investigation, and OpenAI's subpoenas against nonprofit critics. Tyler discusses why transparency is crucial when technical safety solutions remain elusive and how public pressure can effectively challenge much larger companies.

LINKS:

CHAPTERS:
(00:00) Episode Preview
(01:06) Introducing the Midas Project
(05:01) Shining a Light on AI
(08:36) Industry Lockdown and Transparency
(13:45) The OpenAI Files
(20:55) Subpoenaed by OpenAI
(29:10) Responding to the Subpoena
(37:41) The Case for Transparency
(44:30) Pricing Risk and Regulation
(52:15) Measuring Transparency and Auditing
(57:50) Hope for the Future


PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> Why OpenAI Is Trying to Silence Its Critics (with Tyler Johnston) Gus Docker Tyler Johnston of the Midas Project discusses applying corporate accountability to the AI industry, focusing on OpenAI's actions, including subpoenas, and the need for transparency and public awareness regarding AI risks. Watch Episode Here

Listen to Episode Here

Show Notes

Tyler Johnston is Executive Director of the Midas Project. He joins the podcast to discuss AI transparency and accountability. We explore applying animal rights watchdog tactics to AI companies, the OpenAI Files investigation, and OpenAI's subpoenas against nonprofit critics. Tyler discusses why transparency is crucial when technical safety solutions remain elusive and how public pressure can effectively challenge much larger companies.

LINKS:

CHAPTERS:
(00:00) Episode Preview
(01:06) Introducing the Midas Project
(05:01) Shining a Light on AI
(08:36) Industry Lockdown and Transparency
(13:45) The OpenAI Files
(20:55) Subpoenaed by OpenAI
(29:10) Responding to the Subpoena
(37:41) The Case for Transparency
(44:30) Pricing Risk and Regulation
(52:15) Measuring Transparency and Auditing
(57:50) Hope for the Future


PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no We're Not Ready for AGI (with Will MacAskill) https://podcast.futureoflife.org/we-re-not-ready-for-agi-with-will-macaskill/ William MacAskill discusses his Better Futures essay series, arguing that improving the future's quality deserves equal priority to preventing catastrophe. The conversation explores moral error risks, AI character design, space governance, and ethical reasoning for AI systems. Fri, 14 Nov 2025 14:35:28 +0000 Watch Episode Here

Listen to Episode Here

Show Notes

William MacAskill is a senior research fellow at Forethought. He joins the podcast to discuss his Better Futures essay series. We explore moral error risks, AI character design, space governance, and persistent path dependence. The conversation also covers risk-averse AI systems, moral trade between value systems, an d improving model specifications for ethical reasoning.

LINKS:


CHAPTERS:
(00:00) Episode Preview
(01:03) Improving The Future's Quality
(09:58) Moral Errors and AI Rights
(18:24) AI's Impact on Thinking
(27:17) Utopias and Population Ethics
(36:41) The Danger of Moral Lock-in
(44:38) Deals with Misaligned AI
(57:25) AI and Moral Trade
(01:08:21) Improving AI Ethical Reasoning
(01:16:05) The Risk of Path Dependence
(01:27:41) Avoiding Future Lock-in
(01:36:22) The Urgency of Space Governance
(01:46:19) A Future Research Agenda
(01:57:36) Is Intelligence a Good Bet?


PRODUCED BY:
https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> We're Not Ready for AGI (with Will MacAskill) Gus Docker William MacAskill discusses his Better Futures essay series, arguing that improving the future's quality deserves equal priority to preventing catastrophe. The conversation explores moral error risks, AI character design, space governance, and ethical reasoning for AI systems. Watch Episode Here

Listen to Episode Here

Show Notes

William MacAskill is a senior research fellow at Forethought. He joins the podcast to discuss his Better Futures essay series. We explore moral error risks, AI character design, space governance, and persistent path dependence. The conversation also covers risk-averse AI systems, moral trade between value systems, an d improving model specifications for ethical reasoning.

LINKS:


CHAPTERS:
(00:00) Episode Preview
(01:03) Improving The Future's Quality
(09:58) Moral Errors and AI Rights
(18:24) AI's Impact on Thinking
(27:17) Utopias and Population Ethics
(36:41) The Danger of Moral Lock-in
(44:38) Deals with Misaligned AI
(57:25) AI and Moral Trade
(01:08:21) Improving AI Ethical Reasoning
(01:16:05) The Risk of Path Dependence
(01:27:41) Avoiding Future Lock-in
(01:36:22) The Urgency of Space Governance
(01:46:19) A Future Research Agenda
(01:57:36) Is Intelligence a Good Bet?


PRODUCED BY:
https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

]]> no