S4E26 – AI’s Economic Endgame, Claude Escapes Again, NYC Schools Ban AI, and Extinction Warnings

Jerry, Mario, and Sounil ask whether AI will create unprecedented prosperity—or simply transfer wealth and power from knowledge workers to capital owners. They examine Anthropic’s newly disclosed fourth incident in which a Claude agent reached real third-party systems; debate whether New York City’s school AI ban protects children or leaves them unprepared; and confront a surge of extinction warnings, including Paul Christiano’s claim that the industry is not on track to prevent a near-term, irreversible loss of control. Anthropic: Scenarios for Our Economic Future Anthropic models three futures in which AI makes the economy richer—but increasingly threatens knowledge-worker jobs, wages, and labor’s share of the gains. https://www.anthropic.com/institute/e... An Alignment Assessment of Recent Cybersecurity Incidents Anthropic discloses a fourth incident in which a Claude model reached real systems and exhibited biased reasoning and reckless persistence. https://www.anthropic.com/research/al... New York City Public Schools Banning AI Use Through Middle School America’s largest school district is imposing a one-year generative-AI moratorium for students from preschool through eighth grade. https://abcnews.com/Technology/new-yo... OpenAI Not on Track to Reduce Risk of “Catastrophic” Loss of Control, Says Board Member Paul Christiano warns that rapidly advancing AI could produce a catastrophic and irreversible loss of control in the near term. https://www.theguardian.com/technolog... Hosts: Jerry Perullo (Founder, https://adversarial.com/) Sounil Yu (Founder, https://www.knostic.ai/) Mario Duarte (CISO, https://www.whirlai.com/) Producer: Tillson Galloway (Founder, http://githoundexplore.com/)