Autonomous Agents Will Make Irreversible Decisions. Are We Ready? | Dr. Doran Avital

Autonomous agents are no longer a thought experiment. They're already purchasing, emailing, and acting with real-world consequences, and cyber defense systems are being built that can detect an attack and launch a counterstrike without a human in the loop. In this episode of Carver Conversations, Dr. Doran Avital, soldier, philosopher, politician, entrepreneur, and founder of PolygonEyes, joins us to unpack how decisions get made under real uncertainty, and why the rule-based approach most AI governance takes today is fundamentally broken. Timestamps: 00:00 Why autonomous agents change the stakes of every decision 03:18 Introducing Dr. Avital and the four threads of decision-making 04:34 Wittgenstein vs. logical positivism, and why it matters for AI rules today 07:07 Napoleon, the "decision landscape," and why generals don't think like shoppers 10:59 The polygon: decision-making as a geometry of trade-offs, not a rulebook 14:22 The empty gas tank dilemma: hidden reserves and game theory 16:51 Local optimization and why agents chasing narrow goals undermine the bigger picture 18:17 Goodhart's Law, Adam Smith, and the 2008 crash 22:52 Simulation, the "fixed star," and preparing for the moment of truth 24:02 The Karpathy car-wash example: local optimization in the wild 25:13 How militaries and elite athletes train for the "moment of truth" 28:37 Federer's stat: losing more points than he wins, and still winning the match 30:45 Maps vs. rules, and the Kurt Gödel citizenship story 34:56 Courage, integrity, and character in high-stakes decision-making 36:46 The Toyota recall and forgetting who you are 37:23 Usain Bolt and why representation matters 41:07 Closing thoughts: no singularity, no end of scarcity, just the work Dr. Avital holds a PhD in Logic and Philosophy from Columbia University, where he later taught, and is the author of Logic in Action. More about Dr. Avital https://en.wikipedia.org/wiki/Doron_A... https://philpeople.org/profiles/doron... https://columbia.academia.edu/DoronAv...   / doronavital   https://x.com/da64 Logic in Action (Book) https://www.slideshare.net/slideshow/... More about PolygonEyes https://polygoneyes.com/ Collaborators Synergia Foundation    / @synergiafoundation   https://synergiafoundation.org/ More about Dr. Pingali   / pingali   More about Carver Agents https://carveragents.ai Subscribe for more conversations at the intersection of AI, regulation, and geopolitics. #AutonomousAgents #AIGovernance #Wittgenstein #DecisionMaking #PolygonAI