AI Used 17,600 Events. APTs Use 50. | Prompt to Prod - with Justin Tiplitsky

Prompt to Prod: an AI agent completed its goal in 17,600 events. The average advanced attacker, by Justin Tiplitsky's count, uses about 50. Justin, director of red team at Adobe, joins Aaron to talk about where AI actually helps a red team, where it's still loud and sloppy, and why handmade tradecraft is what will make AI useful on offense. We cover what changed when models started keeping context, why Justin doesn't let AI touch his code directly, how AI lowers the bar for zero days, using AI on huge recon datasets, turning red team output into detections defenders can use, the difference between AI red teaming and red teaming with AI, why you can give AI knowledge but not wisdom, and his advice for the next generation of red teamers. TIMESTAMPS 0:00 Cold Open 0:33 Welcome and meet Justin 2:01 How a red team leader feels about AI right now 3:43 What changed: models that keep context 6:13 Don't AI yourself into a corner: handmade tradecraft 8:52 AI lowers the bar for zero days 14:06 When to use AI on a red team 16:30 Recon and large datasets 19:19 Turning red team output into better detections 22:19 Are AI red team products any good? 25:05 AI red teaming vs. red teaming with AI 30:41 What Justin wants to build next 34:51 Knowledge vs. wisdom 38:41 Advice for the next generation of red teamers 42:00 Where to find Justin ABOUT JUSTIN Justin Tiplitsky is director of red team at Adobe, where he built the company's current red team. He previously worked on red teams at Microsoft and Intuit, and writes about strategic red teaming at http://redteambrief.com. ABOUT PROMPT TO PROD Prompt to Prod is a podcast about building with AI, hosted by Aaron Mog. Each episode, practitioners from security and engineering share what they're actually building, what breaks on the way to production, and what they'd do differently. #PromptToProd #RedTeam #AISecurity #OffensiveSecurity #Cybersecurity #BuildingWithAI #AIAgents