AI Said Everything Was on Fire | Prompt to Prod - with Pablo Vidal

Prompt to Prod: when Pablo's team first pointed an AI analyst at their Okta logs, it treated a Monday holiday like an incident. Everything was on fire. Pablo and Aaron get into what it really takes to build with AI as a security engineer: giving models context, making sure your team can own what you build, and putting humans only where the risk demands it. We cover why everyone can build now and what guardrails that requires, which data you should never send to a model, build vs. buy and why you shouldn't build in a cave, what to do when AI generates 5,000 PRs a day, risk-classifying PRs so humans review only what matters, alert fatigue and the holiday-calendar fix, baselining and timelines in detection, cost and cheaper models as token prices catch up, why he isn't more worried about the AI threat wave, and why AI is still bad at writing. TIMESTAMPS 0:00 Cold Open 0:42 Welcome and meet Pablo 1:11 Pablo's background: from Cisco certs to AI security 2:35 How much of his day is AI 4:31 Enablement: everyone can build now 7:54 Guardrails, not gatekeeping 10:03 Sending sensitive data to models 15:17 Build vs. buy: don't build in a cave 19:12 Velocity vs. quality vs. security 22:57 Guardrails agents can read: risk-classifying PRs 26:46 Alert fatigue: how much can AI handle 28:20 Give AI context: the holiday-calendar false alarms 30:59 Baselining, timelines, and non-deterministic AI 36:05 Cost, local models, and deterministic scripts 41:02 The AI threat wave 45:22 What AI is bad at: writing 49:23 What Pablo is building next 50:59 Community and where to find Pablo ABOUT PABLO Pablo has spent about 11 years in security. He started with Cisco certifications, moved into security generalist work and cloud security on AWS, worked on cloud security and security operations at Rippling, then spent a year at Grow Therapy in an individual-contributor role where he went deep on AI. He recently joined Life360 as a senior staff engineer focused on AI security. ABOUT PROMPT TO PROD Prompt to Prod is a podcast about building with AI, hosted by Aaron Mog. Each episode, practitioners from security and engineering share what they're actually building, what breaks on the way to production, and what they'd do differently. #PromptToProd #AISecurity #BuildingWithAI #SecurityEngineering #DetectionEngineering #ClaudeCode #AIAgents