Fruit Fly Brain Learns to play Resident Evil 2 DAY 5

An AI is learning to play the ORIGINAL 1998 Resident Evil 2, live, from scratch. Every attempt starts again from the save, and failing is how it learns. 🎯 CURRENT MISSION Get the Unicorn Medal and carry it back to the main hall, then keep going: use the medal on the hall statue for the Spade Key, get the Square Crank, solve the statue puzzle for the second Red Jewel, grab the fireplace Red Jewel, push through the Lounge, solve the Library bookshelf puzzle for the Bishop Plug, drop the 2F emergency ladder, and fight/sprint through the burning corridors all the way out to the HELIPAD! 🧠 THE BRAIN It's a small neural network "wired like a fly brain". It uses a piece of a real fruit-fly connectome (about 4,000 neurons and 110,000 connections from Janelia FlyEM) as its internal wiring, learning via reinforcement learning (DQN). It has 5 sensory "whiskers" (virtual LIDAR) that feel the distance to nearby walls and obstacles. It is NOT an uploaded fly, and we don't yet know if the fly wiring helps, so this is an ongoing experiment. 🍪 HOW IT LEARNS The reward is "cookies": • progress toward the next door • new ground explored • zombie damage and kills • each door it gets through • personal-best stage times (faster = bonus cookies) It LOSES cookies for taking damage, wasting time, missing shots, and running into walls. If health drops below 70 the attempt ends with a huge penalty, and it reloads the save and tries again. During cutscenes, combat rewards are paused so scripted sequences can't hand out false jackpots. ⏱️ THE RULES • A time limit per stage (resets at each new room) • Restart if health drops below 70 (entering danger) • The live overlay shows the attempt number, health bar, stage timer, cookies, tactical radar minimap, and best room times 🤝 THE ASSISTS (full disclosure) It's an AI learning, but it is helped: • Infinite Magnum ammo, set up in the save file • A "radar" for the nearest live enemy in the room: direction, distance, height, and whether it's crawling • 5-ray sensory whiskers detecting wall clearance in front and to the sides • Line-of-sight check so it won't waste shots through solid walls • A map of doors and rooms, and hand-taught routines for trickier multi-step puzzles It can't see through walls or see into other rooms. Everything it perceives is strictly for the room it is currently standing in. 🎮 HOW IT PLAYS It reads the game's memory (read-only) and sends gamepad inputs through a virtual controller. 💬 LEON'S LINES The subtitles at the bottom are hand-written jokes and story lines, not AI-generated. 📚 CREDITS Fly connectome data: MaleCNS v1.0, Janelia FlyEM, CC BY 4.0 (https://www.janelia.org/project-team/.... Learning: Stable-Baselines3. Built with help from Claude (Anthropic). Resident Evil is © Capcom. This channel is not affiliated with Capcom. Gameplay is streamed under Capcom's video policy. 🔞 Mature content: horror game with zombies and gore. #ResidentEvil2 #AI #MachineLearning #ReinforcementLearning #Resi2 #LiveStream