Why Evolution Beats Raw AI at a 1980s Coding Game | Akarsh Kumar
Machine Learning Street Talk
0:00 / 0:00
Why Evolution Beats Raw AI at a 1980s Coding Game | Akarsh Kumar
10 360 просмотров · 1 дн. назад
Machine Learning Street Talk
220 тыс. подписчиков
10 360 просмотров · 1 дн. назад
A lot of people in AI treat evolution as a dumb fallback, basically random search for when you can't take a gradient. Akarsh Kumar thinks that is wrong. Selection hangs on to partial solutions, so mutations only need to be useful about 1% of the time for the search to keep making progress.
Akarsh is a PhD student at MIT working with Phillip Isola, works with Sakana AI, and is first author of the Fractured Entangled Representation paper with Kenneth Stanley, Jeff Clune and Joel Lehman. He tells Tim Scarfe why the path a learner takes may shape the structure of what it learns, and why that is a different way of looking at intelligence from the statistical one.
Most of the conversation is about ASAL, the method he led for searching whole spaces of artificial worlds. Rather than predict what a rule will do, ASAL runs the simulation and asks a foundation model what happened. Mapped across all 262,144 Life-like rules, the most interesting worlds sit on one small island. Along the way: Game of Life, Lenia (with a clip from its creator, Bert Chan), neural cellular automata, Boids, Particle Life and the emergence of persistence.
The last stretch is Core War, a programming game from the 1980s. Asked cold, LLMs write poor Redcode. Used as the mutation step in an evolutionary loop with a verifier, they produced warriors that, between them, beat or tied 96% of 294 human-written ones. Over repeated rounds the warriors trended towards generalists.
---
TIMESTAMPS:
00:00:00 Intro: artificial life, ASAL and Core War in four minutes
00:04:19 Life as it could be, not just as it is
00:05:46 Why the order you learn things in matters
00:08:33 No shortcuts: Wolfram, novelty search and regularisation
00:10:44 Kenneth Stanley: the path matters, not just the destination
00:11:31 Statistical intelligence vs regularity-based intelligence
00:13:49 Artificial chemistry and other possible universes
00:15:59 Convergent patterns: shadows of the substrate?
00:18:02 How Conway's Game of Life works
00:20:49 Change one cell, change everything?
00:22:31 Lenia (with Bert Chan) and neural cellular automata
00:25:26 Boids, Particle Life and cell-like creatures
00:28:47 Persistence, entropy and what life is
00:30:15 ASAL: a foundation model as the critic
00:34:04 Impostors inside the simulation
00:36:50 From primordial soup to alien animals
00:38:26 262,144 rules and the island of open-endedness
00:40:17 From artificial life to AGI
00:41:35 Core War: Game of Thrones, Turing edition
00:43:22 LLMs as the mutation step: evolving warriors
00:46:03 Evolution is anything but random
---
REFERENCES:
paper:
[00:04:19] ASAL: Automating the Search for Artificial Life with Foundation Models (Kumar et al.)
https://arxiv.org/abs/2412.17799
[00:08:08] Assembly theory (Sharma et al., Nature 2023)
https://www.nature.com/articles/s4158...
[00:09:54] The Fractured Entangled Representation Hypothesis (Kumar, Clune, Lehman, Stanley)
https://arxiv.org/abs/2505.11581
[00:22:38] Lenia: Biology of Artificial Life (Bert Chan)
https://arxiv.org/abs/1812.05433
[00:23:20] Growing Neural Cellular Automata (Mordvintsev et al.)
https://distill.pub/2020/growing-ca/
[00:39:49] CLIP (Radford et al.)
https://arxiv.org/abs/2103.00020
[00:41:35] Digital Red Queen: Core War with LLMs (Kumar et al.)
https://arxiv.org/abs/2601.03335
[00:43:42] MAP-Elites (Mouret and Clune)
https://arxiv.org/abs/1504.04909
[00:44:55] AlphaEvolve (Google DeepMind)
https://arxiv.org/abs/2506.13131
[00:47:03] AutoML-Zero (Real et al.)
https://arxiv.org/abs/2003.03384
book:
[00:07:04] Why Greatness Cannot Be Planned (Stanley and Lehman)
https://link.springer.com/book/10.100...
tool:
[00:18:12] Conway's Game of Life
https://en.wikipedia.org/wiki/Conway%...
[00:25:27] Boids (Craig Reynolds)
https://www.red3d.com/cwr/boids/
[00:27:12] Particle Life (Tom Mohr)
https://github.com/tom-mohr/particle-...
[00:41:50] Core War
https://corewar.co.uk/
other:
[00:08:49] Computational irreducibility (Stephen Wolfram)
https://www.wolframscience.com/nks/p7...
[00:10:46] MLST: Why Every AI Model Is an Impostor (Kenneth Stanley, FER documentary)
• Why Every AI Model Is an Impostor — Kennet...
[00:28:30] MLST: Blaise Agüera y Arcas on life emerging from code
• Google Researcher Shows Life "Emerges From...
[00:33:35] Goodhart's law
https://en.wikipedia.org/wiki/Goodhar...
---
LINKS:
Akarsh Kumar: https://akarshkumar.com/
ASAL project page and demos: https://pub.sakana.ai/asal/
Digital Red Queen project page: https://sakana.ai/drq/
RESCRIPT:
https://app.rescript.info/public/shar...