Перейти к содержимому

Robots That Predict the Future: Dyna-2 & Physical AI — Jason Ma, Dyna Robotics

Latent Space

0:00 / 0:00

Robots That Predict the Future: Dyna-2 & Physical AI — Jason Ma, Dyna Robotics

2 733 просмотра · 9 часов назад
Latent Space
308 тыс. подписчиков
2 733 просмотра · 9 часов назад
From training a world-action model on over one million hours of human video to deploying robots that fold thousands of napkins daily at Din Tai Fung, Dyna Robotics is pushing physical AI beyond impressive demos and into real-world production. In this episode, Dyna Robotics co-founder and Chief Scientist Jason Ma joins swyx on-site to unpack how robots can learn new tasks from as little as 45 minutes of demonstrations, why predicting the future of the physical world may be the key to general-purpose robotics, and what it actually takes to build robots that work reliably for real customers. We go deep on Dyna-2, Dyna's million-hour world-action model that combines future video prediction with robot actions, the scaling laws behind human-to-robot transfer, diffusion transformers and flow matching, and why synthetic environments and self-generated training data could unlock the next wave of robotics progress. Jason also explains why Dyna builds its own hardware instead of relying on off-the-shelf humanoids, how agentic harnesses enable robots to execute hour-long workflows, why dexterous hands and missing sensory data remain major bottlenecks, and what separates real commercial deployments from the graveyard of robotics startups. We also cover world-action models versus vision-language-action models, GPT-6 and coding agents in robotics, and Jason's journey from AlphaGo and Penn to NVIDIA, Google DeepMind, and founding Dyna. We discuss: Why Dyna-2 was trained on over one million hours of human video World-action models: predicting future video to guide physical robot actions Diffusion transformers, flow matching, and real-time robotic control How robots learn new tasks with as little as 45 minutes of demonstrations Why robotics has no equivalent of the internet and data remains its biggest scaling challenge Human egocentric video, robot demonstrations, and cross-embodiment transfer Synthetic environments, simulation, and models that generate their own training data Why robots need on-device inference, model distillation, and custom hardware Why Dyna chose wheeled semi-humanoids instead of traditional bipedal robots The hardware bottleneck: why dexterous robot hands still overheat Best Western, Din Tai Fung, and the difference between robotics pilots and scaled deployments The Bitter Lesson of Robotics: scaling data instead of engineering specialized solutions Agentic harnesses and robots executing multi-step, hour-long physical workflows GPT-6, coding agents, and AI-generated simulation environments for robotics research World-action models versus VLAs, and why vision alone may not be enough Jason's journey through AlphaGo, Penn, NVIDIA, Google DeepMind, and the Eureka project Dyna's research culture, deployment-first philosophy, and vision for millions of robots --- Sponsorship and business inquiries: business@latent.space --- Jason Ma LinkedIn:   / jason-ma-742224a2   X: https://x.com/JasonMa2020 Dyna Robotics Website: https://www.dyna.co/ X: https://x.com/DynaRobotics Timestamps 00:00:00 Hook 00:01:56 Introduction and Dyna-2's World-Action Model 00:05:04 Diffusion Transformers, Flow Matching, and Generalist Robots 00:10:15 The Robotics Data Bottleneck 00:15:46 Synthetic Data and Self-Improving World Models 00:18:47 Real-Time Inference and Model Distillation 00:21:41 Full-Stack Robotics: Hardware and Supply Chains 00:26:58 Why Dyna Built a Wheeled Semi-Humanoid 00:31:31 Teaching Robots New Tasks and Evaluating Performance 00:33:55 Autonomous Workflows and Hardware Limitations 00:38:02 Real-World Deployments at Best Western and Din Tai Fung 00:43:03 The Bitter Lesson of Robotics 00:48:09 Agentic Harnesses for Physical AI 00:51:03 GPT-6, Coding Agents, and AI-Native Robotics 00:53:58 World-Action Models vs. VLAs 01:01:13 From AlphaGo to Founding Dyna Robotics 01:06:16 Dyna's Research Culture and the Future of Robotics