Перейти к содержимому

How Does AI Turn Words Into Images?

Matter Made Clear

0:00 / 0:00

How Does AI Turn Words Into Images?

3 просмотра · 1 день назад
Matter Made Clear
25 подписчиков
3 просмотра · 1 день назад
How can a sentence become a picture that nobody photographed? Follow text-conditioned diffusion from training examples with added noise to numerical language conditioning, sampling, latent representations and decoding. Then test the difference between a convincing picture and a correct one. This explains one influential family of image-generation methods. It does not claim every current image generator uses the same architecture. Our teapot, feature arrays, noise transitions and trajectories are original teaching animations, not recordings of an AI model run or benchmark results. Some diffusion systems can memorize training examples; learned generation is not a guarantee against reproduction. What surprised you most: starting with noise, encoding the words, or how a polished image can still miss the request? Tell us below. CHAPTERS 00:00 A picture that was never photographed 01:08 Learning by adding the problem 02:18 How the words enter the picture 03:31 Generating means choosing a new path 04:44 The smaller space behind the pixels 05:52 Why the same prompt changes its answer 07:03 Why beautiful pictures can still be wrong 08:16 What you should see behind the magic PRIMARY RESEARCH https://arxiv.org/abs/2006.11239 https://arxiv.org/abs/2010.02502 https://arxiv.org/abs/2112.10752 https://arxiv.org/abs/2205.11487 https://arxiv.org/abs/2207.12598 https://arxiv.org/abs/2301.13188 https://arxiv.org/abs/2307.06350 MOVING FOOTAGE & CREDITS ALL IZ Well https://www.pexels.com/video/database... Dimitar Dimitrov https://www.pexels.com/video/a-person... Jakub Zerdzicki https://www.pexels.com/video/tech-wor... Tima Miroshnichenko / Pexels https://www.pexels.com/video/woman-do... ArtHouse Studio / Pexels https://www.pexels.com/video/a-photog... Pexels license: https://www.pexels.com/license/ Commercial use: https://help.pexels.com/hc/en-us/arti... Edited/cropped/retimed excerpts; original source audio excluded. Generic image-making and computing illustrations, not named AI-provider facilities, demonstrations or endorsements. People shown are not associated with a model failure. Original Blender teapot/cube and feature-array animations, diagrams, noise transitions and motion graphics: Matter Made Clear. Numerical arrays, particle paths, timing and sample stages are schematic. No commercial AI image API was used to produce these demonstrations. AI narration: Michael / Kokoro-82M am_michael, US English, generated locally. Original script, Blender, Python and FFmpeg. Only free tools and licensed free material. #AI #Technology #Science