Why do LLMs output one token at a time?

In this video I start our adventure exploring the world of LLMs! This one is a basic introductory one exploring the idea of autoregression. Karpathy video on tokenizers    • Let's build the GPT Tokenizer   Thank you for watching! Please feel free to leave comments below, I will try to reply :)