Перейти к содержимому

How ChatGPT Actually Works (Explained Simply)

Behind the Ordinary

0:00 / 0:00

How ChatGPT Actually Works (Explained Simply)

210 просмотров · 9 дн. назад
Behind the Ordinary
9 подписчиков
210 просмотров · 9 дн. назад
How does ChatGPT actually work? It writes one small piece at a time, guessing what comes next. Here's the whole machine, explained simply, with no maths. A chatbot like ChatGPT has one job: predict the next piece of text. Your words are chopped into tokens, placed on a giant map of meaning, and connected with "attention" so the model knows which bank you mean. Stacked layers refine the guess, and a weighted raffle (temperature) picks the next word. Training sets billions of knobs (parameters) by hiding the next word in trillions of sentences and nudging every knob at once towards the right answer. A second round of training with human feedback turns a text predictor into an assistant, and newer "reasoning" models are trained by checking whether their final answers are right. We also cover why chatbots make things up with total confidence, and why even their makers can't fully explain how they work. #chatgpt #ai #llm #machinelearning #explained