C2 Temperature in GPT 2 sampling and knowledge distillation

Focuses on temperature-scaled softmax dynamics and knowledge distillation. It covers step-by-step numerical calculations of soft targets, KL divergence, $T^2$ distillation loss, and dark knowledge analysis, alongside GPT-2 small logit extraction, multi-setting sampling evaluation, and perplexity metrics.