Entropy: The Mathematics Behind Uncertainty, Possibility, and Complexity

An introduction to entropy from statistical mechanics to information theory and algorithmic complexity. We derive Boltzmann and Shannon entropy from counting and probability, then connect entropy to uncertainty, information, compression, distinguishability, and Kolmogorov complexity.