Information Theory

A public landing page for our info theory tutorial.

resources

Jim's 2017 information theory course at Marlboro & 2012 conditional entropy notes
Jim's Information Entropy: TLDR talk (slideshow) | zip archive
Jim's channel capacity notes and examples
A Mathematical Theory of Communication, Claude Shannon | wikipedia | 1948 article pdf | 1949 book amazon
Codes: An Introduction to Information Communication and Cryptography, Norman Biggs | amazon
Information Theory, Inference, and Learning Algorithms by David MacKay (online textbook)
Dr Ross' Compression Crypt
Hamming Codes - James Fiedler (8 page pdf)
Jim's graphviz tool - make graph images from text description
Jim's notes on linear algebra with jupyter notebooks