New posts in Information Theory

(practical) Codes from sphere packings

Alternate definition of Entropy

Prove that entropy for distribution decreases under certain operation

is Shannons "A mathematical theory of communication" worth reading for a beginner in information theory?

Entropy Lower Bound in Terms of $\ell_2$ norm

How to calculate mutual information

Confused by Kullback-Leibler on conditional probability distributions

Pattern Recognition and Machine Learning (Bishop) - Exercise 1.28

Suppose $X \sim Bin(n,p)$ and $Y \sim Bin(n,1-p)$, how is $X+Y$ distributed?

Is there a way to find the log of very large numbers?