New posts in Information Theory

Substitute for triangle inequality for Kullback-Leibler divergence

Is log the only choice for measuring information?

Expected Entropy Based on Dirichlet Distribution

Preserving mutual information after compressing states

Proof of nonnegativity of KL divergence using Jensen's inequality

Estimating entropy from a set of measurements

higher moments of entropy... does the variance of $ \log x $ have any operational meaning?

Origin of the notation for statistical divergence

How is logistic loss and cross-entropy related?

Is Standard Deviation the same as Entropy?