From Eternity to Here

by Sean Carroll

Roughly speaking, then, the information content of a message goes up as the probability of a given message taking that form goes down.