From Eternity to Here

by Sean Carroll

His final result is this: The “self-information” contained in a message is equal to minus the logarithm of the probability that the message would take that particular form.