I’m giving a talk at the Tutorial on Categorical Semantics of Entropy on May 11th. You can watch it live on Zoom or recorded later. Here’s the idea:
Shannon entropy is a powerful concept. But what properties single out Shannon entropy as special? Instead of focusing on the entropy of a probability measure on a finite set, it can help to focus on the “information loss”, or change in entropy, associated with a measure-preserving function. Shannon entropy then gives the only concept of inf...
Published on April 21, 2022 20:20