A Mind at Play: How Claude Shannon Invented the Information Age

by Jimmy Soni

The information value of a symbol depends on the number of alternatives that were killed off in its choosing. Symbols from large vocabularies bear more information than symbols from small ones. Information measures freedom of choice.