Information Theory


The Information: A History, a Theory, a Flood
Elements of Information Theory
The Mathematical Theory of Communication
An Introduction to Information Theory: Symbols, Signals and Noise (Dover Books on Mathematics)
A Mind at Play: How Claude Shannon Invented the Information Age
Information Theory, Inference, and Learning Algorithms
Information Theory: A Tutorial Introduction
Information Theory (Dover Books on Mathematics)
Why Information Grows: The Evolution of Order, from Atoms to Economies
Nexus: A Brief History of Information Networks from the Stone Age to AI
Information: The New Language of Science
Mathematical Foundations of Information Theory (Dover Books on Mathematics)
Cybernetics: or the Control and Communication in the Animal and the Machine
Chaos: Making a New Science
Decoding the Universe: How the New Science of Information Is Explaining Everything in the Cosmos, from Our Brains to Black Holes
Representation is a process of informational triangulation. Its aim is the specification of distal stimuli. It achieves that aim by corralling the output of multiple information channels integrated at their point of confluence. The integration process, in short, disambiguates individual information channels via the mutual constraints each channel provides others. The specificity won thereby falls on a continuum from the highly unspecific (simple transducers, little integrative depth) to the high ...more
Dan Lloyd, Simple Minds

Richard Hamming
When you are famous it is hard to work on small problems. This is what did Shannon in. After information theory, what do you do for an encore? The great scientists often make this error. They fail to continue to plant the little acorns from which the mighty oak trees grow. They try to get the big thing right off. And that isn't the way things go. So that is another reason why you find that when you get early recognition it seems to sterilize you. ...more
Richard Hamming

More quotes...
Underground Knowledge — A discussion group This global discussion group has been designed to encourage debates about important and underrep…more
25,183 members, last active 5 hours ago