Probability and Information: An Integrated Approach

by David Applebaum

This elementary introduction to probability theory and information theory provides a clear and systematic foundation to the subject; the author pays particular attention to the concept of probability via a highly simplified discussion of measures on Boolean algebras. He then applies the theoretical ideas to practical areas such as statistical inference, random walks, statistical mechanics, and communications modeling. Applebaum deals with topics including discrete and continuous random variables, entropy and mutual information, maximum entropy methods, the central limit theorem, and the coding and transmission of information. The author includes many examples and exercises that illustrate how the theory can be applied, e.g. to information technology. Solutions are available by email. This book is suitable as a textbook for beginning students in mathematics, statistics, or computer science who have some knowledge of basic calculus.

Genres: Mathematics

227 pages, Paperback

First published July 13, 1996

Reviews

[Nati S · Rating 4 out of 5]

I decided to read this book to compliment a course I took on Information Theory and Statistics. This book does a good job introducing abstract concepts in Information Theory in a simple and understandable way. I especially liked that every chapter begins with sections which explain new concepts in a way that is easy to intuit.

[Cica · Rating 4 out of 5]

I really like it because it gives clear intuition to the concepts. Great book for an introduction although the formal mathematics definitions are not maintained.