68 books
—
40 voters

Goodreads helps you keep track of books you want to read.

Start by marking “Information Theory, Inference and Learning Algorithms” as Want to Read:

# Information Theory, Inference and Learning Algorithms

by

Information theory and inference, often taught separately, are here united in one entertaining textbook. These topics lie at the heart of many exciting areas of contemporary science and engineering - communication, signal processing, data mining, machine learning, pattern recognition, computational neuroscience, bioinformatics, and cryptography. This textbook introduces th
...more

Hardcover, 640 pages

Published
October 6th 2003
by Cambridge University Press
(first published June 15th 2002)

## Friend Reviews

To see what your friends thought of this book,
please sign up.

## Reader Q&A

To ask other readers questions about
Information Theory, Inference and Learning Algorithms,
please sign up.

Be the first to ask a question about Information Theory, Inference and Learning Algorithms

## Community Reviews

Showing 1-30

Start your review of Information Theory, Inference and Learning Algorithms

This book was my first in depth exposure to information theory and the proofs, often accompanied by helpful figures, were clear and, hell, even exciting. Its a much easier read than Cover & ...more

I shall add this to my "reference" collection, for I find myself returning ...more

The (>400) problems are interesting, the writing clever and motivational.

...more

May 22, 2014
J C
is currently reading it

While deliberating buying the book, I came across many reviews giving the impression that this was an upper-tier book meant only for those already well-versed in bayesian inference, information theory, and machine learning. Fortunately for me (having purchased it for ~50$), I have been gliding along at quite an easy pace. Already I've learnt about hamming codes and the formulas & axioms (interestingly formulated!) of bayesian probability theory. The treatment probably isn't the most sophisticate
...more

**Run-on Sentence Summary**

A fresh and entertaining textbook that walks through the fundamentals of information theory and machine learning.

**Impressions**

Mackay’s prose is fast paced but lucid, and perfect for a self learner. Often when reading CS textbooks, I’ll skim over problems because I can’t be bothered to spin up whatever boilerplate they want me to download off of the website, but this book did a great job of highlig ...more

Recommended to Nick by:
Michael Mitzenmacher (Harvard CS)

Shelves:
she-blinded-me-with-science,
to-acquire

There are no discussion topics on this book yet.
Be the first to start one »

## Goodreads is hiring!

David MacKay was a Professor in the Department of Physics at the University of Cambridge. He studied Natural Sciences at Cambridge and then obtained his PhD in Computation and Neural Systems at the California Institute of Technology. He returned to Cambridge as a Royal Society research fellow at Darwin College. He was internationally known for his research in machine learning, information theory,
...more

## News & Interviews

Need another excuse to treat yourself to a new book this week? We've got you covered with the buzziest new releases of the day.
To create our...

6 likes · 6 comments

No trivia or quizzes yet. Add some now »