The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of Controversy

The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of Controversy

3.39 of 5 stars 3.39  ·  rating details  ·  241 ratings  ·  74 reviews
Bayes' rule appears to be a straightforward, one-line theorem: by updating our initial beliefs with objective new information, we get a new and improved belief. To its adherents, it is an elegant statement about learning from experience. To its opponents, it is subjectivity run amok.

In the first-ever account of Bayes' rule for general readers, Sharon Bertsch McGrayne explo...more
Hardcover, 336 pages
Published May 17th 2011 by Yale University Press (first published May 14th 2011)
more details... edit details

Friend Reviews

To see what your friends thought of this book, please sign up.
Pattern Recognition and Machine Learning by Christopher M. BishopThe Elements of Statistical Learning by Trevor HastieAll of Statistics by Larry WassermanAn Introduction to Probability Theory and Its Applications by William FellerBayesian Reasoning and Machine Learning by David Barber
Machine Learning
12th out of 16 books — 7 voters
Gödel, Escher, Bach by Douglas R. HofstadterCosmos by Carl SaganFreakonomics by Steven D. LevittChaos by James GleickNapoleon's Buttons by Penny Lecouteur
A Nerd's Guide to Reading
50th out of 54 books — 13 voters


More lists with this book...

Community Reviews

(showing 1-30 of 774)
filter  |  sort: default (?)  |  rating details
rmn
If only I had known how to use Bayesian probabilities before reading this book I could have taken the probability of my liking a book well received in a NY Times Book Review as my prior, plugged that in to a Bayesian calculation as to whether or not I would like this book, and quickly would have come up with the answer "highly unlikely" and saved myself a few hours of my life.

According to the author, Bayes' rule is the greatest mathematical equation/formula/thought process in the history of hist...more
Marks54
The was an interesting popular history of the progress of "Bayes' Rule" from its inception to the present. The rule is about calculating probabilities based on base rates that are updated with subsequent information. The overall history quickly becomes a history of frequency versus Baysian approaches and the tribalism that goes with academic infighting. That is interesting up to a point but seems a bit overdone. Another narrative in the book is how the conditional approaches become more popular...more
Rafael Maia
I wish I had liked this book more than I actually did. Most of the stories reported are very interesting and entertaining, reflecting how academics have been fiercely debating conceptual aspects of Bayes theorem, as well as the bayesian-frequentist feud, while at the same time it was being successfully applied in many crucial issues such as finding stray atomic weapons and linking smoking to lung cancer.

However, I did not find this book well-written at all. It's just not an exciting read - and i...more
Converse

Bayes' Rule is a mathematical formula that allows one to calculate a conditional probability (such as the probability that a woman has breast cancer given that she has a postive mammogram). It has many useful attributes, such as allowing one to updates ones estimates of a probability as you obtain new information, and can be adapted to deal with such basically non-numerical forms of information as expert opinion. One can also use it to estimate the probability of events that have not happened,

...more
Alex Apffel
Mar 28, 2013 Alex Apffel added it
Shelves: science
In The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of Controversy, Sharon Bersch McGrayne takes what might be an otherwise stereotypically dull subject (statistics) and spins a fascinating story across 250 years that touches on Fanatacism, Scientific Breakthroughs, Codebreaking, Academic Feuds and the general idea of how strongly people cling to their beliefs of the "right" way to do things.

Here are...more
Gloria
This is a history of the progress of Bayes' theorem from the early 1700s up to the present. There is essentially no mathematics in the book; it is simply a historical account of the development of Bayes' theorem, with details of the major players in this development and description of how the concept was used in various scenarios in 'the real world' (an aside: how I hate the phrase 'in the real world' , so silly. As if mathematics isn't real. Oh come come). However, having said that, this is a v...more
AJ Armstrong
First, a cachet: unless you are already interested in one or more of Statistics, Decision Theory, Machine Learning, or the history and philosophy of Science and Mathematics, you are probably not a member of this book's audience. However, if you are, you will find a meticulously researched, erudite, and detailed survey of the history of statistics and decision theory. Undergraduate level familiarity with statistics and a generalist understanding of Bayes' rule would be very helpful but not critic...more
Gwern
Light history of Bayesian statistics & related topics. I enjoyed the book a lot; McGrayne has a good eye for the amusing details, and she conveys at least some of the intuition (although some graphs or examples would have helped the reader - I liked the flipping coin illustrations in Dasivia 2006 _Bayesian Data Analysis_). It's also remarkably synoptic: I was repeatedly surprised by names popping up in the chronology, like BUGS, Bretthorst, Fisher's smoking papers, Diaconis, the actuarial us...more
Darrenglass
A friend recently pointed out that the term 'Bayesian' is now entering the common parlance such that the NY Times can use it in an article without explanation. This would come as a huge surprise and disappointment to many statisticians from the early part of the 20th century, when Bayesian was a bad word and the theory was largely refuted. Why would a statistical theory be so upsetting, you might ask...well, McGrayne's book explains why, and gives the history of the theory over time and how it m...more
Jason
Sharon McGrayne is a very good and engaging writer. She has an interesting story to tell about the last 250 years of Bayesian thinking, how the theory has developed, and its many applications including how to price insurance, how to aim artillery, how to break the Enigma code, who wrote The Federalist Papers, how to find Russian nuclear subs, how to estimate the probability of a shuttle disaster, when to do various cancer screenings, whether cigarette smoking is harmful, etc. She also has a grea...more
Terry
The Theory That Would Not Die is a history of Bayes' Theorem and the struggle Bayesianism has been in with frequentism for the two centuries. I found the book enjoyable but there were two shortcomings:

1) The depth to which a particular example was taken was highly variable. Some things were merely mentioned while others were reviewed in great detail. The best chapters explaining the applications of Bayes' Theorem occurred 2/3rds of the way through the book, well after the explanation would have...more
Steve
I came to this book hoping to understand what the heck scientists mean when they say they use a Bayesian approach or Bayesian statistical analysis, but without having to decipher too many formulas or greek letters. However, the book may have erred too much on the side of popular nonfiction; I'm surprised that after reading, I only have a slightly better understanding of Bayes than before.

But I can't exactly fault the author. I doubt there is much market for a popular explanation of Bayesian sta...more
Ken
I liked this book a lot more than I thought I would, particularly given its ratings. This is a non-technical history of the use of Bayesian statistics. The book is so non-technical that no background in statistics is really required at all. The non-technical nature also comes at the cost of a lack of detail. The book only explains WHY Bayesian methods were so poorly thought of for years at a very high level, without enough detail to really understand the underlying issues. In addition, its descr...more
Andy
There is some very important information here but it is buried under a giant pile of whocares?.

By giving us the life of Bayes, the childhood of Laplace , ... , I think the author is trying to force the book to have a narrative, but I doubt that many people buying books about mathematical theories are interested in the minor details of the mathematicians' lives. This type of writing would be bad enough if the importance of Bayesian analysis were clearly explained, but it isn't. For instance, in...more
Romann Weber
Interesting, dry, and disorganized ... often within the same page. McGrayne has produced a well-researched book on a very important topic. However, I believe she does the reader a disservice by shying away from some mathematical notation (and consequently, precision) in her definition of what Bayes's rule really is, especially since it is so easy to prove and would not scare off anyone likely to be reading this book.

The Bayesian controversy starts, of course, with the interpretation of "priors,"...more
Jeff
The basic idea of Bayes' Rule is that you treat probability as a degree of belief (i.e. how much are you willing to bet on something) instead of a relative frequency (i.e. count the number of royal flushes out of all possible poker hands).

Bayes' Rule allows you to "learn" by updating your (prior) degree of belief of something (i.e. probability of finding a sunken ship in a certain part of the ocean) given new information (i.e. a captain's log) in order to obtain knowledge in a "posterior" belie...more
Dan
Covers the history of Bayes' rule but there's little on actual mathematical application. The book was heavy on mathematician drama and light on data-driven aha! moments. If you are interested mainly in History of Mathematics, raise this review to 3.5 stars. But the book's subtitle is misleading: rather than "_how_ Bayes' rule cracked the Enigma code..." it should read "_that_ Bayes' rule cracked the Enigma code..." since there's little "how" to be had. An interesting piece of history, but ultima...more
Michael Quinn
Really just a series of very short biographies on major statisticians and probability theorists since Thomas Bayes. The stuff on Laplace is nice, and the stuff on Turing is very touching. Otherwise, that's about it.

On the whole, the book feels dumbed down. The formula itself only shows up twice in the entire book. While there are lots of stories of its application, more details on the mechanics would have been appreciated. Maybe this is an impossible wish, since the inclusion of any real amount...more
Tom
This was a very interesting read. It seems like common sense that one would use prior experiences to help predict what might happen in an uncertain future situation, but apparently that was a pretty radical notion at one time. At times the self-importance of academia inserts itself into the story, as if anyone really cares if the guy 200 years ago or 150 years ago deserved to have the theory named after him, and the frequentist/Bayesian debate often seems really, really stupid. The examples of a...more
Michael
As someone who actually works with Bayesian methods, I was very much looking forward to reading this book. The strange history of Bayes' Theorem had been briefly mentioned in other, more technical books I had read. I finally wanted to get the whole story.

Alas, that story, at least as presented in this book, turned out to be not quite so exciting. Except for the insights into Laplace's involvement, and in particular the interesting sections on Alan Turing's work, I found this to be a rather lifel...more
Dennis Boccippio
It probably takes a special sort of person to dive into an entire book about one statistical theory, but for those so-motivated, this one pays off.

The pro's: The author has done a phenomenal job at capturing and richly detailing the very "large" personalities that have championed (or condemned) the use of Bayes' Rule through the centuries, amidst a little-known and long-simmering war that has persisted between statistical Bayesians and frequentists since the concept was first brought forward. T...more
David
I think this is the first book about Bayes' theorem and its applications, for the general reader. The book does not explicitly state the theorem as a mathematical formula, until the second appendix. However, the general idea is described, as well the general ideas behind it. The history of the theorem is described in some detail.

The ebb and flow in belief in the theorem over the course of 150 years is interesting. Applying Bayes theorem requires a prior probability, and this is often poorly know...more
Carolyn
A couple of hundred years after Bayes formulated his rule, it was almost universally scorned, despite the fact that it worked: most dramatically, Turing used it to decrypt the Nazi Enigma code machine. The vindication of Bayes was as dramatic and controversial in the world of mathematics as was the vindication of the theory of continental drift in the mid 20th century. Still, there was none of the discussion I wanted to see: how Bayes' rule debunks many of the articles of faith of the promoters...more
Mike
Excellent and very readable book about the history of Bayes' theorem. I never realized that Bayesian statistics, one of the cornerstones of modern data science, had such a turbulent history--so turbulent that, during the cold war, being called a "bayesian" was tantamount to being called a Communist.

If you're at all interested in the history of mathematics, this is a surprisingly exciting story. I expected a rather dull and academic history; that is NOT what this book is.
Caroline
Oct 14, 2012 Caroline rated it 5 of 5 stars  ·  review of another edition Recommends it for: math nerds
Shelves: math, non-fiction
One of the most exciting books I've read in years. I'd can't recommend this book highly enough. It's completely approachable to the layperson, but so incredibly interesting. I was astounded at what Bayes' rule has been used for, and just have to learn more. I've loved seeing how it shows up a little bit in my probability and statistics textbook, but am planning to go buy one or several bayesian specific textbooks to learn more.

My only complaint is that I would have loved more and harder example...more
Richard
The history of Bayes' rule is very interesting and so are some of the applications outlined in this book such as the location of the french airliner that had crashed in the south pacific.
Although i enjoyed reading the historical content of bayes' rule, i feel that the writer did not present the content in a "ingestible" way. i felt as though it was like reading through a school text book and felt more like a chore rather than leisure.
Nigel Davies
I was deeply disappointed by this book. I badly wanted to like it, but I couldn't. I wanted to understand how Bayes theorem had solved the problems described on the cover, but a comprehensible explanation (with a little maths) was missing. Instead the author built up a, to my mind false, conflict between the Bayesians and the Frequentists. And she didn't even trouble to explain what the Frequentists were, when they were first invoked.
JParsons1974 Parsons
Even if you failed math in college this book is good. Basically it's a history one statistical theorem. Put simply by updating intial your belief about something with objective new information , you get a new and improved belief. So simple but so controvrsial. The book is not easy to read in fact I was Googling some of the ideas, persons, places mentioned to understand what was going on but in the end it was worth all the time spent.
David
This is an excellent book if you need to build motivation to learn more about Bayesian methods. It gives you a good qualitative sense of what they're good for.
It's also completely devoid of any information about how they actually work, which is a bit disappointing. However if you're OK with learning that from other sources, and are just interested in an historical overview, it's fine and entertaining science journalism.
Erik
A really interesting review of Bayesian statistics and the battle between Bayesians and frequentists ( the conventional type of statistics you probably learned about in school). While I found the book to be a little lite on describing actual Bayesian techniques, the book was enough to inspire to go pick up a more technical text so I can start using Bayesian techniques in my own life/work.
« previous 1 3 4 5 6 7 8 9 25 26 next »
There are no discussion topics on this book yet. Be the first to start one »
The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of Controversy (Paperback)
The Theory That Would Not Die: How Bayes' Rule Cracked The Enigma Code, Hunted Down Russian Submarines, And Emerged Triumphant From Two Centuries Of Controversy (Kindle Edition)
The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of (ebook)
The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of Controversy (ebook)
The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of Controversy (Audio CD)

Nobel Prize Women in Science: Their Lives, Struggles, and Momentous Discoveries Prometheans in the Lab: Chemistry and the Making of the Modern World 365 Surprising Scientific Facts, Breakthroughs, and Discoveries Die Theorie, Die Nicht Sterben Wollte: Wie Der Englische Pastor Thomas Bayes Eine Regel Entdeckte, Die Nach 150 Jahren Voller Kontroversen Heute Aus Wissenschaft, Technik Und Gesellschaft Nicht Mehr Wegzudenken Ist Geoscience Data and Collections: National Resources in Peril

Share This Book

Your website