The average likelihood, Pr(w), can be confusing. It is commonly called the “evidence” or the “probability of the data,” neither of which is a transparent name. The probability Pr(w) is merely the average likelihood of the data. Averaged over what? Averaged over the prior. It’s job is to standardize the posterior, to ensure it sums (integrates) to one. In mathematical form:
