Seven heads and a flat prior
A coin lands heads with an unknown probability . Before any toss, is uniformly distributed on . The coin is tossed 10 times and shows 7 heads and 3 tails.
Find the probability that the 11th toss is heads.
Fractions, decimals with at least 3 significant digits, and expressions such as sqrt(2)/2, e^-1 or pi/4.
By Bayes' rule, the posterior density of is proportional to the prior times the likelihood, .
The probability that the next toss is heads is the posterior mean of . You may use .
h
s Shown after a correct answer. Revealing it first marks the problem as seen, not solved.
Idea. Average the chance of heads over what we now believe about . That average is the mean of the posterior distribution, which here is a Beta distribution.
Step 1: the posterior. The prior density is 1 on and the likelihood of 7 heads and 3 tails is proportional to . So the posterior density is the Beta(8, 4) distribution.
Step 2: the next toss. Given , the next toss is heads with probability , so With the formula in the hint,
The rule of succession. After heads in tosses with a uniform prior, the next toss is heads with probability It is as if you had seen one extra head and one extra tail before starting. Here , a little below the observed frequency : the prior pulls the estimate towards , and the pull fades as grows.
The trap. Answering , the maximum likelihood estimate. It ignores the prior and the uncertainty about .