Information in sixteen waiting times
are independent exponential random variables with rate , with density for .
Find the Fisher information about contained in the whole sample, when .
Fractions, decimals with at least 3 significant digits, and expressions such as sqrt(2)/2, e^-1 or pi/4.
For one observation, compute the second derivative of with respect to .
Fisher information adds up over independent observations.
h
s Shown after a correct answer. Revealing it first marks the problem as seen, not solved.
Idea. Fisher information is minus the expected second derivative of the log-density. For the exponential distribution that second derivative does not even depend on .
Step 1: one observation. . Then So one observation carries information .
Step 2: the sample. For independent observations the information adds:
What it means. By the Cramér-Rao bound, no unbiased estimator of from these 16 observations has variance below . The maximum likelihood estimator is biased; the unbiased version has variance , a little above the bound.