Three signals that overlap
Three standardised signals each have correlation with a target, and every pair of signals has correlation .
Find the population of the least-squares regression of the target on all three signals.
Fractions, decimals with at least 3 significant digits, and expressions such as sqrt(2)/2, e^-1 or pi/4.
By symmetry the three coefficients are equal. Write the normal equations for one of them.
For standardised variables, .
h
s Shown after a correct answer. Revealing it first marks the problem as seen, not solved.
Idea. The setting is symmetric, so all three signals get the same weight . One normal equation gives , and then follows.
Step 1: the coefficient. The normal equation for the first signal reads , so and .
Step 2: .
Compare. If the three signals were uncorrelated, the would be . Because they overlap, they carry much of the same information, and the joint is only half of that.
In general. With signals, each correlated with the target and with each other, which tends to as grows: adding more of the same kind of signal hits a ceiling.