Two signals, one R²
Two signals and are uncorrelated with each other. Their correlations with a target are and .
What is the of the population least-squares regression of on both signals (with an intercept)?
Fractions, decimals with at least 3 significant digits, and expressions such as sqrt(2)/2, e^-1 or pi/4.
Standardise all three variables; does not change. With uncorrelated standardised regressors, what are the regression coefficients?
, where is the fitted value.
h
s Shown after a correct answer. Revealing it first marks the problem as seen, not solved.
Idea. When the regressors are uncorrelated, the multiple regression splits into separate simple regressions, and the explained variances simply add.
Step 1: standardise. Rescaling variables does not change , so assume , and have mean and variance . Then with , .
Step 2: coefficients. The normal equations are , where is the covariance matrix of the signals and their covariances with . Here , so .
Step 3: explained variance. so .
What changes with correlated signals. In general . If the two signals were positively correlated, part of what they explain would overlap and would be below . This is why a new signal is worth more when it is uncorrelated with the ones you already have.