Prediction Error
The prediction error measures the quality of a forecast by comparing the predicted value to the actual value.
1. Definition
For a predictor $\hat{X}_{n+h}$ of $X_{n+h}$:
$$e_{n+h} = X_{n+h} - \hat{X}_{n+h}$$2. Mean Squared Error
The MSE is the expected squared prediction error:
$$\text{MSE} = \mathbb{E}[e_{n+h}^2] = \mathbb{E}[(X_{n+h} - \hat{X}_{n+h})^2]$$The best linear predictor $P_n X_{n+h}$ minimizes MSE among all linear predictors.
3. AR(1) Example
For $X_t = \phi X_{t-1} + Z_t$ with $\{Z_t\} \sim \text{WN}(0, \sigma^2)$:
- 1-step ahead: $\text{MSE} = \sigma^2$
- The prediction error $e_{n+1} = Z_{n+1}$, which is uncorrelated with all past observations
4. Common Trap
Only reporting point predictions without uncertainty. Always accompany forecasts with prediction intervals or MSE estimates.