What Is Residual Analysis?
You’ve searched for it – here’s the answer to the question: “What exactly is residual analysis?”
Residual analysis is a statistical method used to evaluate how well a forecasting model fits the actual data. It analyses the difference between observed values and the values predicted by the model. This difference is called a residual:
Residual = Observed value – Predicted value
The purpose of residual analysis is to:
- Detect systematic bias in the model – for example, whether it consistently over- or underestimates in certain situations.
- Assess whether the model’s error assumptions are valid, such as:
- Residuals are normally distributed
- Constant variance (homoscedasticity)
- No autocorrelation (independent errors)
Common tools in residual analysis include:
- Residual plots: Show residuals versus predicted values. If the model is sound, the pattern should look random.
- Durbin-Watson test: Measures autocorrelation in residuals – essential for time series.
- Histogram or Normal Probability Plot (NPP): Tests for normality of residuals.
- Breusch-Pagan or White test: Checks for heteroscedasticity – i.e., whether residual variance remains constant.
In summary:
A well-performing model has residuals that are randomly scattered around zero, with no clear patterns. That’s a strong sign the model is capturing the real-world dynamics accurately.
We apply residual analysis to all our forecasting models in TellMeNow. Click here to learn more.