Residual Analysis Calculator

About the Residual Analysis Calculator

Fitting a regression line is only the first step. Residual analysis checks whether the model is actually behaving like a usable regression rather than simply producing a high R².

This calculator reports raw residuals, standardized residuals, leverage, Cook's distance, and summary diagnostics such as Durbin-Watson, skewness, and kurtosis. Together those outputs help you look for common failure modes: curvature, changing variance, autocorrelation, and influential points.

The goal is not just to identify a line, but to see whether the assumptions behind that line are holding up once you inspect the errors directly.

When This Page Helps

Residual diagnostics matter because a visually poor model can still produce an impressive summary statistic. Looking at residual shape, influence, and correlation is often what tells you whether to transform variables, add curvature, or question a few points before you trust the fit.

How to Use the Inputs

1. Enter X values and corresponding Y values (comma-separated).
2. Or click a preset to load diagnostic scenarios.
3. Set the outlier threshold for standardized residuals (default 2).
4. Review the diagnostic output cards (RMSE, Durbin-Watson, etc.).
5. Examine the residual table for outliers and influential points.
6. Check Cook's distance — values > 1.0 indicate highly influential observations.
7. Use the diagnostic reference table to interpret each metric.

Example Calculation

Tips & Best Practices

• Always examine residual plots before trusting any regression model.
• A curved pattern in residuals means you need polynomial or transformed terms.
• Fan-shaped residuals indicate heteroscedasticity — use weighted regression or transform Y.
• Cook's D > 1 means removing that single point substantially changes the entire regression.
• If Durbin-Watson is far from 2, consider adding time-lagged predictors or using autocorrelation-corrected regression.
• Try the "Outlier Present" preset to see how one extreme point affects diagnostics.

Regression Assumptions and Residuals

OLS regression assumes: (1) Linearity — the true relationship is linear. (2) Independence — residuals are uncorrelated. (3) Homoscedasticity — residual variance is constant. (4) Normality — residuals are normally distributed. Each assumption maps to specific diagnostic tests.

Linearity: Plot residuals vs. predicted values. Random scatter = good. Curves = consider polynomial terms. Independence: Durbin-Watson tests first-order serial correlation. Homoscedasticity: Look for fan shapes in residual plots. Normality: Check skewness and kurtosis.

Influential Points vs. Outliers

An outlier has a large residual — the model predicts poorly for that point. A high-leverage point has an extreme X value. An influential point changes the regression substantially when removed. A point can be high-leverage without being influential (if it falls on the trend), or an outlier without being influential (if leverage is low). Cook's distance captures the combined effect.

What To Do When Diagnostics Fail

Non-linearity: Add polynomial terms or transform variables. Heteroscedasticity: Use weighted least squares or robust standard errors. Autocorrelation: Use generalized least squares or add lag terms. Non-normality: Transform Y (log, sqrt) or use robust regression. Outliers: Investigate data quality, use robust methods (LAD, Huber), or report with and without.

Frequently Asked Questions

• What's the difference between raw and standardized residuals?

  Raw residuals (eᵢ = yᵢ − ŷᵢ) retain Y-units. Standardized residuals divide by estimated standard deviation accounting for leverage, converting to a unit-free scale where values beyond ±2 indicate potential outliers.

• What does the Durbin-Watson statistic mean?

  DW tests for first-order autocorrelation in residuals. DW ≈ 2 means no autocorrelation. DW << 2 suggests positive autocorrelation (consecutive residuals similar). DW >> 2 suggests negative autocorrelation (consecutive residuals alternate sign).

• When is Cook's distance concerning?

  The traditional rule: Cook's D > 1 is influential. A stricter rule uses D > 4/n. Remove or investigate high-Cook's-D points — they may be data errors, outliers, or genuinely different observations that shouldn't be modeled together.

• What does high leverage mean?

  Leverage measures how far xᵢ is from x̄. Extreme X values have high leverage: they have outsized potential to pull the regression line. High leverage isn't always bad — compare Cook's D to see if the point actually affects the regression.

• What if residuals aren't normally distributed?

  Non-normal residuals don't affect coefficient estimates but do affect confidence intervals and p-values. Check skewness (should be near 0) and kurtosis (should be near 0 for excess kurtosis). With n > 30, the Central Limit Theorem provides some protection.

• How do I detect heteroscedasticity?

  Look for a fan or funnel shape in the residual visual — residuals getting larger (or smaller) as X increases. Our visual bars show this pattern clearly. Formal tests include Breusch-Pagan and White's test.