Interpreting slope and intercept
The slope b is the predicted change in y for each one-unit increase in x. If hours studied predict test score with b = 4.2, each extra hour is associated with 4.2 more points on average. The intercept a is the predicted y when x = 0, which only means something if x = 0 is realistic.
r² is the fraction of the variation in y explained by the line: r² = 0.81 means 81%.
Cautions
- Look at the scatter plot: a straight line is only sensible for linear patterns.
- Don’t extrapolate far beyond the x values in your data.
- One influential point can swing the line, as the explainer shows.
- Association is not causation.
Frequently asked questions
What is a residual?
Actual y minus predicted ŷ. Least squares chooses the line that makes the sum of squared residuals as small as possible.
Does it matter which variable is x?
Yes. Regressing y on x gives a different line from regressing x on y. Put the explanatory (predictor) variable on x.