the least squares regression line is the line which minimizes the sum of the squared residuals for all the points in the scatterplot. the vertical distance between a point in the scatterplot and the predicted value on the regression line is the residual for the point. least square estimates from simple linear regression are the slope b1 estimates, on average, the change in the y variable associated with one unit increase in x variable.