Watch these videos, which discuss the regression line.
Source: Khan Academy, https://www.youtube.com/watch?v=l5k1Nskh1Nc, https://www.youtube.com/watch?v=uMjoEmXdrkI
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 License.