Linear regression is commonly used to fit a line to a collection of data. The method of least squares can be viewed as finding the projection of a vector. Linear algebra provides a powerful and efficient description of linear regression in terms of the matrix ATA.
Lecture 16: Projection Matrices and Least Squares
Problem Solving: Least Squares Approximation
Work the problems on your own and check your answers when you're done.