Linear regression is commonly used to fit a line to a collection of data. The method of least squares can be viewed as finding the projection of a vector. Linear algebra provides a powerful and efficient description of linear regression in terms of the matrix ATA.
Projection Matrices and Least Squares
Least Squares Approximation
Work the problems on your own and check your answers when you're done.