Exercise 3.11

Prove: any k + 1 k-vectors are linearly dependent. (You can do it by using mathematical induction.)

Solution:

Suppose we have k+1 k-vectors. Each such vector has k components. We assume as an induction hypothesis that any k (k-1)-vectors are linearly dependent, which means that there must be a linear dependence among any k (k-1)-component vectors.

(This hypothesis is trivial for k = 2)

We notice that a linear combination of linear combinations is a linear combination. This means if we can take our k+1 k-vectors and produce k linear distinct linear combinations of them that are each (k-1)-vectors, we can use the induction hypothesis to give us a linear dependence among these which will produce a linear dependence among our original vectors.

Notice also that k-vectors all of whose last components are 0 can be considered to be k-1-vectors.

So we pick one of our vectors, say the k-th, which has a non-zero k-th component. (if there is no vector with non-zero k-th component, then we really have k-1-component vectors and can apply the induction hypothesis immediately) Now we subtract enough of this vector from each of the others to make the resulting k-th components all zero.

Now we have our k (k-1)-vectors and find a linear combination that is 0. This gives a linear combination of the original vectors which is 0 and we are done.

We have to verify that the new linear combination cannot have all 0 coefficients if the one obtained from the induction hypothesis did not. This is obvious because each of our vectors except for the k-th occurs in exactly one of the combinations to which the induction hypothesis was applied. Any non-zero coefficient in the linear combination of linear combinations will give rise to a non-zero coefficient of the corresponding one of our original vectors and we are really done.