Linear Algebra/Vector Spaces and Linear Systems/Solutions

SolutionsEdit

Problem 1

Transpose each.

  1.  
  2.  
  3.  
  4.  
  5.  
Answer
  1.  
  2.  
  3.  
  4.  
  5.  
This exercise is recommended for all readers.
Problem 2

Decide if the vector is in the row space of the matrix.

  1.  ,  
  2.  ,  
Answer
  1. Yes. To see if there are   and   such that   we solve
     
    and get   and  . Thus the vector is in the row space.
  2. No. The equation   has no solution.
     
    Thus, the vector is not in the row space.
This exercise is recommended for all readers.
Problem 3

Decide if the vector is in the column space.

  1.  ,  
  2.  ,  
Answer
  1. No. To see if there are   such that
     
    we can use Gauss' method on the resulting linear system.
     
    There is no solution and so the vector is not in the column space.
  2. Yes. From this relationship
     
    we get a linear system that, when Gauss' method is applied,
     
    yields a solution. Thus, the vector is in the column space.
This exercise is recommended for all readers.
Problem 4

Find a basis for the row space of this matrix.


 


Answer

A routine Gaussian reduction

 

suggests this basis  .

Another, perhaps more convenient procedure, is to swap rows first,

 

leading to the basis  .

This exercise is recommended for all readers.
Problem 5

Find the rank of each matrix.

  1.  
  2.  
  3.  
  4.  
Answer
  1. This reduction
     
    shows that the row rank, and hence the rank, is three.
  2. Inspection of the columns shows that that the others are multiples of the first (inspection of the rows shows the same thing). Thus the rank is one. Alternatively, the reduction
     
    shows the same thing.
  3. This calculation
     
    shows that the rank is two.
  4. The rank is zero.
This exercise is recommended for all readers.
Problem 6

Find a basis for the span of each set.

  1.  
  2.  
  3.  
  4.  
Answer
  1. This reduction
     
    gives  .
  2. Transposing and reducing
     
    and then transposing back gives this basis.
     
  3. Notice first that the surrounding space is given as  , not  . Then, taking the first polynomial   to be "the same" as the row vector  , etc., leads to
     
    which yields the basis  .
  4. Here "the same" gives
     
    leading to this basis.
     
Problem 7

Which matrices have rank zero? Rank one?

Answer

Only the zero matrices have rank of zero. The only matrices of rank one have the form

 


where   is some nonzero row vector, and not all of the  's are zero. (Remark. We can't simply say that all of the rows are multiples of the first because the first row might be the zero row. Another Remark. The above also applies with "column" replacing "row".)

This exercise is recommended for all readers.
Problem 8

Given  , what choice of   will cause this matrix to have the rank of one?


 


Answer

If   then a choice of   will make the second row be a multiple of the first, specifically,   times the first. If   and   then any non-  choice for   will ensure that the second row is nonzero. If   and   and   then any choice for   will do, since the matrix will automatically have rank one (even with the choice of  ). Finally, if   and   and   then no choice for   will suffice because the matrix is sure to have rank two.

Problem 9

Find the column rank of this matrix.

 
Answer

The column rank is two. One way to see this is by inspection— the column space consists of two-tall columns and so can have a dimension of at least two, and we can easily find two columns that together form a linearly independent set (the fourth and fifth columns, for instance). Another way to see this is to recall that the column rank equals the row rank, and to perform Gauss' method, which leaves two nonzero rows.

Problem 10

Show that a linear system with at least one solution has at most one solution if and only if the matrix of coefficients has rank equal to the number of its columns.

Answer

We apply Theorem 3.13. The number of columns of a matrix of coefficients   of a linear system equals the number   of unknowns. A linear system with at least one solution has at most one solution if and only if the space of solutions of the associated homogeneous system has dimension zero (recall: in the " " equation  , provided that such a   exists, the solution   is unique if and only if the vector   is unique, namely  ). But that means, by the theorem, that  .

This exercise is recommended for all readers.
Problem 11

If a matrix is  , which set must be dependent, its set of rows or its set of columns?

Answer

The set of columns must be dependent because the rank of the matrix is at most five while there are nine columns.

Problem 12

Give an example to show that, despite that they have the same dimension, the row space and column space of a matrix need not be equal. Are they ever equal?

Answer

There is little danger of their being equal since the row space is a set of row vectors while the column space is a set of columns (unless the matrix is  , in which case the two spaces must be equal).

Remark. Consider

 

and note that the row space is the set of all multiples of   while the column space consists of multiples of

 

so we also cannot argue that the two spaces must be simply transposes of each other.

Problem 13

Show that the set   does not have the same span as  . What, by the way, is the vector space?

Answer

First, the vector space is the set of four-tuples of real numbers, under the natural operations. Although this is not the set of four-wide row vectors, the difference is slight— it is "the same" as that set. So we will treat the four-tuples like four-wide vectors.

With that, one way to see that   is not in the span of the first set is to note that this reduction

 

and this one

 

yield matrices differing in rank. This means that addition of   to the set of the first three four-tuples increases the rank, and hence the span, of that set. Therefore   is not already in the span.

This exercise is recommended for all readers.
Problem 14

Show that this set of column vectors

 

is a subspace of  . Find a basis.

Answer

It is a subspace because it is the column space of the matrix

 

of coefficients. To find a basis for the column space,

 

we take the three vectors from the spanning set, transpose, reduce,

 

and transpose back to get this.

 
Problem 15

Show that the transpose operation is linear:

 

for   and  .

Answer

This can be done as a straightforward calculation.


 
This exercise is recommended for all readers.
Problem 16

In this subsection we have shown that Gaussian reduction finds a basis for the row space.

  1. Show that this basis is not unique— different reductions may yield different bases.
  2. Produce matrices with equal row spaces but unequal numbers of rows.
  3. Prove that two matrices have equal row spaces if and only if after Gauss-Jordan reduction they have the same nonzero rows.
Answer
  1. These reductions give different bases.
     
  2. An easy example is this.
     
    This is a less simplistic example.
     
  3. Assume that   and   are matrices with equal row spaces. Construct a matrix   with the rows of   above the rows of  , and another matrix   with the rows of   above the rows of  .
     
    Observe that   and   are row-equivalent (via a sequence of row-swaps) and so Gauss-Jordan reduce to the same reduced echelon form matrix. Because the row spaces are equal, the rows of   are linear combinations of the rows of   so Gauss-Jordan reduction on   simply turns the rows of   to zero rows and thus the nonzero rows of   are just the nonzero rows obtained by Gauss-Jordan reducing  . The same can be said for the matrix  — Gauss-Jordan reduction on   gives the same non-zero rows as are produced by reduction on   alone. Therefore,   yields the same nonzero rows as  , which yields the same nonzero rows as  , which yields the same nonzero rows as  .
Problem 17

Why is there not a problem with Remark 3.14 in the case that   is bigger than  ?

Answer

It cannot be bigger.

Problem 18

Show that the row rank of an   matrix is at most  . Is there a better bound?

Answer

The number of rows in a maximal linearly independent set cannot exceed the number of rows. A better bound (the bound that is, in general, the best possible) is the minimum of   and  , because the row rank equals the column rank.

This exercise is recommended for all readers.
Problem 19

Show that the rank of a matrix equals the rank of its transpose.

Answer

Because the rows of a matrix   are turned into the columns of   the dimension of the row space of   equals the dimension of the column space of  . But the dimension of the row space of   is the rank of   and the dimension of the column space of   is the rank of  . Thus the two ranks are equal.

Problem 20

True or false: the column space of a matrix equals the row space of its transpose.

Answer

False. The first is a set of columns while the second is a set of rows.

This example, however,

 

indicates that as soon as we have a formal meaning for "the same", we can apply it here:

 

while

 

are "the same" as each other.

This exercise is recommended for all readers.
Problem 21

We have seen that a row operation may change the column space. Must it?

Answer

No. Here, Gauss' method does not change the column space.

 
Problem 22

Prove that a linear system has a solution if and only if that system's matrix of coefficients has the same rank as its augmented matrix.

Answer

A linear system

 

has a solution if and only if   is in the span of the set  . That's true if and only if the column rank of the augmented matrix equals the column rank of the matrix of coefficients. Since rank equals the column rank, the system has a solution if and only if the rank of its augmented matrix equals the rank of its matrix of coefficients.

Problem 23

An   matrix has full row rank if its row rank is  , and it has full column rank if its column rank is  .

  1. Show that a matrix can have both full row rank and full column rank only if it is square.
  2. Prove that the linear system with matrix of coefficients   has a solution for any  , ...,  's on the right side if and only if   has full row rank.
  3. Prove that a homogeneous system has a unique solution if and only if its matrix of coefficients   has full column rank.
  4. Prove that the statement "if a system with matrix of coefficients   has any solution then it has a unique solution" holds if and only if   has full column rank.
Answer
  1. Row rank equals column rank so each is at most the minimum of the number of rows and columns. Hence both can be full only if the number of rows equals the number of columns. (Of course, the converse does not hold: a square matrix need not have full row rank or full column rank.)
  2. If   has full row rank then, no matter what the right-hand side, Gauss' method on the augmented matrix ends with a leading one in each row and none of those leading ones in the furthest right column (the "augmenting" column). Back substitution then gives a solution. On the other hand, if the linear system lacks a solution for some right-hand side it can only be because Gauss' method leaves some row so that it is all zeroes to the left of the "augmenting" bar and has a nonzero entry on the right. Thus, if   does not have a solution for some right-hand sides, then   does not have full row rank because some of its rows have been eliminated.
  3. The matrix   has full column rank if and only if its columns form a linearly independent set. That's equivalent to the existence of only the trivial linear relationship.
  4. The matrix   has full column rank if and only if the set of its columns is linearly independent, and so forms a basis for its span. That's equivalent to the existence of a unique linear representation of all vectors in that span.
Problem 24

How would the conclusion of Lemma 3.3 change if Gauss' method is changed to allow multiplying a row by zero?

Answer

Instead of the row spaces being the same, the row space of   would be a subspace (possibly equal to) the row space of  .

This exercise is recommended for all readers.
Problem 25

What is the relationship between   and  ? Between   and  ? What, if any, is the relationship between  ,  , and  ?

Answer

Clearly   as Gauss' method allows us to multiply all rows of a matrix by  . In the same way, when   we have  .

Addition is more interesting. The rank of a sum can be smaller than the rank of the summands.

 

The rank of a sum can be bigger than the rank of the summands.

 

But there is an upper bound (other than the size of the matrices). In general,  .

To prove this, note that Gaussian elimination can be performed on   in either of two ways: we can first add   to   and then apply the appropriate sequence of reduction steps

 

or we can get the same results by performing   through   separately on   and  , and then adding. The largest rank that we can end with in the second case is clearly the sum of the ranks. (The matrices above give examples of both possibilities,   and  , happening.)