# Linear Algebra/Vector Spaces and Linear Systems/Solutions

## SolutionsEdit

- Problem 1

Transpose each.

- Answer

*This exercise is recommended for all readers.*

- Problem 2

Decide if the vector is in the row space of the matrix.

- ,
- ,

- Answer

- Yes.
To see if there are and such that we solve
- No. The equation has no solution.

*This exercise is recommended for all readers.*

- Problem 3

Decide if the vector is in the column space.

- ,
- ,

- Answer

- No. To see if there are such that
- Yes. From this relationship

*This exercise is recommended for all readers.*

- Problem 4

Find a basis for the row space of this matrix.

- Answer

A routine Gaussian reduction

suggests this basis .

Another, perhaps more convenient procedure, is to swap rows first,

leading to the basis .

*This exercise is recommended for all readers.*

- Problem 5

Find the rank of each matrix.

- Answer

- This reduction
- Inspection of the columns shows that that the others are multiples of the first (inspection of the rows shows the same thing). Thus the rank is one.
Alternatively, the reduction
- This calculation
- The rank is zero.

*This exercise is recommended for all readers.*

- Problem 6

Find a basis for the span of each set.

- Answer

- This reduction
- Transposing and reducing
- Notice first that the surrounding space is given as , not . Then, taking the first polynomial to be "the same" as the row vector , etc., leads to
- Here "the same" gives

- Problem 7

Which matrices have rank zero? Rank one?

- Answer

Only the zero matrices have rank of zero. The only matrices of rank one have the form

where is some nonzero row vector, and not all of the 's are zero. (*Remark.* We can't simply say that all of the rows are multiples of the first because the first row might be the zero row. *Another Remark.* The above also applies with "column" replacing "row".)

*This exercise is recommended for all readers.*

- Problem 8

Given , what choice of will cause this matrix to have the rank of one?

- Answer

If then a choice of will make the second row be a multiple of the first, specifically, times the first. If and then any non- choice for will ensure that the second row is nonzero. If and and then any choice for will do, since the matrix will automatically have rank one (even with the choice of ). Finally, if and and then no choice for will suffice because the matrix is sure to have rank two.

- Problem 9

Find the column rank of this matrix.

- Answer

The column rank is two. One way to see this is by inspection— the column space consists of two-tall columns and so can have a dimension of at least two, and we can easily find two columns that together form a linearly independent set (the fourth and fifth columns, for instance). Another way to see this is to recall that the column rank equals the row rank, and to perform Gauss' method, which leaves two nonzero rows.

- Problem 10

Show that a linear system with at least one solution has at most one solution if and only if the matrix of coefficients has rank equal to the number of its columns.

- Answer

We apply Theorem 3.13. The number of columns of a matrix of coefficients of a linear system equals the number of unknowns. A linear system with at least one solution has at most one solution if and only if the space of solutions of the associated homogeneous system has dimension zero (recall: in the " " equation , provided that such a exists, the solution is unique if and only if the vector is unique, namely ). But that means, by the theorem, that .

*This exercise is recommended for all readers.*

- Problem 11

If a matrix is , which set must be dependent, its set of rows or its set of columns?

- Answer

The set of columns must be dependent because the rank of the matrix is at most five while there are nine columns.

- Problem 12

Give an example to show that, despite that they have the same dimension, the row space and column space of a matrix need not be equal. Are they ever equal?

- Answer

There is little danger of their being equal since the row space is a set of row vectors while the column space is a set of columns (unless the matrix is , in which case the two spaces must be equal).

*Remark.* Consider

and note that the row space is the set of all multiples of while the column space consists of multiples of

so we also cannot argue that the two spaces must be simply transposes of each other.

- Problem 13

Show that the set does not have the same span as . What, by the way, is the vector space?

- Answer

First, the vector space is the set of four-tuples of real numbers, under the natural operations. Although this is not the set of four-wide row vectors, the difference is slight— it is "the same" as that set. So we will treat the four-tuples like four-wide vectors.

With that, one way to see that is not in the span of the first set is to note that this reduction

and this one

yield matrices differing in rank. This means that addition of to the set of the first three four-tuples increases the rank, and hence the span, of that set. Therefore is not already in the span.

*This exercise is recommended for all readers.*

- Problem 14

Show that this set of column vectors

is a subspace of . Find a basis.

- Answer

It is a subspace because it is the column space of the matrix

of coefficients. To find a basis for the column space,

we take the three vectors from the spanning set, transpose, reduce,

and transpose back to get this.

- Problem 15

Show that the transpose operation is **linear**:

for and .

- Answer

This can be done as a straightforward calculation.

*This exercise is recommended for all readers.*

- Problem 16

In this subsection we have shown that Gaussian reduction finds a basis for the row space.

- Show that this basis is not unique— different reductions may yield different bases.
- Produce matrices with equal row spaces but unequal numbers of rows.
- Prove that two matrices have equal row spaces if and only if after Gauss-Jordan reduction they have the same nonzero rows.

- Answer

- These reductions give different bases.
- An easy example is this.
- Assume that and are matrices with equal row spaces. Construct a matrix with the rows of above the rows of , and another matrix with the rows of above the rows of .

- Problem 17

Why is there not a problem with Remark 3.14 in the case that is bigger than ?

- Answer

It cannot be bigger.

- Problem 18

Show that the row rank of an matrix is at most . Is there a better bound?

- Answer

The number of rows in a maximal linearly independent set cannot exceed the number of rows. A better bound (the bound that is, in general, the best possible) is the minimum of and , because the row rank equals the column rank.

*This exercise is recommended for all readers.*

- Problem 19

Show that the rank of a matrix equals the rank of its transpose.

- Answer

Because the rows of a matrix are turned into the columns of the dimension of the row space of equals the dimension of the column space of . But the dimension of the row space of is the rank of and the dimension of the column space of is the rank of . Thus the two ranks are equal.

- Problem 20

True or false: the column space of a matrix equals the row space of its transpose.

- Answer

False. The first is a set of columns while the second is a set of rows.

This example, however,

indicates that as soon as we have a formal meaning for "the same", we can apply it here:

while

are "the same" as each other.

*This exercise is recommended for all readers.*

- Problem 21

We have seen that a row operation may change the column space. Must it?

- Answer

No. Here, Gauss' method does not change the column space.

- Problem 22

Prove that a linear system has a solution if and only if that system's matrix of coefficients has the same rank as its augmented matrix.

- Answer

A linear system

has a solution if and only if is in the span of the set . That's true if and only if the column rank of the augmented matrix equals the column rank of the matrix of coefficients. Since rank equals the column rank, the system has a solution if and only if the rank of its augmented matrix equals the rank of its matrix of coefficients.

- Problem 23

An matrix has **full row rank** if its row rank is , and it has **full column rank** if its column rank is .

- Show that a matrix can have both full row rank and full column rank only if it is square.
- Prove that the linear system with matrix of coefficients has a solution for any , ..., 's on the right side if and only if has full row rank.
- Prove that a homogeneous system has a unique solution if and only if its matrix of coefficients has full column rank.
- Prove that the statement "if a system with matrix of coefficients has any solution then it has a unique solution" holds if and only if has full column rank.

- Answer

- Row rank equals column rank so each is at most the minimum of the number of rows and columns. Hence both can be full only if the number of rows equals the number of columns. (Of course, the converse does not hold: a square matrix need not have full row rank or full column rank.)
- If has full row rank then, no matter what the right-hand side, Gauss' method on the augmented matrix ends with a leading one in each row and none of those leading ones in the furthest right column (the "augmenting" column). Back substitution then gives a solution. On the other hand, if the linear system lacks a solution for some right-hand side it can only be because Gauss' method leaves some row so that it is all zeroes to the left of the "augmenting" bar and has a nonzero entry on the right. Thus, if does not have a solution for some right-hand sides, then does not have full row rank because some of its rows have been eliminated.
- The matrix has full column rank if and only if its columns form a linearly independent set. That's equivalent to the existence of only the trivial linear relationship.
- The matrix has full column rank if and only if the set of its columns is linearly independent, and so forms a basis for its span. That's equivalent to the existence of a unique linear representation of all vectors in that span.

- Problem 24

How would the conclusion of Lemma 3.3 change if Gauss' method is changed to allow multiplying a row by zero?

- Answer

Instead of the row spaces being the same, the row space of would be a subspace (possibly equal to) the row space of .

*This exercise is recommended for all readers.*

- Problem 25

What is the relationship between and ? Between and ? What, if any, is the relationship between , , and ?

- Answer

Clearly as Gauss' method allows us to multiply all rows of a matrix by . In the same way, when we have .

Addition is more interesting. The rank of a sum can be smaller than the rank of the summands.

The rank of a sum can be bigger than the rank of the summands.

But there is an upper bound (other than the size of the matrices). In general, .

To prove this, note that Gaussian elimination can be performed on in either of two ways: we can first add to and then apply the appropriate sequence of reduction steps

or we can get the same results by performing through separately on and , and then adding. The largest rank that we can end with in the second case is clearly the sum of the ranks. (The matrices above give examples of both possibilities, and , happening.)