Linear Algebra/Any Matrix Represents a Linear Map

Linear Algebra
 ← Representing Linear Maps with Matrices Any Matrix Represents a Linear Map Matrix Operations → 

The prior subsection shows that the action of a linear map is described by a matrix , with respect to appropriate bases, in this way.

In this subsection, we will show the converse, that each matrix represents a linear map.

Recall that, in the definition of the matrix representation of a linear map, the number of columns of the matrix is the dimension of the map's domain and the number of rows of the matrix is the dimension of the map's codomain. Thus, for instance, a matrix cannot represent a map from to . The next result says that, beyond this restriction on the dimensions, there are no other limitations: the matrix represents a map from any three-dimensional space to any two-dimensional space.

Theorem 2.1

Any matrix represents a homomorphism between vector spaces of appropriate dimensions, with respect to any pair of bases.

Proof

For the matrix

fix any -dimensional domain space and any -dimensional codomain space . Also fix bases and for those spaces. Define a function by: where in the domain is represented as

then its image is the member the codomain represented by

that is, is defined to be . (This is well-defined by the uniqueness of the representation .)

Observe that has simply been defined to make it the map that is represented with respect to by the matrix . So to finish, we need only check that is linear. If are such that

and then the calculation

provides this verification.

Example 2.2

Which map the matrix represents depends on which bases are used. If

then represented by with respect to maps

while represented by with respect to is this map.

These two are different. The first is projection onto the axis, while the second is projection onto the axis.

So not only is any linear map described by a matrix but any matrix describes a linear map. This means that we can, when convenient, handle linear maps entirely as matrices, simply doing the computations, without have to worry that a matrix of interest does not represent a linear map on some pair of spaces of interest. (In practice, when we are working with a matrix but no spaces or bases have been specified, we will often take the domain and codomain to be and and use the standard bases. In this case, because the representation is transparent— the representation with respect to the standard basis of is — the column space of the matrix equals the range of the map. Consequently, the column space of is often denoted by .)

With the theorem, we have characterized linear maps as those maps that act in this matrix way. Each linear map is described by a matrix and each matrix describes a linear map. We finish this section by illustrating how a matrix can be used to tell things about its maps.

Theorem 2.3

The rank of a matrix equals the rank of any map that it represents.

Proof

Suppose that the matrix is . Fix domain and codomain spaces and of dimension and , with bases and . Then represents some linear map between those spaces with respect to these bases whose rangespace

is the span . The rank of is the dimension of this rangespace.

The rank of the matrix is its column rank (or its row rank; the two are equal). This is the dimension of the column space of the matrix, which is the span of the set of column vectors .

To see that the two spans have the same dimension, recall that a representation with respect to a basis gives an isomorphism . Under this isomorphism, there is a linear relationship among members of the rangespace if and only if the same relationship holds in the column space, e.g, if and only if . Hence, a subset of the rangespace is linearly independent if and only if the corresponding subset of the column space is linearly independent. This means that the size of the largest linearly independent subset of the rangespace equals the size of the largest linearly independent subset of the column space, and so the two spaces have the same dimension.

Example 2.4

Any map represented by

must, by definition, be from a three-dimensional domain to a four-dimensional codomain. In addition, because the rank of this matrix is two (we can spot this by eye or get it with Gauss' method), any map represented by this matrix has a two-dimensional rangespace.

Corollary 2.5

Let be a linear map represented by a matrix . Then is onto if and only if the rank of equals the number of its rows, and is one-to-one if and only if the rank of equals the number of its columns.

Proof

For the first half, the dimension of the rangespace of is the rank of , which equals the rank of by the theorem. Since the dimension of the codomain of is the number of rows in , if the rank of equals the number of rows, then the dimension of the rangespace equals the dimension of the codomain. But a subspace with the same dimension as its superspace must equal that superspace (a basis for the rangespace is a linearly independent subset of the codomain, whose size is equal to the dimension of the codomain, and so this set is a basis for the codomain).

For the second half, a linear map is one-to-one if and only if it is an isomorphism between its domain and its range, that is, if and only if its domain has the same dimension as its range. But the number of columns in is the dimension of 's domain, and by the theorem the rank of equals the dimension of 's range.

The above results end any confusion caused by our use of the word "rank" to mean apparently different things when applied to matrices and when applied to maps. We can also justify the dual use of "nonsingular". We've defined a matrix to be nonsingular if it is square and is the matrix of coefficients of a linear system with a unique solution, and we've defined a linear map to be nonsingular if it is one-to-one.

Corollary 2.6

A square matrix represents nonsingular maps if and only if it is a nonsingular matrix. Thus, a matrix represents an isomorphism if and only if it is square and nonsingular.

Proof

Immediate from the prior result.

Example 2.7

Any map from to represented with respect to any pair of bases by

is nonsingular because this matrix has rank two.

Example 2.8

Any map represented by

is not nonsingular because this matrix is not nonsingular.

We've now seen that the relationship between maps and matrices goes both ways: fixing bases, any linear map is represented by a matrix and any matrix describes a linear map. That is, by fixing spaces and bases we get a correspondence between maps and matrices. In the rest of this chapter we will explore this correspondence. For instance, we've defined for linear maps the operations of addition and scalar multiplication and we shall see what the corresponding matrix operations are. We shall also see the matrix operation that represent the map operation of composition. And, we shall see how to find the matrix that represents a map's inverse.


Exercises

edit
This exercise is recommended for all readers.
Problem 1

Decide if the vector is in the column space of the matrix.

  1.  ,  
  2.  ,  
  3.  ,  
This exercise is recommended for all readers.
Problem 2

Decide if each vector lies in the range of the map from   to   represented with respect to the standard bases by the matrix.

  1.  ,  
  2.  ,  
This exercise is recommended for all readers.
Problem 3

Consider this matrix, representing a transformation of  , and these bases for that space.

 
  1. To what vector in the codomain is the first member of   mapped?
  2. The second member?
  3. Where is a general vector from the domain (a vector with components   and  ) mapped? That is, what transformation of   is represented with respect to   by this matrix?
Problem 4

What transformation of   is represented with respect to   and   by this matrix?

 
This exercise is recommended for all readers.
Problem 5

Decide if   is in the range of the map from   to   represented with respect to   and   by this matrix.

 
Problem 6

Example 2.8 gives a matrix that is nonsingular, and is therefore associated with maps that are nonsingular.

  1. Find the set of column vectors representing the members of the nullspace of any map represented by this matrix.
  2. Find the nullity of any such map.
  3. Find the set of column vectors representing the members of the rangespace of any map represented by this matrix.
  4. Find the rank of any such map.
  5. Check that rank plus nullity equals the dimension of the domain.
This exercise is recommended for all readers.
Problem 7

Because the rank of a matrix equals the rank of any map it represents, if one matrix represents two different maps   (where  ) then the dimension of the rangespace of   equals the dimension of the rangespace of  . Must these equal-dimensioned rangespaces actually be the same?

This exercise is recommended for all readers.
Problem 8

Let   be an  -dimensional space with bases   and  . Consider a map that sends, for  , the column vector representing   with respect to   to the column vector representing   with respect to  . Show that is a linear transformation of  .

Problem 9

Example 2.2 shows that changing the pair of bases can change the map that a matrix represents, even though the domain and codomain remain the same. Could the map ever not change? Is there a matrix  , vector spaces   and  , and associated pairs of bases   and   (with   or   or both) such that the map represented by   with respect to   equals the map represented by   with respect to  ?

This exercise is recommended for all readers.
Problem 10

A square matrix is a diagonal matrix if it is all zeroes except possibly for the entries on its upper-left to lower-right diagonal— its   entry, its   entry, etc. Show that a linear map is an isomorphism if there are bases such that, with respect to those bases, the map is represented by a diagonal matrix with no zeroes on the diagonal.

Problem 11

Describe geometrically the action on   of the map represented with respect to the standard bases   by this matrix.

 

Do the same for these.

 
Problem 12

The fact that for any linear map the rank plus the nullity equals the dimension of the domain shows that a necessary condition for the existence of a homomorphism between two spaces, onto the second space, is that there be no gain in dimension. That is, where   is onto, the dimension of   must be less than or equal to the dimension of  .

  1. Show that this (strong) converse holds: no gain in dimension implies that there is a homomorphism and, further, any matrix with the correct size and correct rank represents such a map.
  2. Are there bases for   such that this matrix
     
    represents a map from   to   whose range is the   plane subspace of  ?
Problem 13

Let   be an  -dimensional space and suppose that  . Fix a basis   for   and consider the map   given   by the dot product.

  1. Show that this map is linear.
  2. Show that for any linear map   there is an   such that  .
  3. In the prior item we fixed the basis and varied the   to get all possible linear maps. Can we get all possible linear maps by fixing an   and varying the basis?
Problem 14

Let   be vector spaces with bases  .

  1. Suppose that   is represented with respect to   by the matrix  . Give the matrix representing the scalar multiple   (where  ) with respect to   by expressing it in terms of  .
  2. Suppose that   are represented with respect to   by   and  . Give the matrix representing   with respect to   by expressing it in terms of   and  .
  3. Suppose that   is represented with respect to   by   and   is represented with respect to   by  . Give the matrix representing   with respect to   by expressing it in terms of   and  .

Solutions

Linear Algebra
 ← Representing Linear Maps with Matrices Any Matrix Represents a Linear Map Matrix Operations →