Linear Algebra/Subspaces and Spanning sets
One of the examples that led us to introduce the idea of a vector space was the solution set of a homogeneous system. For instance, we've seen in Example 1.4 such a space that is a planar subset of
. There, the vector space
contains inside it another vector space, the plane.
- Definition 2.1
For any vector space, a subspace is a subset that is itself a vector space, under the inherited operations.
- Example 2.2
The plane from the prior subsection,
is a subspace of
. As specified in the definition, the operations are the ones that are inherited from the larger space, that is, vectors add in P as they add in 
and scalar multiplication is also the same as it is in
. To show that P is a subspace, we need only note that it is a subset and then verify that it is a space. Checking that P satisfies the conditions in the definition of a vector space is routine. For instance, for closure under addition, just note that if the summands satisfy that x1 + y1 + z1 = 0 and x2 + y2 + z2 = 0 then the sum satisfies that (x1 + x2) + (y1 + y2) + (z1 + z2) = (x1 + y1 + z1) + (x2 + y2 + z2) = 0.
- Example 2.3
The x-axis in
is a subspace where the addition and scalar multiplication operations are the inherited ones.
As above, to verify that this is a subspace, we simply note that it is a subset and then check that it satisfies the conditions in definition of a vector space. For instance, the two closure conditions are satisfied: (1) adding two vectors with a second component of zero results in a vector with a second component of zero, and (2) multiplying a scalar times a vector with a second component of zero results in a vector with a second component of zero.
- Example 2.4
Another subspace of
is
its trivial subspace.
Any vector space has a trivial subspace
. At the opposite extreme, any vector space has itself for a subspace. These two are the improper subspaces. Other subspaces are proper.
- Example 2.5
The condition in the definition requiring that the addition and scalar multiplication operations must be the ones inherited from the larger space is important. Consider the subset {1} of the vector space
. Under the operations 1 + 1 = 1 and
that set is a vector space, specifically, a trivial space. But it is not a subspace of
because those aren't the inherited operations, since of course
has 1 + 1 = 2.
- Example 2.6
All kinds of vector spaces, not just
's, have subspaces. The vector space of cubic polynomials
has a subspace comprised of all linear polynomials
.
- Example 2.7
Another example of a subspace not taken from an
is one from the examples following the definition of a vector space. The space of all real-valued functions of one real variable
has a subspace of functions satisfying the restriction
.
- Example 2.8
Being vector spaces themselves, subspaces must satisfy the closure conditions. The set
is not a subspace of the vector space
because with the inherited operations it is not closed under scalar multiplication: if
then
.
The next result says that Example 2.8 is prototypical. The only way that a subset can fail to be a subspace (if it is nonempty and the inherited operations are used) is if it isn't closed.
- Lemma 2.9
For a nonempty subset S of a vector space, under the inherited operations, the following are equivalent statements.[1]
- S is a subspace of that vector space
- S is closed under linear combinations of pairs of vectors: for any vectors
and scalars r1,r2 the vector
is in S - S is closed under linear combinations of any number of vectors: for any vectors
and scalars
the vector
is in S.
Briefly, the way that a subset gets to be a subspace is by being closed under linear combinations.
- Proof
"The following are equivalent" means that each pair of statements are equivalent.
We will show this equivalence by establishing that
. This strategy is suggested by noticing that
and
are easy and so we need only argue the single implication
.
For that argument, assume that S is a nonempty subset of a vector space V and that S is closed under combinations of pairs of vectors. We will show that S is a vector space by checking the conditions.
The first item in the vector space definition has five conditions. First, for closure under addition, if
then
, as
. Second, for any
, because addition is inherited from V, the sum
in S equals the sum
in V, and that equals the sum
in V (because V is a vector space, its addition is commutative), and that in turn equals the sum
in S. The argument for the third condition is similar to that for the second. For the fourth, consider the zero vector of V and note that closure of S under linear combinations of pairs of vectors gives that (where
is any member of the nonempty set S)
is in S; showing that
acts under the inherited operations as the additive identity of S is easy. The fifth condition is satisfied because for any
, closure under linear combinations shows that the vector
is in S; showing that it is the additive inverse of
under the inherited operations is routine.
The checks for item 2 are similar and are saved for Problem 14.
We usually show that a subset is a subspace with
.
- Remark 2.10
At the start of this chapter we introduced vector spaces as collections in which linear combinations are "sensible". The above result speaks to this.
The vector space definition has ten conditions but eight of them— the conditions not about closure— simply ensure that referring to the operations as an "addition" and a "scalar multiplication" is sensible. The proof above checks that these eight are inherited from the surrounding vector space provided that the nonempty set S satisfies Lemma 2.9's statement (2) (e.g., commutativity of addition in S follows right from commutativity of addition in V). So, in this context, this meaning of "sensible" is automatically satisfied.
In assuring us that this first meaning of the word is met, the result draws our attention to the second meaning of "sensible". It has to do with the two remaining conditions, the closure conditions. Above, the two separate closure conditions inherent in statement (1) are combined in statement (2) into the single condition of closure under all linear combinations of two vectors, which is then extended in statement (3) to closure under combinations of any number of vectors. The latter two statements say that we can always make sense of an expression like
, without restrictions on the r's— such expressions are "sensible" in that the vector described is defined and is in the set S.
This second meaning suggests that a good way to think of a vector space is as a collection of unrestricted linear combinations. The next two examples take some spaces and describe them in this way. That is, in these examples we parametrize, just as we did in Chapter One to describe the solution set of a homogeneous linear system.
- Example 2.11
This subset of 
is a subspace under the usual addition and scalar multiplication operations of column vectors (the check that it is nonempty and closed under linear combinations of two vectors is just like the one in Example 2.2). To parametrize, we can take x − 2y + z = 0 to be a one-equation linear system and expressing the leading variable in terms of the free variables x = 2y − z.
Now the subspace is described as the collection of unrestricted linear combinations of those two vectors. Of course, in either description, this is a plane through the origin.
- Example 2.12
This is a subspace of the
matrices
(checking that it is nonempty and closed under linear combinations is easy). To parametrize, express the condition as a = − b − c.
As above, we've described the subspace as a collection of unrestricted linear combinations (by coincidence, also of two elements).
Parametrization is an easy technique, but it is important. We shall use it often.
- Definition 2.13
The span(or linear closure) of a nonempty subset S of a vector space is the set of all linear combinations of vectors from S.
The span of the empty subset of a vector space is the trivial subspace.
No notation for the span is completely standard. The square brackets used here are common, but so are "span(S)" and "sp(S)".
- Remark 2.14
In Chapter One, after we showed that the solution set of a homogeneous linear system can be written as
, we described that as the set "generated" by the
's. We now have the technical term; we call that the "span" of the set
.
Recall also the discussion of the "tricky point" in that proof. The span of the empty set is defined to be the set
because we follow the convention that a linear combination of no vectors sums to
. Besides, defining the empty set's span to be the trivial subspace is a convienence in that it keeps results like the next one from having annoying exceptional cases.
- Lemma 2.15
In a vector space, the span of any subset is a subspace.
- Proof
Call the subset S. If S is empty then by definition its span is the trivial subspace. If S is not empty then by Lemma 2.9 we need only check that the span [S] is closed under linear combinations. For a pair of vectors from that span,
and
, a linear combination
(p, r scalars) is a linear combination of elements of S and so is in [S] (possibly some of the
's forming
equal some of the
's from
, but it does not matter).
The converse of the lemma holds: any subspace is the span of some set, because a subspace is obviously the span of the set of its members. Thus a subset of a vector space is a subspace if and only if it is a span. This fits the intuition that a good way to think of a vector space is as a collection in which linear combinations are sensible.
Taken together, Lemma 2.9 and Lemma 2.15 show that the span of a subset S of a vector space is the smallest subspace containing all the members of S.
- Example 2.16
In any vector space V, for any vector
, the set
is a subspace of V. For instance, for any vector
, the line through the origin containing that vector,
is a subspace of
. This is true even when
is the zero vector, in which case the subspace is the degenerate line, the trivial subspace.
- Example 2.17
The span of this set is all of
.
To check this we must show that any member of
is a linear combination of these two vectors. So we ask: for which vectors (with real components x and y) are there scalars c1 and c2 such that this holds?
Gauss' method
with back substitution gives c2 = (x − y) / 2 and c1 = (x + y) / 2. These two equations show that for any x and y that we start with, there are appropriate coefficients c1 and c2 making the above vector equation true. For instance, for x = 1 and y = 2 the coefficients c2 = − 1 / 2 and c1 = 3 / 2 will do. That is, any vector in
can be written as a linear combination of the two given vectors.
Since spans are subspaces, and we know that a good way to understand a subspace is to parametrize its description, we can try to understand a set's span in that way.
- Example 2.18
Consider, in
, the span of the set {3x − x2,2x}. By the definition of span, it is the set of unrestricted linear combinations of the two
. Clearly polynomials in this span must have a constant term of zero. Is that necessary condition also sufficient?
We are asking: for which members a2x2 + a1x + a0 of
are there c1 and c2 such that a2x2 + a1x + a0 = c1(3x − x2) + c2(2x)? Since polynomials are equal if and only if their coefficients are equal, we are looking for conditions on a2, a1, and a0 satisfying these.
Gauss' method gives that c1 = − a2, c2 = (3 / 2)a2 + (1 / 2)a1, and 0 = a0. Thus the only condition on polynomials in the span is the condition that we knew of— as long as a0 = 0, we can give appropriate coefficients c1 and c2 to describe the polynomial a0 + a1x + a2x2 as in the span. For instance, for the polynomial 0 − 4x + 3x2, the coefficients c1 = − 3 and c2 = 5 / 2 will do. So the span of the given set is
.
This shows, incidentally, that the set {x,x2} also spans this subspace. A space can have more than one spanning set. Two other sets spanning this subspace are {x,x2, − x + 2x2} and
. (Naturally, we usually prefer to work with spanning sets that have only a few members.)
- Example 2.19
These are the subspaces of
that we now know of, the trivial subspace, the lines through the origin, the planes through the origin, and the whole space (of course, the picture shows only a few of the infinitely many subspaces). In the next section we will prove that
has no other type of subspaces, so in fact this picture shows them all.
The subsets are described as spans of sets, using a minimal number of members, and are shown connected to their supersets. Note that these subspaces fall naturally into levels— planes on one level, lines on another, etc.— according to how many vectors are in a minimal-sized spanning set.
So far in this chapter we have seen that to study the properties of linear combinations, the right setting is a collection that is closed under these combinations. In the first subsection we introduced such collections, vector spaces, and we saw a great variety of examples. In this subsection we saw still more spaces, ones that happen to be subspaces of others. In all of the variety we've seen a commonality. Example 2.19 above brings it out: vector spaces and subspaces are best understood as a span, and especially as a span of a small number of vectors. The next section studies spanning sets that are minimal.
[edit] Exercises
- This exercise is recommended for all readers.
- Problem 1
Which of these subsets of the vector space of
matrices are subspaces under the inherited operations? For each one that is a subspace, parametrize its description. For each that is not, give a condition that fails.
- This exercise is recommended for all readers.
- Problem 2
Is this a subspace of
:
? If it is then parametrize its description.
- This exercise is recommended for all readers.
- Problem 3
Decide if the vector lies in the span of the set, inside of the space.
,
, in 
- x − x3, {x2,2x + x2,x + x3}, in

,
, in 
- Problem 4
Which of these are members of the span [{cos 2x,sin 2x}] in the vector space of real-valued functions of one real variable?
- f(x) = 1
- f(x) = 3 + x2
- f(x) = sin x
- f(x) = cos(2x)
- This exercise is recommended for all readers.
- Problem 5
Which of these sets spans
? That is, which of these sets has the property that any three-tall vector can be expressed as a suitable linear combination of the set's elements?
- This exercise is recommended for all readers.
- Problem 6
Parametrize each subspace's description. Then express each subspace as a span.
- The subset
of the three-wide row vectors - This subset of
- This subset of
- The subset
of 
- The subset of
of quadratic polynomials p such that p(7) = 0
- This exercise is recommended for all readers.
- Problem 7
Find a set to span the given subspace of the given space. (Hint. Parametrize each.)
- the xz-plane in

in 
in 
in 
- The set
in the space 
in 
- Problem 8
- Parametrize it with
to get
.

- Parametrize the description as
to get { − 1 + x,x2 + x3}. - {1,x,x2,x3,x4}

- Problem 9
Is
a subspace of
?
- This exercise is recommended for all readers.
- Problem 10
Decide if each is a subspace of the vector space of real-valued functions of one real variable.
- The even functions
. For example, two members of this set are f1(x) = x2 and f2(x) = cos(x). - The odd functions
. Two members are f3(x) = x3 and f4(x) = sin(x).
- Problem 11
Example 2.16 says that for any vector
that is an element of a vector space V, the set
is a subspace of V. (This is of course, simply the span of the singleton set
.) Must any such subspace be a proper subspace, or can it be improper?
- Problem 12
An example following the definition of a vector space shows that the solution set of a homogeneous linear system is a vector space. In the terminology of this subsection, it is a subspace of
where the system has n variables. What about a non-homogeneous linear system; do its solutions form a subspace (under the inherited operations)?
- Problem 13
Example 2.19 shows that
has infinitely many subspaces. Does every nontrivial space have infinitely many subspaces?
- Problem 14
Finish the proof of Lemma 2.9.
- Problem 15
Show that each vector space has only one trivial subspace.
- This exercise is recommended for all readers.
- Problem 16
Show that for any subset S of a vector space, the span of the span equals the span [[S]] = [S]. (Hint. Members of [S] are linear combinations of members of S. Members of [[S]] are linear combinations of linear combinations of members of S.)
- Problem 17
All of the subspaces that we've seen use zero in their description in some way. For example, the subspace in Example 2.3 consists of all the vectors from
with a second component of zero. In contrast, the collection of vectors from
with a second component of one does not form a subspace (it is not closed under scalar multiplication). Another example is Example 2.2, where the condition on the vectors is that the three components add to zero. If the condition were that the three components add to one then it would not be a subspace (again, it would fail to be closed). This exercise shows that a reliance on zero is not strictly necessary. Consider the set
under these operations.
- Show that it is not a subspace of
. (Hint. See Example 2.5). - Show that it is a vector space. Note that by the prior item, Lemma 2.9 can not apply.
- Show that any subspace of
must pass through the origin, and so any subspace of
must involve zero in its description. Does the converse hold? Does any subset of
that contains the origin become a subspace when given the inherited operations?
- Problem 18
We can give a justification for the convention that the sum of zero-many vectors equals the zero vector. Consider this sum of three vectors
.
- What is the difference between this sum of three vectors and the sum of the first two of these three?
- What is the difference between the prior sum and the sum of just the first one vector?
- What should be the difference between the prior sum of one vector and the sum of no vectors?
- So what should be the definition of the sum of no vectors?
- Problem 19
Is a space determined by its subspaces? That is, if two vector spaces have the same subspaces, must the two be equal?
- Problem 20
- Give a set that is closed under scalar multiplication but not addition.
- Give a set closed under addition but not scalar multiplication.
- Give a set closed under neither.
- Problem 21
Show that the span of a set of vectors does not depend on the order in which the vectors are listed in that set.
- Problem 22
Which trivial subspace is the span of the empty set? Is it
or some other subspace?
- Problem 23
Show that if a vector is in the span of a set then adding that vector to the set won't make the span any bigger. Is that also "only if"?
- This exercise is recommended for all readers.
- Problem 24
Subspaces are subsets and so we naturally consider how "is a subspace of" interacts with the usual set operations.
- If A,B are subspaces of a vector space, must
be a subspace? Always? Sometimes? Never? - Must
be a subspace? - If A is a subspace, must its complement be a subspace?
(Hint. Try some test subspaces from Example 2.19.)
- This exercise is recommended for all readers.
- Problem 25
Does the span of a set depend on the enclosing space? That is, if W is a subspace of V and S is a subset of W (and so also a subset of V), might the span of S in W differ from the span of S in V?
- Problem 26
Is the relation "is a subspace of" transitive? That is, if V is a subspace of W and W is a subspace of X, must V be a subspace of X?
- This exercise is recommended for all readers.
- Problem 27
Because "span of" is an operation on sets we naturally consider how it interacts with the usual set operations.
- If
are subsets of a vector space, is
? Always? Sometimes? Never? - If S,T are subsets of a vector space, is
? - If S,T are subsets of a vector space, is
? - Is the span of the complement equal to the complement of the span?
- Problem 28
Reprove Lemma 2.15 without doing the empty set separately.
- Problem 29
Find a structure that is closed under linear combinations, and yet is not a vector space. (Remark. This is a bit of a trick question.)
This page may need to be 



and scalars
the vector
is in 




![[S] =\{ c_1\vec{s}_1+\cdots+c_n\vec{s}_n
\,\big|\, c_1,\ldots, c_n\in\mathbb{R}
\text{ and } \vec{s}_1,\ldots,\vec{s}_n\in S \}](http://upload.wikimedia.org/wikibooks/en/math/a/d/8/ad80571b726941bfa224bc2c2026bef6.png)



![\begin{array}{rcl}
\begin{array}{*{2}{rc}r}
c_1 &+ &c_2 &= &x \\
c_1 &- &c_2 &= &y
\end{array}
&\xrightarrow[]{-\rho_1+\rho_2}
&\begin{array}{*{2}{rc}r}
c_1 &+ &c_2 &= &x \\
& &-2c_2 &= &-x+y
\end{array}
\end{array}](http://upload.wikimedia.org/wikibooks/en/math/e/a/a/eaaaaf4817157fddebb7b218473bb153.png)





,
, in 
,
, in 





of the three-wide row vectors

of
in
in 
in
in the space 
to get 
. For example, two members of this set are
. Two members are 


be a subspace? Always? Sometimes? Never?
be a subspace?
are subsets of a vector space, is
? Always? Sometimes? Never?
?
?