Jump to content

Sum of subspaces – "Math for Non-Geeks"

From Wikibooks, open books for an open world

In this article, we define the sum of two subspaces. This sum will again be a subspace, containing the two initial subspaces. We can think of the sum as a structure-preserving union.

What is the sum of subspaces?

[edit | edit source]

Consider two subspaces U and W of a vector space V. Now we want to combine these subspaces into a larger subspace that contains U and W. A first approach could be to consider U∪W. However, we have already seen in the article union and intersection of vector spaces that the union is generally not a subspace.

Why is that the case? For u∈U and w∈W, the vector u+w is not always in U∪W, as you can see from this example.

Union of two lines in two-dimensional space
Union of two lines in two-dimensional space

In order to solve the problem, we add all sums of the form u+w with u∈U and w∈W to the union of the two subspaces U and W. That means, we consider U∪W∪{u+w∣u∈U,w∈W}. This expression still seems very complicated, but we can simplify it to {u+w∣u∈U,w∈W}.

Question: Why is U∪W∪{u+w∣u∈U,w∈W}={u+w∣u∈U,w∈W}?

Since U and W are subspace, the vector 0 is contained in both subspaces. Therefore, the following applies to allw∈W : w=w+0∈{u+w∣u∈U,w∈W} Therefore, W⊆{u+w∣u∈U,w∈W}. Analogously, we get U⊆{u+w∣u∈U,w∈W}.

We call this set the sum of U and W because it consists of the sums of vectors from U and W. Later we will show that this is a subspace.

Definition

[edit | edit source]
Definition (Sum of two subspaces)

Let U and W be two subspaces of a vector space V. Then we define the sum of U and W as U+W:={u+w∈V∣u∈U,w∈W}.

The sum is a subspace

[edit | edit source]

We still have to prove that U+W is a subspace.

Theorem (The sum is a subspace)

The sum U+W:={u+w∈V∣u∈U,w∈W} is a subspace of V.

How to get to the proof? (The sum is a subspace)

We need to check the subspace criterion. To do so, we utilise the fact that all vectors v∈U+W can be written as v=u+w with u∈U and w∈W. We can then trace the conditions of the subspace criterion back to the respective properties of U and W.

Proof (The sum is a subspace)

Proof step: 0∈U+W

Since U and W are subspaces, we have 0∈U and 0∈W. Thus, 0=0+0∈U+W.

Proof step: U+W is closed with respect to addition

Let x,y∈U+W. We must show that x+y∈U+W. According to the definition of U+W, there exist u1,u2∈U and w1,w2∈W, such that x=u1+w1 and y=u2+w2. We know that U and W are subspaces and therefore closed with respect to addition. Hence, x+y=(u1+w1)+(u2+w2)=(u1+u2)⏟∈U+(w1+w2)⏟∈W∈U+W.

Proof step: U+W is closed with respect to scalar multiplication

Let v∈U+W and λ∈K. We must show that λv∈U+W. According to the definition of U+W, there exist u∈U and w∈W, such that v=u+w. Since U and W are closed with respect to scalar multiplication, we have λv=λ(u+w)=λu⏟∈U+λw⏟∈W∈U+W.

Examples

[edit | edit source]

Sum of two lines in R2

[edit | edit source]
The lines U and W

We consider the following two lines in ℝ2: U:={(x0)∣x∈ℝ} and W:={(xx)∣x∈ℝ} So U is the x-axis and W is the line that runs through the origin and the point (1,1). What is the sum U+W?

Using the definition U+W={u+w∣u∈U,w∈W} we can calculate a convenient set description for U+W:

U+W={(x0)∣x∈ℝ}+{(xx)∣x∈ℝ}={(x0)∣x∈ℝ}+{(yy)∣y∈ℝ}={(x0)+(yy)∣x,y∈ℝ}={(x+yy)∣x,y∈ℝ}

We can write each vector in ℝ2 as (x+y,y)T with matching x,y∈ℝ. Specifically, for each vector (a,b)T∈ℝ2 we can find scalars x and y∈ℝ such that (a,b)=(x+y,y), namely x:=a−b and y:=b. Therefore, U+W=ℝ2 holds.

Intuitively, you can immediately see that U+W=ℝ2. This is because U+W is a subspace of ℝ2, which contains the straight lines U and W. The only subspaces of ℝ2 are the null space, lines that run through the origin and ℝ2. As the straight lines U and W do not coincide but are different, U+W cannot be a line. Therefore, we must have U+W=ℝ2.

Sum of two lines in R3

[edit | edit source]
The lines U and W

Consider the following lines in ℝ3:

U:={(xx2x)∣x∈ℝ} and W:={(3x05x)∣x∈ℝ}

Here U is the line in ℝ3 that runs through the origin and the point (1,1,2) and W is the line that runs through the origin and (3,0,5). We want to determine the sum U+W={u+w∣u∈U,w∈W}.

U+W={(xx2x)∣x∈ℝ}+{(3y05y)∣y∈ℝ}={(xx2x)+(3y05y)∣x,y∈ℝ}={x(112)+y(305)∣x,y∈ℝ}

So U+W is the plane that is spanned by the vectors (1,1,2)T and (3,0,5)T.

Sum of two planes in R3

[edit | edit source]
The planes U1 and W

Consider the following two planes: U1={(2xxy)∣x,y∈ℝ} and W={(02x−y)∣x,y∈ℝ}

The planes are not equal. We can see this, for example, from the fact that the vector (2,1,0)T lies in U1, but not in W. Therefore, the two planes should intuitively span the entire space ℝ3. So we can initially assume that U1+W=ℝ3.

We now try to prove this assumption. To do so, we have to show that each vector (a,b,c)T∈ℝ3 lies in the sum U1+W={u+w∣u∈U1,w∈W}. We must therefore find vectors (a,b,c)T for u∈U1 and w∈W such that (a,b,c)T=u+w. Then (a,b,c)T∈U1+W applies. Here we can use the definitions of U1 and W: Each vector u∈U1 can be written as (2x1,x1,y1)T with x1,y1∈ℝ. Similarly, each vector w∈W can be written as (0,2x2,−y2)T with x2,y2∈ℝ. So we want to find numbers x1,y1,x2,y2∈ℝ for the vector (a,b,c)T∈ℝ3 satisfying

(abc)=(2x1x1y1)+(02x2−y2).

We can re-write this as

(abc)=(2x1+0x1+2x2y1−y2)=(2x1x1+2x2y1−y2).

How can we choose x1,y1,x2,y2∈ℝ such that the above equation is satisfied? For instance,

x1:=12ay1:=cx2:=12b−14ay2:=0

will do this job.

To summarise, the following applies to any vector (a,b,c)T∈ℝ3:

(abc)=(2(12a)12ac)⏟∈U1+(02(12b−14a)−0)⏟∈W∈U1+W

Therefore, U1+W=ℝ3 indeed holds, i.e. the two planes together span the entire ℝ3.

Absorption property of the sum

[edit | edit source]
The line U2 and the plane W

We have already looked at a few examples of sums in the space ℝ3. Now let's look at another example in ℝ3. Let

U2={(0x2x)∣x∈ℝ}andW={(0yz)∣y,z∈ℝ}

Then U2 is the line that runs through the origin and through the point (0,1,2). The subspace W is the y,z-plane.

What is the sum of the subspaces U2+W? The line U2 lies in the y,z-plane, i.e. in W. The sum is intuitively the subspace consisting of U2 and W. Since U2 is already contained in W, the sum should simply be W, i.e. U2+W=W. This is indeed the case, as the exercise below shows.

Intuitively, this should also apply more generally: Let U and W be two subspaces of an arbitrary vector space V. If U lies in W, i.e. U⊆W, then the sum U+W should simply result in W. This is called the absorption property, as U is absorbed by W when taking the sum. We prove it in the following exercise.

Exercise (Absorption property of the sum)

Let V be a K-vector space, as well as U and W two subspaces of V. Whenever U⊆W, then it follows that U+W=W.

Solution (Absorption property of the sum)

We assume that U⊆W applies and prove that U+W=W. To show this equality, we prove the two inclusions W⊆U+W and U+W⊆W.

Proof step: W⊆U+W

Let w∈W. Then, w=0⏟∈U+w⏟∈W∈U+W.

Proof step: U+W⊆W

Let v∈U+W. Then there are vectors u∈U and w∈W, such that v=u+w. Since U⊆W we have u∈W. We know that W is a subspace and therefore closed under addition. Furthermore, u,w∈W. Thus, we get v=u+w∈W.

Hint

From the absorption property, we conclude U+U=U for any subspace U. This is because every subspace is contained within itself, i.e., U⊆U.

Alternative definitions

[edit | edit source]

Using the intersection

[edit | edit source]

We have constructed a subspace U+W of V, which contains the two subspaces U and W. Since we have included only "necessary" vectors in our construction of U+W, this sum U+W should be the smallest subspace that contains both U and W.

We can also describe the smallest subspace containing U and W differently: We first consider all subspaces that contain U and W and then take the intersection of these subspaces. This intersection still contains U and W and is also a subspace, since the intersection of any number of subspaces is again a subspace. Intuitively, there should be no smaller subspace with this property. Thus, we also obtain the smallest subspace that contains both U and W. According to these considerations, it should therefore be the case that U+W is equal to the intersection of all subspaces containing U and W. We now want to prove this:

Theorem (Definition of the sum over the intersection of subspaces)

Let V be a vector space, as well as U and W two subspaces of V. For S:=⋂U∪W⊆ZZ subspaceZ gilt: S=U+W

Proof (Definition of the sum over the intersection of subspaces)

We prove the two inclusions S⊆U+W and S⊇U+W.

Proof step: ⊆

It is sufficient to show that U+W is a subspace that contains U∪W. Then it follows from the definition of S that S=⋂U∪W⊆ZZ subspaceZ⊆U+W. We first show that U is contained in U+W. Then, W being contained in U+W will follow analogously. So let u∈U. Since W is a subspace, 0∈W. Therefore, u=u+0∈U+W.

Proof step: ⊇

We must show that every subspace Z of V that contains both U and W must also contain U+W.

Let Z be such a subspace. Let v∈U+W. Then there exist u∈U and w∈W with v=u+w.

In particular, u,w∈Z applies. Since Z is a subspace, v=u+w∈Z holds.

We have thus shown: U+W⊆Z.

This renders us the two alternative definitions:

Definition (Definition of the sum of subspaces via the intersection)

Let V be a vector space, as well as U and W two subspaces of V. Then the sum of U and W is given by U+W=⋂U∪W⊆ZZ subspaceZ.

Using the span

[edit | edit source]

We can describe the smallest subspace containing U and W or U∪W in yet a third way. In the article "span", we saw that for a given subset M of V, the span of M is the smallest subspace containing M. Therefore, span⁡(U∪W) is the smallest subspace that contains U and W. So it must also be equal to the sum U+W.

Theorem (Definition via the span)

Let V be a vector space, as well as U and W two subspaces of V. Then, U+W=span⁡(U∪W)

Proof (Definition via the span)

We show the two inclusions U+W⊆span⁡(U∪W) and U+W⊇span⁡(U∪W).

Proof step: ⊆

Let v∈U+W. Then there exist u∈U and w∈W with v=u+w. Because the span of U∪W consists of linear combinations of vectors from U and W, we indeed have v=u+w∈span⁡(U∪W).

Proof step: ⊇

we have seen that span⁡(U∪W) is the smallest subspace that contains U∪W. Since U+W is a subspace of V that contains U∪W, we finally obtain span⁡(U∪W)⊆U+W.

Dimension formula

[edit | edit source]

Now that we know what the sum of two subspaces U and W of a vector space V is, we can ask ourselves how large the sum U+W is. The sum of subspaces is the vector space analogue of the union of sets. For two sets X and Y, the union X∪Y has a maximum of |X|+|Y| elements. If X and Y share elements, i.e. have a non-empty intersection, then X∪Y has fewer than |X|+|Y| elements, because we count the elements from X∩Y twice. This gives us the formula |X∪Y|+|X∩Y|=|X|+|Y|. In order to transfer this formula to vector spaces, we need the correct concept of the size of a vector space, i.e. the analogue for the cardinality of a set for vector spaces. This is exactly the idea of the dimension of a vector space. Therefore, if an analogue formula holds for vector spaces, the following should be true: dim⁡(U+W)+dim⁡(U∩W)=dim⁡(U)+dim⁡(W). If dim⁡(U∩W) is finite, we can convert this formula to a formula for dim⁡(U+W), namely dim⁡(U+W)=dim⁡(U)+dim⁡(W)−dim⁡(U∩W).

Before we prove our assumption, we will test it with a few examples:

The lines U and W

Let us reconsider the two lines from the example above:

U:={(x0)∣x∈ℝ} and W:={(xx)∣x∈ℝ}

We have already calculated above that U+W=ℝ2. This fits our assumption: ℝ2 is two-dimensional, U and W are one-dimensional and the intersection U∩W={0} is zero-dimensional.

The planes U1 and W

Let us look again at the example above with the two planes:

U1={(2xxy)∣x,y∈ℝ} and W={(02x−y)∣x,y∈ℝ}

We have already calculated above that U1+W=ℝ3 and the figure shows that U1 and W intersect in a straight line. This means that the dimension of U1+W is three, the dimension of U1 and W are both two and the dimension of U1∩W is just one. So the dimension formula also holds in this case.

As a final example, we consider the subspace U=ℝ3 in V=ℝ3 and W={(x0x);x∈ℝ}

The subspace W is a line through the origin, i.e. dim⁡(W)=1 and we have dim⁡(U)=dim⁡(ℝ3==3. Because U⊆W, the Absorption property of the sum tells us that U+W=U=ℝ3. For the same reason, we have U∩W=W. Thus, dim⁡(U+W)=3=3+1−1=dim⁡(U)+dim⁡(W)−dim⁡(U∩W). So the dimension formula is also valid in this case.

Theorem (Dimension formula)

Let V be a finite-dimensional K-vector space, as well as U and W two subspaces of V. Then,

dim⁡(U+W)=dim⁡(U)+dim⁡(W)−dim⁡(U∩W).
How to get to the proof? (Dimension formula)

The motivation for our formula comes from the world of finite sets. Therefore, we would also like to trace the proof back to the case of (finite) sets. The structure of a vector space can be reduced to its basis, which is indeed a finite set. The cardinality of a basis is exactly the dimension of the vector space, so we can trace the dimension formula back to a statement about the cardinality of (finite) basis sets. To do so, we have to choose suitable bases BU,BW,BU∩W of U, W and U∩W for which BU∩BW=BU∩W. In this case, we obtain from the number-of-elements-formula for sets that BU∪BW has the desired size. Then we just have to prove that BU∪BW is a basis of U+W. We do this by reducing everything to the fact that BU and BW are already bases of U and W.

To construct the desired bases BU,BW and BU∩W, we use the basis completion theorem. With this we can extend a basis of U∩W to one of U and one of W.

Proof (Dimension formula)

Let now n=dim⁡(U),m=dim⁡(W) and k=dim⁡(U∩W). Then there is a basis {v1,…,vk} of U∩W. We can extend it to a basis BU:={v1,…,vk,uk+1,…,un} of U, as well as to a basis BW:={v1,…,vk,wk+1,…,wm} of W.

We now show that B:={v1,…,vk,uk+1,…,un,wk+1,…,wm} is a basis of U+W.

Proof step: B is a generating system

Since according to the previous theorem we have U+W=span⁡(U∪W)=span⁡(BU∪BW)=span⁡(B) , we know that B is a generating system of U+W.

Proof step: B is linearly independent

Let αi,βj,γl∈K with i∈{1,…k},j∈{k+1,…,n} and l∈{k+1,…,m} such that

∑i=1kαivi+∑j=k+1nβjuj+∑l=k+1mγlwl=0.

We can re-write this as

∑i=1kαivi+∑j=k+1nβjuj⏟∈U=−∑l=k+1mγlwl⏟∈W∈U∩W.

Since {v1,…,vk} is a basis of U∩W, we can write the above element as a linear combination of these basis vectors:

∑i=1kαivi+∑j=k+1nβjuj=∑i=1kα'ivi

This is equivalent to

∑i=1k(αi−α′)ivi+∑j=k+1nβjuj=0

Since BU={v1,…,vk,uk+1,…,un} is a basis of U, it follows that βj=0 for all j=k+1,…,n and thus we get αi−α'i=0 for all i=1,…,k.

Plugging βj=0 into our first equation, we then get

∑i=1kαivi+∑l=k+1mγlwl=0.

This is a linear combination of the basis vectors from BW, so αi=0 must also apply for all i=1,…,k and γl=0 for all l=k+1,…,m. Hence B is linearly independent.

Since B is a basis of U+W , we have dim⁡(U+W)=|B|=k+(n−k)+(m−k)=n+m−k=|BU|+|BW|−|{v1,…,vk}|=dim⁡(U)+dim⁡(W)−dim⁡(U∩W).

Warning

The formula from the above theorem cannot be used for infinite-dimensional vector spaces. The reason is that there is no unique, meaningful way to subtract infinity from infinity. To illustrate this problem, consider the sets U={0,1,2,…} and W={1,2,…}. Then U∩W=W and thus |U|+|W|−|U∩W|=∞+∞−∞, which makes mathematically no sense. The same can happen with vector spaces: For example, we can consider U=k[X] and W={f∈k[X]∣deg⁡f≥1} in V=k[X]. Again, U∩W=W and we have dim⁡(U)+dim⁡(W)−dim⁡(U∩W)=∞+∞−∞.

However, if we move the term with the intersection to the other side of the equation, then the formula makes sense also for infinite-dimensional vector spaces. This means that for any subspaces U and W of a vector space V, we have

dim⁡(U+W)+dim⁡(U∩W)=dim⁡(U)+dim⁡(W).

For this formula to also make sense in infinite dimensions, we require ∞+∞=∞, which is a mathematically meaningful and true statement.