Functional Analysis/Hilbert spaces
From Wikibooks, the open-content textbooks collection
| ←Chapter 2: Banach spaces | Functional Analysis Chapter 3: Hilbert spaces |
Chapter 4: Geometry of Banach spaces→ |
A normed space is called a pre-Hilbert space if for each pair (x,y) of elements in the space there is a unique complex (or real) number called an inner product of x and y, denoted by
, subject to the following conditions:
- (i) The functional
is linear. - (ii)

- (iii)
for every nonzero x
The inner product in its second variable is not linear but antilinear: i.e., if
, then
for scalars α. We define
and this becomes a norm. Indeed, it is clear that
and (iii) is the reason that
implies that x = 0. Finally, the triangular inequality follows from the next lemma.
3.1 Lemma (Schwarz's inequality)
where the equality holds if and only if we can write x = λy for some scalar λ.
If we assume the lemma for a moment, it follows:
since
for any complex number α
Proof of Lemma: First suppose
. If
, it then follows:
where the equation becomes 0 if and only if x = λy. Since we may suppose that
, the general case follows easily. 
3.2 Theorem A normed linear space is a pre-Hilbert space if and only if
.
Proof: The direct part is clear. To show the converse, we define
.
It is then immediate that
,
and
. Moreover, since the calculation:
-


,
we have:
. If α is a real scalar and αj is a sequence of rational numbers converging to α, then by continuity and the above, we get: 
3.3 Lemma Let
be a pre-Hilbert. Then
in norm if and only if for any
and
as
.
Proof: The direct part holds since:
as
.
Conversely, we have:
as 

3.4 Lemma Let D be a non-empty convex closed subset of a Hilbert space. Then D admits a unique element z such that
.
Proof: By δ denote the right-hand side. Since D is nonempty, δ > 0. For each n = 1,2,..., there is some
such that
. That is,
. Since D is convex,
and so
.
It follows:
![]() |
![]() |
![]() |
|
as ![]() |
This is to say, xn is Cauchy. Since D is a closed subset of a complete metric space, whence it is complete, there is a limit
with
. The uniqueness follows since if
we have
where the right side is
for the same reason as before. 
The lemma may hold for a certain Banach space that is not a Hilbert space; this question will be investigated in the next chapter.
For a nonempty subset
, define
to be the intersection of the kernel of the linear functional
taken all over
. (In other words,
is the set of all
that is orthogonal to every
.) Since the kernel of a continuos function is closed and the intersection of linear spaces is again a linear space,
is a closed (linear) subspace of
. Finally, if
, then
and x = 0.
3.5 Lemma Let
be a linear subspace of a pre-Hilbert space. Then
if and only if
.
Proof: The Schwarz inequality says the inequality
is actually equality if and only if z and z + w are linear dependent.
(TODO: the proof isn't quite well written.)
3.6 Theorem (orthogonal decomposition) Let
be a Hilbert space and
be a closed subspace. For every
we can write
- x = y + z
where
and
, and y and z are uniquely determined by x.
Proof: Clearly
is convex, and it is also closed since a translation of closed set is again closed. Lemma 3.4 now gives a unique element
such that
. Let z = x − y. By Lemma 3.5,
. For the uniqueness, suppose we have written:
- x = y' + z'
where
and
. By Lemma 3.5,
. But, as noted early, such y' must be unique; i.e., y' = y. 
3.7 Corollary Let
be a subspace of a Hilbert space
. Then
- (i)
if and only if
is dense in
. - (ii)
.
Proof: By continuity,
. (Here,
denotes the image of the set E under the map
.) This gives:
and so 
by the orthogonal decomposition. (i) follows. Similarly, we have:
.
Hence, (ii). 
3.8 Theorem (representation theorem) Every continuous linear functional f on a Hilbert space
has the form:
with a unique
and 
Proof: Let
. Since f is continuous,
is closed. If
, then take y = 0. If not, by Corollary 3.6, there is a nonzero
orthogonal to
. By replacing z with
we may suppose that
. For any
, since zf(x) − f(z)x is in the kernel of f and thus is orthogonal to z, we have:
and so:
The uniqueness follows since
for all
means that
. Finally, we have the identity:
where the last inequality is Schwarz's inequality. 
3.9 Exercise Using Lemma 1.6 give an alternative proof of the preceding theorem.
In view of Theorem 3.5, for each
, we can write: x = y + z where
, a closed subspace of
, and
. Denote each y, which is uniquely determined by x, by π(x). The function π then turns out to be a linear operator. Indeed, for given
, we write:
- x1 = y1 + z1,x2 = y2 + z2 and x1 + x2 = y3 + z3
where
and
for j = 1,2,3. By the uniqueness of decomposition
- π(x1) + π(x2) = y1 + y2 = y3 = π(x1 + x2).
The similar reasoning shows that π commutes with scalars. Now, for
(where
and
), we have:
That is, π is continuous with
. In particular, when
is a nonzero space, there is
with π(x0) = x0 and
and consequently
. Such π is called an orthogonal projection (onto
).
The next theorem gives an alternative proof of the Hahn-Banach theorem.
3 Theorem Let
be a linear (not necessarily closed) subspace of a Hilbert space. Every continuous linear functional on
can be extended to a unique continuous linear functional on
that has the same norm and vanishes on
.
Proof: Since
is a dense subset of a Banach space
, by Theorem 2.something, we can uniquely extend f so that it is continuous on
. Define
. By the same argument used in the proof of Theorem 2.something (Hahn-Banach) and the fact that
, we obtain
. Since g = 0 on
, it remains to show the uniqueness. For this, let h be another extension with the desired properties. Since the kernel of f − h is closed and thus contain
, f = h on
. Hence, for any
,
.
The extension g is thus unique. 
3 Theorem Let
be an increasing sequence of closed subspaces, and
be the closure of
. If
is an orthogonal projection onto
, then for every
.
Proof: Let
. Then
is closed. Indeed, if
and
, then
and so
. Since
, the proof is complete. 
Let
be Hilbert spaces. The direct sum of
is defined as follows: let
and define
.
It is then easy to verify that
is a Hilbert space. It is also clear that this definition generalizes to a finite direct sum of Hilbert spaces. (For an infinite direct sum of Hilbert spaces, see Chapter 5.)
Recall from the previous chapter that an isometric surjection between Banach spaces is called "unitary".
3 Lemma (Hilbert adjoint) Define
by
. (Clearly, V is a unitary operator.) Then
is a graph (of some linear operator) if and only if T is densely defined.
Proof: Set
. Let
. Then
for every v.
That is to say,
, which is a graph of a linear operator by assumption. Thus, u = 0. For the converse, suppose
. Then
(j = 1,2)
and so
for every v in the domain of T, dense. Thus, u1 = u2, and
is a graph of a function, say, S. The linear of S can be checked in the similar manner.
Remark: In the proof of the lemma, the linear of T was never used.
For a densely defined T, we thus obtained a linear operator which we call T * . It is characterized uniquely by:
for every u,
or, more commonly,
for every u.
Furthermore, T * f is defined if and only if
is continuous for every
. The operator T * is called the Hilbert adjoint (or just adjoint) of T. If T is closed in addition to having dense domain, then
Here,
. By the above lemma, T * is densely defined. More generally, if a densely defined operator T has a closed extension S (i.e.,
), then S and S * are both densely defined. It follows:
. That is, T * is densely defined and T * * exists. That S = T * * follows from the next theorem.
3 Theorem Let
be a densely defined operator. If T * is also densely defined, then
for any closed extension S of T.
Proof: As above,
Here, the left-hand side is a graph of T * * . For the second identity, since
is a Hilbert space, it suffices to show
. But this follows from Lemma 3.something.
The next corollary is obvious but is important in application.
3 Corollary Let
be Hilbert spaces, and
a closed densely defined linear operator. Then
if and only if there is some K > 0 such that:
for every 
3 Lemma Let
be a densely defined linear operator. Then 
Proof: f is in either the left-hand side or the right-hand side if and only if:
for every u.
(Note that
for every u implies
.) 
In particular, a closed densely defined operator has closed kernel. As an application we shall prove the next theorem.
3 Theorem Let
be a closed densely defined linear operator. Then T is surjective if and only if there is a K > 0 such that
for every
.
Proof: Suppose T is surjective. Since T has closed range, it suffices to show the estimate for
. Let
with Tu = f. Denoting by G the inverse of T restricted to
, we have:
The last inequality holds since G is continuous by the closed graph theorem. To show the converse, let
be given. Since T * is injective, we can define a linear functional L by
for
.,
for every
.
Thus, L is continuous on the range of T * . It follows from the Hahn-Banach theorem that we may assume that L is defined and continuous on
. Thus, by Theorem 3.something, we can write
in
with some u. Since L(T * f) is continuous for
,
for every
.
Hence, Tu = T * * u = g. 
3 Corollary Let
be as given in the preceding theorem. Then
is closed if and only if
is closed.
Proof: Define
by S = T. It thus suffices to show S * is surjective when T has closed range (or equivalently S is surjective.) Suppose S * fj is convergent. The preceding theorem gives:
as
.
Thus,
is Cauchy in the graph of S * , which is closed. Hence, S * fj converges within the range of S * . The converse holds since T * * = T. 
We shall now consider some concrete examples of densely defined linear operators.
3 Theorem
is continuous if and only if T * is continuous. Moreover, when T is continuous,
.
Proof: It is clear that T * is defined everywhere, and its continuity is a consequence of the closed graph theorem. Conversely, if T * is continuous, then T * * is continuous and T = T * * . For the second part,
for every f.
Thus, T * is continuous with
. In particular, T * T is continuous, and so:
for every f.
That is to say,
. Applying this result to T * in place of T completes the proof.
The identity in the theorem shows that
is a C * -algebra, which is a topic in Chapter 6.
3 Lemma Let
. If
for
, then S = T.
Proof: Let R = T − S. We have
and
. Summing the two we get:
for
. Taking y = Rx gives
for all
or R = 0. 
Remark: the above lemma is false if the underlying field is
.
Recall that a isometric surjection is called unitary.
3 Corollary A linear operator
is unitary if and only if U * U and UU * are identities.
Proof: Since
, we see that U * U is the identity. Since UU * U = U, UU * is the identity on the range of U, which is
by surjectivity. Conversely, since
, U is an isometry. 
Curiously, the hypothesis on linearity can be omitted:
3 Theorem If
is a function such that
for every x and y and U(0) = 0, then U is a linear operator (and so unitary).
Proof: Note that U is continuous. Since
, we have:
.
Thus,
It now follows:
for any
and scalar α. 
There is an analog of this result for Banach space. See, for example, http://www.helsinki.fi/~jvaisala/mazurulam.pdf)
3 Exercise Construct an example so as to show that an isometric operator (i.e., a linear operator that preserves norm) need not be unitary. (Hint: a shift operator.)
A densely defined linear operator T is called "symmetric" if
. If the equality in the above holds, then T is called "self-adjoint". In light of Theorem 3.something, every self-adjoint is closed and densely defined. If T is symmetric, then since T * * is an extension of T,
.
3 Theorem Let
be densely defined linear operators for j = 1,2. Then
where the equality holds if
(j = 1,2) and
is closed and densely defined.
Proof: Let
. Then
for every
.
But, by definition,
denotes
. Hence,
is an extension of
. For the second part, the fact we have just proved gives:
. 
3 Theorem Let
be a Hilbert spaces. If
is a closed densely defined operator, then T * T is a self-adjoint operator (in particular, densely defined and closed.)
Proof: In light of the preceding theorem, it suffices to show that T * T is closed. Let
be a sequence such that (uj,T * Tuj) converges to limit (u,v). Since
,
there is some
such that:
. It follows from the closedness of T * that T * f = v. Since
and T is closed, T * Tu = T * f = v. 
3 Theorem Let T be a symmetric densely defined operator. If T is surjective, then T is self-adjoint and injective and T − 1 is self-adjoint and bounded.
Proof: If Tu = 0,
and u = 0
if T has a dense range (for example, it is surjective). Thus, T is injective. Since T − 1 is closed (by Lemma 2.something) and
,
is a continuous linear operator. Finally, we have:
.
Here,
, and the equality holds since the domains of T and T * coincide. Hence, T − 1 is self-adjoint. Since we have just proved that the inverse of a self-adjoint is self-adjoint, we have: (T − 1) − 1 is self-adjoint.
3 Theorem Let
be a closed linear subspace of a Hilbert space
. Then π is an orthogonal projection onto
if and only if π = π * = π2 and the range of π is
.
Proof: The direct part is clear except for π = π * . But we have:
since π(x) and x − π(x) are orthogonal. Thus, π is real and so self-adjoint then. For the converse, we only have to verify
for every x. But we have: π(x − π(x)) = 0 and
. 
We shall now turn our attention to the spectral decomposition of a compact self-adjoint operator. Let
be a compact operator.







as 















