# Real Analysis/Sequences

←Section 1 Exercises | Real AnalysisSequences |
Constructing the real numbers→ |

## Definition[edit]

Sequences occur frequently in analysis, and they appear in many contexts. While we are all familiar with sequences, it is useful to have a formal definition.

**Definition**A*sequence*of real numbers is any function*a*:**N**→**R**.

However, we usually write *a*_{n} for the image of *n* under *a*, rather than *a*(*n*). The values *a*_{n} are often called the *elements* of the sequence. To make a distinction between a sequence and one of its values it is often useful to denote the entire sequence by , or just (*a*_{n}). When specifying a particular sequence, it may be written in the form (*a*_{1}, *a*_{2}, *a*_{3}, …), where sufficiently many elements of the sequence are given so that the pattern is clear.

For example, (1, 2, 3, 4, …), (1, -2, 3, -4, …), and (1, π, π^{2}, π^{3}, π^{4}, …) are all sequences. Note, however, that there need not be any particular pattern to the elements of the sequence. For example, we may specify *a*_{n} to be the *n*-th digit of π. Often it is useful to specify a sequence recursively. That is, to specify some initial values of the sequence, and then to specify how to get the next element of the sequence from the previous elements. For example, consider the sequence *x*_{1}=1, *x*_{2}=1, and *x*_{n} = *x*_{n−1} + *x*_{n−2} for *n* ≥ 3. This sequences is known as the Fibonacci sequence, and its first few terms are given by (1, 1, 2, 3, 5, 8, 13, …). Another familiar example of a recursive sequence is Newton's method. With an initial guess *x*_{0} for the zero of a function, Newton's method tells you how to construct the next guess. In this way you generate a sequence which (hopefully) converges to the zero of the function.

Often sequences such as these are called *real sequences*, *sequences of real numbers* or *sequences in* **R** to make it clear that the elements of the sequence are real numbers. Analogous definitions can be given for sequences of natural numbers, integers, etc.

Given a sequence (*x*_{n}), a *subsequence* is a sequence , where (*n*_{j}) is strictly increasing sequence of natural numbers.

For example, taking *n*_{j}=2*j* would the subsequence consisting of every other element of the original sequence, that is (*x*_{2}, *x*_{4}, *x*_{6}, …).

We can also perform algebraic operations on sequences. In other words, we can add, subtract, multiply, divide sequences. These operations are simply performed element by element, for completeness we give the definitions.

**Definition**Given two sequences (*x*_{n}) and (*y*_{n}) and a real number*c*, we define the following operations:- (
*x*_{n})+(*y*_{n})=(*x*_{n}+*y*_{n}); - (
*x*_{n})−(*y*_{n})=(*x*_{n}−*y*_{n}); - (
*x*_{n})·(*y*_{n})=(*x*_{n}·*y*_{n}); - if
*y*_{n}≠ 0 for all*n*in**N**, (*x*_{n})/(*y*_{n})=(*x*_{n}/*y*_{n}); *c*·(*x*_{n})=(*c*·*x*_{n})

- (

## Classification of Sequences[edit]

Some properties of sequence are so important that they are given special names. A sequence (*a*_{n}) is called:

*strictly increasing*if*a*_{n}<*a*_{n+1}for all*n*in**N**;*non-decreasing*if*a*_{n}≤*a*_{n+1}for all*n*in**N**;*strictly decreasing*if*a*_{n}>*a*_{n+1}for all*n*in**N**;*non-increasing*if*a*_{n}≥*a*_{n+1}for all*n*in**N**;*monotone*if it satisfies any of the above properties, that is, if it is either non-decreasing or non-increasing;*strictly monotone*if it is either strictly increasing or strictly decreasing;*bounded above*if there exists*M*in**R**such that*a*_{n}<*M*for all*n*in**N**.*bounded below*if there exists*M*in**R**such that*a*_{n}>*M*for all*n*in**N**.*bounded*if it is both bounded above and bounded below.*Cauchy*if for all ε>0 there exists a natural number*N*so that, for all*n*,*m*>*N*, |*a*_{m}-*a*_{n}| < ε.

The term *increasing* is used in some contexts with meaning either that of strictly increasing or of non-decreasing, and similarly *decreasing* can mean the same as either strictly decreasing, or non-increasing. As a result, these terms are ambiguous and we try to avoid their use here.

## Convergence[edit]

A further important property of sequences (arguably the most important property from the perspective of analysis) is the property of convergence.

**Definition**Let (*x*_{n}) be a sequence of real numbers. The sequence (*x*_{n}) is said to*converge*to a real number*a*.- if for all ε>0, there exists
*N*in**N**such that |*x*_{n}-*a*|<ε for all*n*≥*N*.

If (*x*_{n}) converges to *a* then we say *a* is the *limit* of (*x*_{n}) and write

or

- as .

This is read *x*_{n} *approaches* *a* as *n* *approaches* ∞. If it is clear which variable is playing the role of *n* then this may be abbreviated to simply *x*_{n}→*a* or lim *x*_{n}=*a*.

If a sequence converges, then it is called *convergent*.

It is also useful to extend this concept and allow sequences whose limits are either ∞ or −∞

**Definition**We say*x*_{n}→∞ as*n*→∞ if for every*M*in**R**there is a natural number*N*so that*x*_{n}≥ M for all*n*≥*N*. We say*x*_{n}→−∞ as*n*→∞ if for every*M*in**R**there is a natural number*N*so that*x*_{n}≤ M for all*n*≥*N*.

Despite this, we do not refer to sequences such as these as convergent.

The following theorems tells us that a convergent sequence converges to exactly one number. This may seem intuitively clear, mathematically we have to prove that limits behave the way we expect. After all, we gave the definition and nothing tells us ahead of time that it is correct.

### Theorem (Uniqueness of limits)[edit]

A sequence can have at most one limit. In other words: if *x*_{n} → *a* and *x*_{n} → *b* then *a* = *b*.

##### Proof[edit]

Suppose the sequence has two distinct limits, so *a*≠*b*. Let ε=|*a*−*b*|/3.

Certainly ε>0, using the definition of convergence twice we can find natural numbers *N*_{a} and *N*_{b} so that

- for all
*n*>*N*_{a}.

and

- for all
*n*>*N*_{b}.

Taking *k*=max(*N*_{a},*N*_{b}) then both of these conditions hold for *x*_{k}. Hence we deduce that |*x*_{k}−*a*|≤ε and |*x*_{k}−*b*|≤ε. Applying the triangle inequality, we see

which is a contradiction. Thus, any sequence has at most one limit.

### Theorem (Convergent Sequences Bounded)[edit]

If is a convergent sequence, then it is bounded.

##### Proof[edit]

Let , and let ε = 1.

From the definition of convergence there exists a natural number *N* such that

- for all
*n*≥*N*.

The sequence is bounded above by *a*+1 and below by *a*−1. Let *M* = max(|*x*_{1}|,|*x*_{2}|,|*x*_{3}|,…,|*x*_{N}|, |*a*|+1). It follows that −*M* ≤ *x*_{n} ≤ *M* for all *n* in **N**. Hence the sequence is bounded.

### Theorem (Boundedness of Cauchy Sequences)[edit]

If is a Cauchy sequence, then it is bounded.

#### Proof[edit]

Let (*x*_{n}) be a Cauchy sequence. By the definition of a Cauchy sequence, there is a natural number *N* such that |*x*_{n}−*x*_{m}|<1 for all *n*,*m* > *N*. In particular, |*x*_{N+1}−*x*_{m}|<1 for all *m* > *N*. It follows by the reverse triangle inequality that |*x*_{m}| < |*x*_{N+1}| + 1. If we take *M*=max(|*x*_{1}|, |*x*_{2}|, …, |*x*_{N}|, |*x*_{N+1}| + 1), then |*x*_{n}| ≤ *M* for all *n* in **N**.

The following theorem tells us that algebraic operations on sequences commute with the taking limits. This simple theorem is a useful tool in computing limits.

### Theorem (Algebraic Operations)[edit]

If (*x*_{n}) and (*y*_{n}) are convergent sequences and *a* ∈ **R**, the following properties hold:

- .
- .
- .
- (assuming
*y*_{n}≠ 0 for all*n*in**N**and lim y_n ≠ 0). - If
*x*_{n}≤*y*_{n}for every*n*in*N*, then .

#### Proof[edit]

1. Let *x*=lim *x*_{n} and *y*=lim *y*_{n}. We need to show that for any ε>0 there is natural number *N* so that if *n*≥ *N*, then |(*x*_{n} + *y*_{n}) − (*x* + *y*)|≤ε. Given any ε>0 we have ε/3>0 so from the definition of convergence there is a natural number *N*_{x} so that |*x*_{n}−*x*|≤ε/3 for all *n*>*N*_{x}, similarly we can choose *N*_{y} |*y*_{n}−*y*|≤ε/3 for all *n*>*N*_{y}.

Let *N*=max(*N*_{x} ,*N*_{y}). If *n*>*N*, then by the triangle inequality we have

which is what we needed to show.

2. Let *x*=lim *x*_{n} and *y*=lim *y*_{n}. Since these sequences are convergent they are bounded. Let *M*_{x} be a bound for (*x*_{n}) and let *M*_{y} be a bound for (*y*_{n}). By increasing these quantities of necessary we may also assume *M*_{x} > *x* and *M*_{y} > *y*. Given ε>0, there exists some *N*_{x} and *N*_{y} such that

- for
*n*>*N*_{x}and - for
*n*>*N*_{y}.

Then for every *n* > max(*N*_{x}, *N*_{y}),

3. Let *y*_{n} = *a* for all *n* in **N**. The statement now follows from 2.

4. We can reduce this to showing that lim (1/*y*_{n}) exists and equals 1/(lim y_{n}). Then it follows by 2 that we have:

Let *y*=lim *y*_{n}. By the exercises, since y and *y*_{n} are not 0, we can find δ > 0 so that |*y*_n| > δ and |*y*| > δ. It follows that 1/|*y*_{n}*y*|<1/δ^{2}. Given ε > 0 choose *n* in **N** so that |*y*_{n} − *y*| < δ^{2}ε. We have

- .

Hence,

5. We first can reduce to the case when one sequence is identically 0. To see this let *z*_{n} = *x*_{n} − *y*_{n}. Then *z*_{n} < 0 for all *n* in **N**. Let *z* = lim *z*_{n}. Suppose that *z* > 0 then we can then find an natural number *N* so that

- .

Since *z*_{N} ≤ 0 < *z*, the absolute value equals *z* − *z*_{N}. Subtracting *z* we find that −*z*_{N} < 0. Hence *z*_{N} is positive. Contradiction. Therefore we must have that *z* ≤ 0. Which means that by 1 we get:

Therefore lim *x*_{n} ≤ lim *y*_{n}

### Theorem (Squeeze/Sandwich Limit Theorem)[edit]

Given sequences (*x*_{n}), (*y*_{n}), and (*w*_{n}), if (*x*_{n}) and (*y*_{n}) converge to *a* and *x*_{n} ≤ *w*_{n} ≤ *y*_{n}, then *w*_{n} converges to *a*.

#### Proof[edit]

Fix ε > 0. We need to find an *N* such that |*w*_{n} − *a*| < ε if *n* > *N*. Since (*x*_{n}) → *a* and (*y*_{n}) → *a* the definition of convergence ensures that there exists integers *N*_{x} and *N*_{y} so that |*x*_{n} − *a*| < ε for *n* > *N*_{x} and |*y*_{n} − *a*| < ε for *n* > *N*_{y}.

Let *N*=max(*N*_{x}, *N*_{y}). Then, for all *n* > *N* we have −ε < *x*_{n} − *a* and *y*_{n} − *a* < ε. Since *x*_{n} < *w*_{n} < *y*_{n}, it follows that *x*_{n} − *a* < *w*_{n} − *a* < *y*_{n} − *a*.

Thus if *n* ≥ *N*, then −ε < *x*_{n} − *a* < *w*_{n} − *a* < *y*_{n} − *a* < ε. In other words, |*w*_{n} − *a*| < ε.

## Completeness[edit]

The following results are closely related to the completeness of the real numbers.

### Theorem (Convergence of Monotone sequences)[edit]

Any monotone, bounded sequence converges. If the sequence is non-decreasing, then the sequence converges to the least upper bound of the elements of the sequence. If the sequence is non-increasing, then the sequence converges to the greatest lower bound of the elements of the sequence

#### Proof[edit]

Let (*x*_{n}) be any monotone sequence that is bounded by a real number M. Without loss of generality, assume (*x*_{n}) is non-decreasing. Since (*x*_{n}) is bounded above, it has a least upper bound by the least upper bound axiom. Let *x* = sup {*x*_{n} | *n* ∈ **N**}. We will now show that (*x*_{n}) → *x*.

Fix ε > 0. As was shown in the exercises, if *s* = sup(*A*), then for any ε > 0 there is an element *a* in *A* so that *s* − ε < *a* < *s*. Hence, it follows that there exists an *N* in **N** so that *x* − ε < *x*_{N} < *x*.

For any *n* > *N*, since *x*_{n} is non-decreasing, we have that

- .

Thus |*x* − *x*_{n}| < ε and by the definition of convergence, (*x*_{n}) converges to *x*.

### Theorem (Nested intervals property)[edit]

If there exists a sequence of closed intervals *I*_{n} = [*a*_{n}, *b*_{n}] = {*x* | *a*_{n} ≤ *x* ≤ *b*_{n}} such that *I*_{n+1} ⊆ *I*_{n} for all *n*, then ∩*I*_{n} is nonempty.

#### Proof[edit]

Since *I*_{n+1} ⊆ *I*_{n} it follows that *a*_{n} ≤ *a*_{n+1} and *b*_{n+1} ≤ *b*_{n}.

Since (*a*_{n}) and (*b*_{n}) are monotonic sequences they converge by the previous theorem. Furthermore, since *a*_{n} < *b*_{n} for all *n*, it follows that lim *a*_{n} ≤ lim *b*_{n} .

By the monotonicity of (*a*_{n}) and (*b*_{n}) we have for every *n*

Therefore lim *a*_{n} ∈ [*a*_{n}, *b*_{n}] for every *n*, which implies that

Thus the intersection is nonempty.

### Theorem (Bolzano—Weierstrass)[edit]

Every bounded sequence of real numbers contains a convergent subsequence.

#### Proof[edit]

Let (*x*_{n}) be a sequence of real numbers bounded by a real number *M*, that is |*x*_{n}| < *M* for all *n*. We define the set *A* by *A* = {*r* | |*r*| ≤ *M* and *r* < *x*_{n} for infinitely many *n*}. We note that *A* is non-empty since it contains −*M* and *A* is bounded above by *M*. Let *x* = sup *A*.

We claim that, for any ε > 0, there must be infinitely many points of *x*_{n} in the interval (*x* − ε, *x* + ε). Suppose not and fix an ε > 0 so that there are only finitely many values of *x*_{n} in the interval (*x* − ε, *x* + ε). Either *x* ≤ *x*_{n} for infinitely many *n* or *x* ≤ *x*_{n} for at most only finitely many *n* (possibly no *n* at all). Suppose *x*< *x*_{n} for infinitely many *n*. Clearly in this case *x* ≠ *M*. If necessary restrict ε so that *x* + ε ≤ *M*. Set *r* = *x* + ε/2 we have that *r* < *x*_{n} for infinitely many *n* because there are only finitely many *x*_{n} in the set [*x*,*r*] and *x* must be less than infinitely many *x*_{n}, furthermore |*r*| < *M*. Thus *r* is in *A*, which contradicts that *x* is an upper bound for *A*. Now suppose *x*< *x*_{n} for at most finitely many *n*. Set *y* = *x* − ε/2. Then there are at most only finitely man *n* so that *x*_{n} ≥ *y*. Thus, if *r* < x_{n} for infinitely many *n*, we have that *r* ≤ *y*. This means that *y* is an upper bound for *A* that is less than *x*, contradicting that *x* wast the *least* upper bound of *A*. In either case we arrive at a contradiction, thus we must have that for any ε > 0, there must be infinitely many points of *x*_{n} in the interval (*x* − ε, *x* + ε).

Now we show there is a subsequence that converges to *x*. We define the subsequence inductively, choose any *x*_{n1} from the interval (*x* − 1, *x* + 1). Assuming we have chosen *x*_{n1}, …, *x*_{nk−1}, choose *x*_{nk} to be an element in the interval (*x* − 1/k, *x* + 1/k) so that *n*_{k}∉{*n*_{1}, …, *n*_{k−1}}, this is possible as there are infinitely many elements of (*x*_{n}) in the interval. Notice that for this choice of *x*_{nk} we have that |*x* − *x*_{nk}|<1/k. Hence for any ε>0, if we take any *k* > 1/ε, then |*x*_{nk}-x| < ε. That is the subsequence (*x*_{nk}) → *x*.

### Theorem (Cauchy criterion)[edit]

A sequence converges if and only if it is Cauchy. Although this seems like a weaker property than convergence, it is actually equivalent, as the following theorem shows:

#### Proof[edit]

First we show that if (*x*_{n}) → x then *x*_{N} is Cauchy. Now suppose that for a given ε > 0 we wish to find an *N* so that |*x*_{n} − *x*_{m}| < ε for all *n*, *m* > *N*. We will choose *N* so that for all *n* ≥ *N* we have that |*x*_{n} − *x*| < ε/2. By the triangle inequality, for any *n*, *m* > *N* we have:

- .

Thus (*x*_{n}) is a Cauchy sequence.

Now we show that if (*x*_{n}) is a Cauchy sequence, then it converges to some *x*. Let (*x*_{n}) be a Cauchy sequence, and let ε > 0. By the definition of a Cauchy Sequence, there exits a natural number *L* so that |*x*_{n} − *x*_{m}| < ε/2 whenever *n*, *m* > *L*. Since (*x*_{n}) is a Cauchy sequence it is bounded. By the Bolzano—Weierstrass theorem, it has a convergent subsequence (*x*_{nk}) that converges to some point *x*. Now we will show that the whole sequence converges to *x*

Because (*x*_{nk}) converges, we can choose a natural number *M* so that if *n*_{k} > *M*, then |*x*_{nk} − x| < ε/2. Let *N* = max(*L*, *M*), and fix any *n*_{k} > *N*. For *n* > *N* we have that

- .

Thus by definition of convergence (*x*_{n}) → *x*.

These theorems all describe different aspects of the completeness of the real numbers. The reader will notice that the least upper bound property was used heavily in this section, and it is the axiom that separates the real numbers from the rational numbers. While these theorems would be false for the rational numbers, not all of them can substitute for the least upper bound property. The Cauchy criterion and the nested intervals property are not strong enough to imply the least upper bound property without additional assumptions, while the Convergence of Monotone sequences theorem and the Bolzano—Weierstrass property do imply the least upper bound property.

## Limit superior and limit inferior[edit]

Limits turn out to be a very useful tool in analysis, their primary draw back is that they may not always exist. Occasionally it is useful to have some notion of limit that makes sense for any sequence. To this end we introduce the limit superior (often just called the "lim sup") and the limit inferor (often called the "lim inf").

**Definition** For a sequence (x_{n}) we define the limit superior, denoted lim sup by:

Similarly we define the limit inferior, deonoted by lim inf by:

If (*x*_{n}) is not bounded above, we say that lim sup *x*_{n} = ∞. If (*x*_{n}) is not bounded we say that lim inf *x*_{n} = −∞.

Notice that for bounded sequences the lim sup and the lim inf always exist. As we know general bounded sequence the limit doesn't always exist. But in the case when the lim sup and lim inf are equal, life is nicer as the next theorem shows.

### Theorem (Limit Superior and Inferior)[edit]

Let (*x*_{n}) be a bounded sequence. Then (*x*_{n}) → *x* if and only if lim sup *x*_{n} = x = lim inf *x*_{n}.

#### Proof[edit]

First suppose (*x*_{n}) → *x*. Fix an ε > 0 choose a natural number *N* so that *x* − ε < *x*_{n} < *x* + ε for any *n* > *N*. Hence for any *k* > *N* we have that

and hence *x* − ε < lim sup *x*_{n} < *x* + ε. Since ε was arbitrary, this can only happen if lim sup *x*_{n} = *x*. A similar argument shows that lim inf *x*_{n} = *x*.

Now suppose lim inf *x*_{n} = *x* = lim sup *x*_{n}, and we wish to show that lim *x*_{n} = *x*.

First recall that the x=lim sup *x*_{n} is defined as:

Given an ε > 0, since we can get arbitrarily close to the infimum, we can choose we will choose *N*_{ls} so that

Similarly recall that the x=lim inf *x*_{n} is defined as:

Since we can get arbitrarily close to the supremum, we can choose we will choose *N*_{li} so that

Let *N* = max(*N*_{ls}, *N*_{li}). Now if *n* > *N*, then

Hence for any *n* > *N*

By our choice of *N*_{ls} and *N*_{li} this implies for any *n* > *N*