Jump to content

Uniform continuity – "Math for Non-Geeks"

From Wikibooks, open books for an open world

Uniform continuity is a stronger form of continuity. It is derived from the epsilon-delta criterion of continuity and particularly important for approximating functions.

Motivation

[edit | edit source]

Recap: Epsilon-delta criterion

[edit | edit source]

The definition of uniform continuity is built upon that one of the epsilon-delta criterion for continuity. We will therefore recap the epsilon-delta definition:

A function f:D→ℝ with D⊆ℝ is continuous at x0∈D, if and only if for every ϵ>0 there is a δ>0 , such that |f(x)−f(x0)|<ϵ holds for all x∈D with |x−x0|<δ .

That is, if we choose an epsilon-tube around f(x0) , no matter how small it is, all function values in a sufficiently small environment of x0 will lie in it. An epsilon-tube is an interval from f(x0)−ϵ to f(x0)+ϵ with ϵ>0 aroundf(x0):

A function f with an epsilon-tube around f(x_0)
A function f with an epsilon-tube around f(x_0)

A function f:D→ℝ is continuous at x0∈D if and only if for every epsilon-tube, there is a δ>0 , such that all function values of f when evaluated between x0−δ and x0+δ fit inside the epsilon-tube:

All function values for x between x_0-delta and x_0+delta fit inside the epsilon-tube around x_0
All function values for x between x_0-delta and x_0+delta fit inside the epsilon-tube around x_0

This δ may depend on the given function f, the given tube size ϵand from the point x0 . The following diagram shows an example, where a δ-value is sufficiently small for x0 , but too large for x1 :

The value for delta is sufficiently small for x_0, but too large for x_1.
The value for delta is sufficiently small for x_0, but too large for x_1.

Hence, we must choose the δ at x1 smaller. As both δ-values at x0 and x1 are different, we will label them correspondingly by δ0 and δ1. This shows, that the δ within the definition of continuity may depend on the considered position x. The following diagram illustrates this:

Both the interval sizes delta_1 and delta_2 are sufficiently small for the given epsilon.
Both the interval sizes delta_1 and delta_2 are sufficiently small for the given epsilon.

Derivation of uniform continuity

[edit | edit source]

The epsilon-delta criterion guarantees that any continuous function f:D→ℝ can be approximated. For every maximal error ϵ>0 and around every x~ we can find a δx~>0, such that the function value f(x) at every x inside the delta-interval (x~−δ,x~+δ) around f(x~) maximally deviates from f(x~) by ϵ>0. So for all of those x with x~−δ<x<x~+δ we can consider f(x~) as an approximation of f(x) with a maximal error of ϵ . The following diagram illustrates this approximation at several points xi:

Approximation of a continuous function at several positions.
Approximation of a continuous function at several positions.

However, the δx~-values depend on the considered position x~ . This is why the rectangles in the above diagram have different sizes. For a more uniform approximation, we could impose additionally that all rectangles have to be of equal size, That means, the δx~-value shall be equally suitable for any x~ . The above diagram would then look as follows:

Uniform approximation of a continuous function.
Uniform approximation of a continuous function.

This is the core idea of uniform continuity. For any given ϵ>0 , there is a global δ>0, such that no matter which point x~∈D is chosen, every function value f(x) picked from the delta-interval (x~−δ,x~+δ) will be closer than ϵ to f(x~) . This leads us to the following definition of uniform continuity for a function f:D→ℝ, which will allow us for uniform approximations:

For every ϵ>0 there is a δ>0 (independent from the position x~), such that for every x~∈D and every argument x∈D with |x−x~|<δ the following inequality holds: |f(x)−f(x~)|<ϵ .

Definition

[edit | edit source]

Definition of uniform continuity

[edit | edit source]

The formal definition of uniform continuity hence reads as follows:

Definition (Uniform continuity)

A function f:D→ℝ is uniform continuous on D, if for every ϵ>0 a δ>0 exists, such that at all positions x~∈D and for all arguments x∈D with a distance smaller than δ to x~ the function values f(x) and f(x~) deviate from each other by less than ϵ . In quantifier notation, the definition of uniform continuity reads:

∀ϵ>0∃δ>0∀x~∈D∀x∈D:|x−x~|<δ⟹|f(x)−f(x~)|<ϵ

In different words, for each ϵ>0 there is a δ>0 , such that all pairs x,x~∈D with |x−x~|<δ satisfy the inequality |f(x)−f(x~)|<ϵ .

Quantifier notation

[edit | edit source]

The commented version of the quantifier notation reads:

∀ϵ>0⏟for all ϵ>0∃δ>0⏟ there is a δ>0∀x~∈D⏟, such that at all positions x~∈D∀x∈D⏟ and for all arguments x∈D|x−x~|<δ⏟ with distance to x~ smaller δ⟹⏟ there is|f(x)−f(x~)|<ϵ⏟, that the distance from f(x) to f(x~) is smaller than ϵ

Comparing the epsilon-delta definition of uniform continuity and continuity in the quantifier notation, we note that only two quantifiers have been permuted:

Continuity: ∀ϵ>0∀x~∈D∃δ>0∀x∈D:|x−x~|<δ⟹|f(x)−f(x~)|<ϵUniform Continuity: ∀ϵ>0∃δ>0∀x~∈D∀x∈D:|x−x~|<δ⟹|f(x)−f(x~)|<ϵ

The reason is that the δ used for uniform continuity is a global one, i.e. it does not depend on the position x~∈D . In order to express this independence, the existence quantifier „∃δ>0“ must appear in front of the all quantifier „∀x~∈D“ .

Deriving the negation of uniform continuity

[edit | edit source]

The quantifier notation is a handy tool for inverting definitions - like for uniform continuity. It basically works by step-wise replacing existence and all quantifiers by the respective other expression:

¬(∀ϵ>0∃δ>0∀x~,x∈D:|x−x~|<δ⟹|f(x)−f(x~)|<ϵ)⟺∃ϵ>0¬(∃δ>0∀x~,x∈D:|x−x~|<δ⟹|f(x)−f(x~)|<ϵ)⟺∃ϵ>0∀δ>0¬(∀x~,x∈D:|x−x~|<δ⟹|f(x)−f(x~)|<ϵ)⟺∃ϵ>0∀δ>0∃x~,x∈D:¬(|x−x~|<δ⟹|f(x)−f(x~)|<ϵ)⟺∃ϵ>0∀δ>0∃x~,x∈D:|x−x~|<δ∧¬(|f(x)−f(x~)|<ϵ)⟺∃ϵ>0∀δ>0∃x~,x∈D:|x−x~|<δ∧|f(x)−f(x~)|≥ϵ

So:

∃ϵ>0∀δ>0∃x~,x∈D:|x−x~|<δ∧|f(x)−f(x~)|≥ϵ

Negation of uniform continuity

[edit | edit source]
Definition (Not uniformly continuous)

A function f:D→ℝ is called not uniformly continuous, if there is at least one ϵ>0 , such that no matter how small δ>0 is chosen, we can find at least two arguments x~ and x with distance smaller than δ , such that the function values f(x) and f(x~) have a distance of at least ϵ .

Uniform continuity is a global property

[edit | edit source]

Uniform continuity is a global property of a function. That means, it makes only sense to consider uniform continuity of a whole function. By contrast, continuity is a local property. We can speak of a function being continuous at a certain position x. For uniform continuity, this is not possible. However, a function can be both be globally continuous (continuous at every x∈D) and (globally) uniformly continuous.

The globalness is just a consequence of the definition: For uniform continuity, we can find a global δ>0, whose delta-interval around every argument is a sufficient approximation. It is no necessary to speak of a global delta at some certain argument x: we just need to find one delta for all arguments.

Visualization

[edit | edit source]

Recap: visualization of the epsilon-delta criterion

[edit | edit source]

In order to visualize the epsilon-delta criterion, we will draw a rectangle centred at (x0,f(x0)) with height 2ϵ and width 2δ. In order to satisfy the epsilon-delta criterion, the graph must not lie above or below the rectangle, but completely inside:

The 2epsilon-2delta rectangle with permitted and non-permitted area
The 2epsilon-2delta rectangle with permitted and non-permitted area

Take, for instance the square function at arguments around x0=1. No matter how small we impose ϵ , we can always find a δ, such that the graph lies completely in the interior of the 2ϵ-2δ-rectangle:

Visualization of the epsilon-delta criterion for the square function
Visualization of the epsilon-delta criterion for the square function

Conversely, if a function is not continuous, such as the sign function sgn⁡(x) , we are able to find an ϵ>0, whose graph always takes values above or below the rectangle - no matter how narrow we make it. Concerning the sign function at x0=0 , this will for instance be the case if we choose ϵ=12 :

Visualization of uniform continuity

[edit | edit source]
For uniformly continuous functions, we can draw one rectangle with height 2ϵ and width 2δ and move it to any point on the graph, without having pieces of the graph above or below the rectangle. The function f(x)=x is uniformly continuous. Despite having infinite derivative at zero, the graph always runs inside the upper and lower bounds of the rectangle. However, for g(x)=1x this is not the case. In the vicinity of arguments near zero, the function moves infinitely far into the y-direction. No matter how narrow we choose the rectangle, the function will always break its lower and upper barriers for x close enough to zero.

For uniform continuity, δ has to be the same at every x . The graph has to fit inside the rectangle, no matter where we move it. That means: For every ϵ>0 there must be a δ>0 , such that the 2ϵ-2δ-rectangle can be moved arbitrarily along the graph without having function values above or below it:

For a uniformly continuous function, there is no point above or below the rectangle - no matter where on the graph we place it.
For a uniformly continuous function, there is no point above or below the rectangle - no matter where on the graph we place it.

For a non-uniformly continuous function, this is not possible. Another counter-example is the square function. In fact, for any given ϵ>0 (not just a specific one), we cannot find a δ>0 , such that the graph does nowhere cross the upper or lower border of the 2ϵ-2δ-rectangle. For x-values near zero, the square function is close to constant, so the graph will fit inside some 2ϵ-2δ-rectangle, there. But the more we move it to the right, the steeper our function will get. And at some point, the function will break the upper and lower barriers of the 2ϵ-2δ-rectangle. So the square function in a continuous but not uniformly continuous function:

The square function is a continuous but not uniformly continuous function.
The square function is a continuous but not uniformly continuous function.

Scheme of proof

[edit | edit source]

Scheme of proof: Uniform continuity

[edit | edit source]

In terms of quantifiers, the definition of uniform continuity reads:

∀ϵ>0 ∃δ>0 ∀x~,x∈D (|x−x~|<δ⟹|f(x)−f(x~)|<ϵ)

This can be used to derive a scheme of proof for uniform continuity:

Let ϵ>0 be arbitrary.⏟∀ϵ>0 Choose δ=… There is δ, since…⏟∃δ>0Let x,x~∈D with |x−x~|<δ be arbitrary.⏟∀x~,x∈D:|x−x~|<δ there is: |f(x)−f(x0)|<…<ϵ⏟⟹|f(x)−f(x0)|<ϵ

Scheme of proof: Not uniformly continuous

[edit | edit source]

In terms of quantifiers, the definition of f being not uniformly continuous reads:

∃ϵ>0 ∀δ>0 ∃x~,x∈D:|x−x~|<δ∧|f(x)−f(x~)|≥ϵ

This can be used to derive a scheme for disproving uniform continuity:

Choose an ϵ=…⏟∃ϵ>0 Let δ>0 be arbitrary.⏟∀δ>0Choose x~=… and x=… There is x~,x∈D, since …⏟∃x~,x∈DThere is:Proof for |x−x~|<δProof for |f(x)−f(x~)|≥ϵ

Uniform continuity as a stronger form of continuity

[edit | edit source]

Uniform continuity is a stronger form of continuity. That means, every uniformly continuous function is also continuous. The converse does not hold. There are functions like the square function f:ℝ→ℝ:x↦x2 being continuous, but not uniformly continuous:

uniformcontinuity⟸̸⟹continuity

Every uniformly continuous function is also continuous

[edit | edit source]
Theorem (uniform continuity implies continuity)

Every uniformly continuous function f:D→ℝ with D⊆ℝ is continuous at each point x0∈D .

Proof (uniform continuity implies continuity)

We need to show that a uniformly continuous function f:D→ℝ is continuous at every point x0∈D . That means, we are given an arbitrary ϵ>0 and x0∈D and we need to find a δ>0 such that |x−x0|<δ implies the inequality |f(x)−f(x0)|<ϵ . But now, we can just apply the definition of uniform continuity. This definition provides us with a δ>0, such that at all x,x~∈D with |x−x~|<δ , there is |f(x)−f(x~)|<ϵ. As this implication holds for all x,x~∈D , it particularly holds for x and x~=x0. So the δ>0 given by uniform continuity can also be used as the δ for ordinary continuity at x0∈D.

The square function is continuous but not uniformly continuous

[edit | edit source]

As we have seen, every uniformly continuous function is also continuous. However, the converse does not hold. Let us consider again the square function as an example:f:ℝ⟶ℝx⟼x2

As we have seen in the section visualization, if there is ϵ>0 given, we cannot set a fixed δ>0 , such that the graph is everywhere inside the 2ϵ-2δ-rectangle , independent from where we place it. The further we move the rectangle to the right, the steeper the square function gets. And at some point, the graph starts crossing he upper and lower borders of the 2ϵ-2δ-rectangle.

This can also be seen by checking the epsilon-delta definition of uniform continuity: ∀ϵ>0∃δ>0∀x~∈ℝ∀x∈ℝ:|x−x~|<δ⟹|f(x)−f(x~)|<ϵ. We want to prove the negation of this statement, i.e. ∃ϵ>0∀δ>0∃x~∈ℝ∃x∈ℝ:|x−x~|<δ and |f(x)−f(x~)|≥ϵ. Consider for instance ϵ=1 and assume there was some δ>0, such that |x12−x02|<ϵ for all real numbers x0,x1∈ℝ with |x1−x0|<δ . Now consider some x0(δ)>0 which we will determine later. We take the centre x0 and some point x1:=x0+δ2 inside the δ-interval. That means, |x1−x0|=δ2<δ.

Now, we want to show that |x12−x02|≥ϵ holds.

x12=(x0+δ2)2=x02+x0δ+14δ2≥(x0+δ2)2=x02+x0δ

Further,

|x12−x02|=(x0+δ2)2−x02=x02+δx0+δ24−x02≥δx0.

If we choose x0≥1δ then it is guaranteed that |x12−x02|≥1=ϵ. Hence, we have proven that

f:ℝ⟶ℝx⟼x2

is not uniformly continuous.

Example: uniformly continuous functions

[edit | edit source]
  • The identity function f:D→D is uniformly continuous, since for |x−y|<δ , we can show |f(x)−f(y)|=|x−y|<ϵ by choosing δ=ϵ .
  • Above, we have seen that the square function f:ℝ→ℝ is not uniformly continuous on the real numbers. However, when restricting to a compact interval, the function gets uniformly continuous. For example,

f:[0,1]→ℝx↦x2 is uniformly continuous. We can prove this as follows: There is |f(x)−f(y)|=|x2−y2|=|x+y||x−y|≤2|x−y|, because x,y∈[0,1] . So we can choose δ:=ϵ2 and then for all x,y∈D with |x−y|<δ the estimate |f(x)−f(y)|<2|x−y|<2δ=ϵ will hold.

  • The square root function is uniformly continuous on ℝ0+. Consider:

f:ℝ0+→ℝx↦x Let ϵ>0 be arbitrary. Then, δ=ϵ2 is a suitable choice: Let x,y∈[0,∞[ with |x−y|<δ.

Without any restrictions, we may choose x≤y. Then, there is also x≤y, and hence we get |x−y|=y−x.

Now, we want to prove that |f(x)−f(y)|=|x−y|=y−x<ϵ .

By assumption, there is 0≤x≤y<x+ϵ2. And therefore:

y<x+ϵ2≤x+2xϵ+ϵ2=(x+ϵ)2

So y<(x+ϵ)2. Since by assumption x,y≥0 and also ϵ>0 , we may take the square root of this equation and obtain y<x+ϵ, i.e.y−x<ϵ, which is what we wanted to show. Hence, we have proven that f is uniformly continuous.

  • The following example is not uniformly continuous:

f:(0,1]→ℝx↦sin⁡(1x), , which are sine waves oscillating faster and faster when approaching x=0. Assume that f was uniformly continuous. Then we could find some global δ such that the epsilon-delta criterion holds everywhere. But now, for x→0 the frequency of f gets arbitrarily high, so inside an interval close to x→0 , there will always be a full oscillation of the sine inside any δ-ball. Since the peak-to-peak amplitude of the sine function is equal to 2 , the condition |f(x)−f(y)|<ϵ will never hold everywhere for ϵ<2 . We just have to move the rectangle close enough to 0, as illustrated by the subsequent figure:

This image shows, that the topological sine curve is not uniformly continuous. For an environment of fixed width and x going towards 0, at some point a full period will be inside the environment.
This image shows, that the topological sine curve is not uniformly continuous. For an environment of fixed width and x going towards 0, at some point a full period will be inside the environment.

Properties

[edit | edit source]

As we have seen, not every continuous function is also uniformly continuous. But if we restrict to a closed, compact interval [a,b] , both continuity and uniform continuity will be equivalent:

Theorem (Heine-Cantor for ℝ)

Every function f:[a,b]→ℝ is uniformly continuous.

Proof (Heine-Cantor for ℝ)

We choose an indirect way of proof: suppose, the function f:[a,b]→ℝ was not uniformly continuous. That means, there is an ε>0 and for every n∈ℕ there are two points xn,x'n∈[a,b], such that |xn−x'n|<1n but |f(xn)−f(x'n)|≥ε.

The Bolzano Weierstrass theorem tells us (this is where compactness of f:[a,b]→ℝ comes into play) that the bounded sequence (xn)n∈ℕ must have a convergent subsequence (xnk)k∈ℕ, whose limit x is inside the interval [a,b] . Since |xnk−x'nk|<1nk this is also the limit of the subsequence (x'nk)k∈ℕ.

Now, continuity of f implies f(xnk)→f(x) and f(x'nk)→f(x). Therefor, there must be a k0, such that |f(xnk)−f(x)|<ε2 and |f(x'nk)−f(x)|<1nK for all k≥k0. We proceed by splitting and bounding |f(xnk)−f(x'nk)|=|(f(xnk)−f(x))+(f(x)−f(x'nk))|≤|(f(xnk)−f(x))|+|(f(x)−f(x'nk))|<ε2+ε2=ε ,which holds for all k≥k0 . This contradicts our assumption |f(xnk)−f(x'nk)|≥ε for all k. The assumption of f not being uniformly continuous must therefore have been wrong and we obtain uniform continuity.