Real Analysis/Landau notation

From Wikibooks, the open-content textbooks collection

Jump to: navigation, search
Real Analysis
Landau notation

Contents

The Landau notation is an amazing tool applicable in all of real analysis. The reason it is so convenient and widely used is because it underlines a key principle of real analysis, namely estimation. Loosely speaking, the Landau notation introduces two operators which can be called the "order of magnitude" operators, which essentially compare the magnitude of two given functions.

[edit] The little-o

The little-o provides a function that is of lower order of magnitude than a given function, that is the function o(g(x)) is of a lower order than the function g(x). Formally,

[edit] Definition

Let A\subseteq\mathbb{R} and let c\in\mathbb{R}

Let f,g:A\to\mathbb{R}

If \lim_{x\to c}\frac{f(x)}{g(x)}=0 then we say that

"As x\to c, f(x) = o(g(x))"

[edit] Examples

  • As x\to\infty, (and m < n) xm = o(xn)
  • As x\to\infty, (and n\in\mathbb{N}) lnx = o(xn)
  • As x\to 0, sinx = o(1)

[edit] The Big-O

The Big-O provides a function that is at most the same order as that of a given function, that is the function O(g(x)) is at most the same order as the function g(x). Formally,

[edit] Definition

Let A\subseteq\mathbb{R} and let c\in\mathbb{R}

Let f,g:A\to\mathbb{R}

If there exists M > 0 such that \lim_{x\to c}\left| \frac{f(x)}{g(x)}\right| <M then we say that

"As x\to c, f(x) = O(g(x))"

[edit] Examples

  • As x\to 0, sinx = O(x)
  • As x\to \tfrac{\pi}{2}, sinx = O(1)

[edit] Applications

We will now consider few examples which demonstrate the power of this notation.

[edit] Differentiability

Let A\subseteq\mathbb{R} and L\in\mathbb{R}

Let f:A\to\mathbb{R} and let c\in A

Then, we say that f(x) is differentiable at x = c if and only if

As x\to c, f(x)-f(c)=L(x-c)+o\left( (x-c)\right)

[edit] Mean Value Theorem

Let f:[a,x]\to\mathbb{R} be differentiable on [a,b]. Then,

As x\to a, f(x) = f(a) + O(xa)

[edit] Taylor's Theorem

Let f:[a,x]\to\mathbb{R} be n-times differentiable on [a,b]. Then,

As x\to a, f(x)=f(a)+\tfrac{(x-a)f'(a)}{1!}+\tfrac{(x-a)^2f''(a)}{2!}+\ldots+\tfrac{(x-a)^{n-1}f^{(n-1)}(a)}{(n-1)!}+O\left( (x-a)^n\right)