Real analysis/Differentiation in Rn

From Wikibooks, the open-content textbooks collection

< Real analysis
Jump to: navigation, search

We will first revise some important concepts of Linear Algebra that are of importance in Multivariate Analysis. The reader with no background in Linear Algebra is advised to refer the book Linear Algebra.

Contents

[edit] Vector Space

A set \mathcal{V} is said to be a Vector Space over a field F if and only if operations addition and scalar multiplication are defined over it so as to satisfy for all \mathbf{v_1}, \mathbf{v_2},\ldots\in\mathcal{V} and c_1,c_2\in F

(i)Commutativity:\mathbf{v_1}+\mathbf{v_2}=\mathbf{v_2}+\mathbf{v_1}

(ii)Associativity:(\mathbf{v_1}+\mathbf{v_2})+\mathbf{v_3}=\mathbf{v_1}+(\mathbf{v_2}+\mathbf{v_3})

(iii)Identity:There exists \mathbf{0}\in\mathcal{V} such that \mathbf{v_1}+\mathbf{0}=\mathbf{v_1}=\mathbf{0}+\mathbf{v_1}

(iv)Inverse:There exists -\mathbf{v_1}\in\mathcal{V} such that \mathbf{v_1}+(-\mathbf{v_1})=\mathbf{0}

(v):c\mathbf{v_1}+c\mathbf{v_2}=c(\mathbf{v_1}+\mathbf{v_2})

(vi)c_1\mathbf{v}+c_2\mathbf{v}=(c_1+c_2)\mathbf{v}

(vii)c_1(c_2\mathbf{v_1})=c_2(c_1\mathbf{v_1})=(c_1c_2)\mathbf{v_1}

Members of a vector space are called "Vectors" and those of the field are called "Scalars". \mathbb{R}^n, the set of all polynomials etc. are examples of vector spaces

A set of linearly independant vectors that spans the vector space is said to be a Basis for the vector space and its members are called "Unit vectors"

[edit] Linear Transformations

Let X,Y be vector spaces.

Let T:X\to Y

We say that T is a Linear transformation if and only if for all \mathbf{v_1},\mathbf{v_2}\in X,

(i)T(\mathbf{v_1}+\mathbf{v_2})=T(\mathbf{v_1})+T(\mathbf{v_2})

(ii)T(c\mathbf{v_1})=cT(\mathbf{v_1})


As we will see, there are two major ways to define a 'derivative' of a multivariable function. We first present the seemingly more straightforward way of using "Partial Derivatives".

[edit] Directional and Partial Derivatives

Let \mathbf{f}:\mathbb{R}^n\to \mathbb{R}^m

Let \mathbf{a},\mathbf{y}\in \mathbb{R}^n

We say that \mathbf{f} is differentiable at \mathbf{a}\in\mathbb{R}^n with respect to vector \mathbf{y} if and only if there exists \mathbf{L}\in\mathbb{R}^m that satisfies

\lim_{h\to 0}\frac{\mathbf{f}(\mathbf{a}+h\mathbf{y})-\mathbf{f}(\mathbf{a})}{h}=\mathbf{L}

\mathbf{L} is said to be the derivative of \mathbf{f} at \mathbf{a} with respect to \mathbf{y} and is written as \mathbf{f}'(\mathbf{a};\mathbf{y})

When \mathbf{y} is a unit vector, the derivative is said to be a partial derivative. Here we will explicitly define partial derivatives and see some of their properties.


Let f be a real multivariate function defined on an open subset Ω of \mathbb{R}^{n}

f: \Omega \longrightarrow \mathbb{R} .

Then the partial derivative at some parameter (x1,...,xn) with respect to the coordinate xi is defined as the following limit

\lim_{h \rightarrow 0} {f(x_1,\ldots,x_i+h,\ldots,x_n)-f(x_1,\ldots,x_i,\ldots,x_n) \over h} = { \partial f \over \partial x_i } .

f is said to be differentiable at this parameter (x1,...,xn) if the difference f(x1,...,xi + h,...,xn) − f(x1,...,xi,...,xn) is equivalent up to first order in h to a linear form L (of h), that is

f(x_1,...,x_i+h,...,x_n)-f(x_1,...,x_i,...,x_n) = L\times h + o(\|h\|).

The linear form L is then said to be the differential of f at (x1,...,xn), and is written as Df|_{(x_1,\ldots,x_n)} or sometimes \mathrm{d}f(x_1,\ldots,x_n) .

In this case, where f is differentiable at (x_1,\ldots,x_n) , by linearity we can write

\mathrm{d}f={\partial f \over \partial x_1}\mathrm{d} x_1+\ldots+ {\partial f \over \partial x_n}\mathrm{d} x_n

f is said to be continuously differentiable if its differential is defined at any parameter in its domain, and if the differential is varying continuously relative to the parameter (x1,...,xn), that is if it coordinates (as a linear form) \partial f \over \partial x_1 are varying continuously.

In case partial derivatives exists but f is not differentiable, and sometimes not even continuous exempli gratia

f:(x,y)\mapsto {(xy)^2\over (x^2+y^2)}

(and f(0,0) = 0) we say that f is separably differentiable.

The partial derivatives can be arranged in a matrix called the Jacobian Matrix:

\begin{bmatrix} \frac{\partial y_1}{\partial x_1} & \cdots & \frac{\partial y_1}{\partial x_n} \\ \vdots & \ddots & \vdots \\ \frac{\partial y_m}{\partial x_1} & \cdots & \frac{\partial y_m}{\partial x_n} \end{bmatrix}.


[edit] Total Derivatives

The total derivative is important as it preserves some of the key properties of the single variable derivative, most notably the assertion differentiability implies continuity

Let \mathbf{f}:\mathbb{R}^n\to \mathbb{R}^m

We say that \mathbf{f} is differentiable at \mathbf{a}\in\mathbb{R}^n if and only if there exists a linear transformation Ta such that

\lim_{|\mathbf{h}|\to 0}\frac{\mathbf{f}(\mathbf{a}+\mathbf{h})-\mathbf{f}(\mathbf{a})-T_a(\mathbf{h})}{|\mathbf{h}|}=\mathbf{0}

Retrieved from "http://en.wikibooks.org/wiki/Real_analysis/Differentiation_in_Rn"
Personal tools
Create a book
  • Add wiki page
  • Collections help