The L2 space is an infinite function space, and therefore a linear combination of any infinite set of orthogonal functions can be used to represent any single member of the L2 space. The decomposition of an L2 function in terms of an infinite basis set is a technique known as the Fourier Decomposition of the function, and produces a result called the Fourier Series.
Let's consider a set of L2 functions, , as follows:
We can prove that over a range , all of these functions are orthogonal:
Because is as an infinite orthogonal set in L2, is also a valid basis set in the L2 space. Therefore, we can decompose any function in L2 as the following sum:
[Classical Fourier Series]
However, the difficulty occurs when we need to calculate the a and b coefficients. We will show the method to do this below:
Calculation of a0 is the easiest, and therefore we will show how to calculate it first. We use the value of a0 which minimizes the error in approximating by the Fourier series.
First, define an error function, E, that is equal to the squared norm of the difference between the function f(x) and the infinite sum above:
For ease, we will write all the basis functions as the set φ, described above:
Combining the last two functions together, and writing the norm as an integral, we can say:
We attempt to minimize this error function with respect to the constant term. To do this, we differentiate both sides with respect to a0, and set the result to zero:
The φ0 term comes out of the sum because of the chain rule: it is the only term in the entire sum dependent on a0. We can separate out the integral above as follows:
All the other terms drop out of the infinite sum because they are all orthogonal to φ0. Again, we can rewrite the above equation in terms of the scalar product:
And solving for a0, we get our final result:
Using the above method, we can solve for the an coefficients of the sin terms:
Also using the above method, we can solve for the bn terms of the cos term.