Theorem due to Flajolet and Sedgewick[1] .
If
F
(
z
)
{\displaystyle F(z)}
is an admissible function then
[
z
n
]
F
(
z
)
∼
F
(
ζ
)
ζ
n
+
1
2
π
f
″
(
ζ
)
{\displaystyle [z^{n}]F(z)\sim {\frac {F(\zeta )}{\zeta ^{n+1}{\sqrt {2\pi f^{''}(\zeta )}}}}}
as
n
→
∞
{\displaystyle n\to \infty }
where
ζ
{\displaystyle \zeta }
is such that
F
′
(
ζ
)
=
0
{\displaystyle F^{'}(\zeta )=0}
.
Proof due to Flajolet and Sedgewick[2] .
By Cauchy's coefficient formula :
[
z
n
]
F
(
z
)
=
1
2
π
i
∫
C
F
(
z
)
z
n
+
1
d
z
{\displaystyle [z^{n}]F(z)={\frac {1}{2\pi i}}\int _{C}{\frac {F(z)}{z^{n+1}}}dz}
We can visualise this as a 3D graph whose
x
{\displaystyle x}
and
y
{\displaystyle y}
axes are the real and imaginary parts of
z
{\displaystyle z}
respectively and the
z
{\displaystyle z}
axis is the real part of
F
(
z
)
z
n
+
1
{\displaystyle {\frac {F(z)}{z^{n+1}}}}
.
For the generating functions we are interested in,
F
(
z
)
z
n
+
1
{\displaystyle {\frac {F(z)}{z^{n+1}}}}
has a saddle-point on the positive real axis[3] . This is the highest altitude of the green path in the above graph. Call this
ζ
{\displaystyle \zeta }
.
Being an analytic function (except at
z
=
0
{\displaystyle z=0}
), we can deform the contour to go through the saddle-point. The biggest contributor to the integral is made by the part of the contour near the saddle-point (call this
C
0
{\displaystyle C_{0}}
, which is the red part of the path in the graph below). The rest of the contour (call this
C
1
{\displaystyle C_{1}}
, the green part of the path) contributes relatively little.
1
2
π
i
∫
C
F
(
z
)
z
n
+
1
d
z
=
1
2
π
i
∫
C
0
F
(
z
)
z
n
+
1
d
z
+
1
2
π
i
∫
C
1
F
(
z
)
z
n
+
1
d
z
{\displaystyle {\frac {1}{2\pi i}}\int _{C}{\frac {F(z)}{z^{n+1}}}dz={\frac {1}{2\pi i}}\int _{C_{0}}{\frac {F(z)}{z^{n+1}}}dz+{\frac {1}{2\pi i}}\int _{C_{1}}{\frac {F(z)}{z^{n+1}}}dz}
We can deform the contour even more to make the part of the contour near the saddle-point a straight line (in the complex plane).
C
0
{\displaystyle C_{0}}
is deformed to a straight, vertical line, perpendicular to the real axis, crossing the saddle-point, starting from
−
i
a
{\displaystyle -ia}
to
i
a
{\displaystyle ia}
.
a
{\displaystyle a}
is chosen such that
f
″
(
ζ
)
a
2
→
∞
{\displaystyle f^{''}(\zeta )a^{2}\to \infty }
and
f
‴
(
ζ
)
a
3
→
0
{\displaystyle f^{'''}(\zeta )a^{3}\to 0}
as
n
→
∞
{\displaystyle n\to \infty }
. This is so that the Taylor series expansion around
ζ
{\displaystyle \zeta }
f
(
z
)
=
f
(
ζ
)
+
1
2
f
″
(
ζ
)
(
z
−
ζ
)
2
+
1
6
f
‴
(
ζ
)
(
z
−
ζ
)
3
+
⋯
{\displaystyle f(z)=f(\zeta )+{\frac {1}{2}}f^{''}(\zeta )(z-\zeta )^{2}+{\frac {1}{6}}f^{'''}(\zeta )(z-\zeta )^{3}+\cdots }
.
can be reduced to just
f
(
ζ
)
+
1
2
f
″
(
ζ
)
(
z
−
ζ
)
2
{\displaystyle f(\zeta )+{\frac {1}{2}}f^{''}(\zeta )(z-\zeta )^{2}}
.
f
″
(
ζ
)
=
F
″
(
ζ
)
F
(
ζ
)
+
n
+
1
ζ
2
{\displaystyle f^{''}(\zeta )={\frac {F^{''}(\zeta )}{F(\zeta )}}+{\frac {n+1}{\zeta ^{2}}}}
is real-valued because
ζ
{\displaystyle \zeta }
is real and
F
(
z
)
{\displaystyle F(z)}
, being a generating function, has real coefficients.
z
=
ζ
+
i
x
{\displaystyle z=\zeta +ix}
, so
(
z
−
ζ
)
2
=
−
x
2
{\displaystyle (z-\zeta )^{2}=-x^{2}}
is real. Therefore,
1
2
f
″
(
ζ
)
(
z
−
ζ
)
2
{\displaystyle {\frac {1}{2}}f^{''}(\zeta )(z-\zeta )^{2}}
is real-valued.
So, any imaginary part of
f
(
z
)
{\displaystyle f(z)}
can be moved outside the integral, leaving just a real-valued integrand:
1
2
π
i
∫
C
0
F
(
z
)
z
n
+
1
d
z
=
1
2
π
i
∫
C
0
e
f
(
z
)
d
z
∼
e
f
(
ζ
)
2
π
i
∫
C
0
e
1
2
f
″
(
ζ
)
(
z
−
ζ
)
2
d
z
{\displaystyle {\frac {1}{2\pi i}}\int _{C_{0}}{\frac {F(z)}{z^{n+1}}}dz={\frac {1}{2\pi i}}\int _{C_{0}}e^{f(z)}dz\sim {\frac {e^{f(\zeta )}}{2\pi i}}\int _{C_{0}}e^{{\frac {1}{2}}f^{''}(\zeta )(z-\zeta )^{2}}dz}
This also means that the real-valued surface we discussed in the beginning is a valid estimate of the potentially complex-valued
F
(
z
)
z
n
+
1
{\displaystyle {\frac {F(z)}{z^{n+1}}}}
.
C
0
:
x
∈
[
−
a
,
a
]
→
i
x
+
ζ
{\displaystyle C_{0}:x\in [-a,a]\to ix+\zeta }
We change variables to remove the imaginary part of the interval and turn it into a real-valued integrand over the real line. Setting
g
−
1
(
x
)
=
x
−
ζ
i
{\displaystyle g^{-1}(x)={\frac {x-\zeta }{i}}}
:
∫
C
0
e
1
2
f
″
(
ζ
)
(
z
−
ζ
)
2
d
z
=
∫
−
a
a
e
1
2
f
″
(
ζ
)
(
i
x
+
ζ
−
ζ
)
2
i
d
x
=
i
∫
−
a
a
e
−
1
2
f
″
(
ζ
)
x
2
d
x
{\displaystyle \int _{C_{0}}e^{{\frac {1}{2}}f^{''}(\zeta )(z-\zeta )^{2}}dz=\int _{-a}^{a}e^{{\frac {1}{2}}f^{''}(\zeta )(ix+\zeta -\zeta )^{2}}idx=i\int _{-a}^{a}e^{-{\frac {1}{2}}f^{''}(\zeta )x^{2}}dx}
∫
−
a
a
e
−
1
2
f
″
(
ζ
)
x
2
d
x
=
∫
−
∞
∞
e
−
1
2
f
″
(
ζ
)
x
2
d
x
−
2
∫
a
∞
e
−
1
2
f
″
(
ζ
)
x
2
d
x
{\displaystyle \int _{-a}^{a}e^{-{\frac {1}{2}}f^{''}(\zeta )x^{2}}dx=\int _{-\infty }^{\infty }e^{-{\frac {1}{2}}f^{''}(\zeta )x^{2}}dx-2\int _{a}^{\infty }e^{-{\frac {1}{2}}f^{''}(\zeta )x^{2}}dx}
Because
e
−
1
2
f
″
(
ζ
)
x
2
{\displaystyle e^{-{\frac {1}{2}}f^{''}(\zeta )x^{2}}}
is very small for large
x
{\displaystyle x}
:
|
∫
a
∞
e
−
1
2
f
″
(
ζ
)
x
2
d
x
|
≤
A
e
−
1
2
f
″
(
ζ
)
a
2
{\displaystyle \left|\int _{a}^{\infty }e^{-{\frac {1}{2}}f^{''}(\zeta )x^{2}}dx\right|\leq Ae^{-{\frac {1}{2}}f^{''}(\zeta )a^{2}}}
Due to our choice of
a
{\displaystyle a}
before, as
n
→
∞
{\displaystyle n\to \infty }
,
e
−
1
2
f
″
(
ζ
)
a
2
→
0
{\displaystyle e^{-{\frac {1}{2}}f^{''}(\zeta )a^{2}}\to 0}
.
Therefore, the integral can be estimated by a Gaussian integral which we know how to calculate:
∫
−
a
a
e
−
1
2
f
″
(
ζ
)
x
2
d
x
∼
∫
−
∞
∞
e
−
1
2
f
″
(
ζ
)
x
2
d
x
=
2
π
f
″
(
ζ
)
{\displaystyle \int _{-a}^{a}e^{-{\frac {1}{2}}f^{''}(\zeta )x^{2}}dx\sim \int _{-\infty }^{\infty }e^{-{\frac {1}{2}}f^{''}(\zeta )x^{2}}dx={\sqrt {\frac {2\pi }{f^{''}(\zeta )}}}}
Putting it all together:
1
2
π
i
∫
C
F
(
z
)
z
n
+
1
d
z
∼
e
f
(
ζ
)
2
π
i
∫
C
0
e
1
2
f
″
(
ζ
)
(
z
−
ζ
)
2
d
z
=
e
f
(
ζ
)
i
2
π
i
∫
−
a
a
e
−
1
2
f
″
(
ζ
)
x
2
d
x
∼
e
f
(
ζ
)
2
π
2
π
f
″
(
ζ
)
=
F
(
ζ
)
ζ
n
+
1
2
π
f
″
(
ζ
)
{\displaystyle {\frac {1}{2\pi i}}\int _{C}{\frac {F(z)}{z^{n+1}}}dz\sim {\frac {e^{f(\zeta )}}{2\pi i}}\int _{C_{0}}e^{{\frac {1}{2}}f^{''}(\zeta )(z-\zeta )^{2}}dz={\frac {e^{f(\zeta )}i}{2\pi i}}\int _{-a}^{a}e^{-{\frac {1}{2}}f^{''}(\zeta )x^{2}}dx\sim {\frac {e^{f(\zeta )}}{2\pi }}{\sqrt {\frac {2\pi }{f^{''}(\zeta )}}}={\frac {F(\zeta )}{\zeta ^{n+1}{\sqrt {2\pi f^{''}(\zeta )}}}}}
This formalises the conditions under which we can apply the saddle-point method. Definition from Flajolet and Sedgewick[4] and Wilf[5] . Also known as Hayman-admissibility[6] .
The function
F
(
z
)
{\displaystyle F(z)}
is admissible if:
F
(
z
)
{\displaystyle F(z)}
is a function with radius of convergence
R
(
0
<
R
≤
∞
)
{\displaystyle R\quad (0<R\leq \infty )}
There exists an
R
0
<
R
{\displaystyle R_{0}<R}
such that
F
(
r
)
>
0
(
R
0
<
r
<
R
)
{\displaystyle F(r)>0\quad (R_{0}<r<R)}
H1 :
lim
r
→
R
a
(
r
)
=
+
∞
{\displaystyle \lim _{r\to R}a(r)=+\infty }
and
lim
r
→
R
b
(
r
)
=
+
∞
{\displaystyle \lim _{r\to R}b(r)=+\infty }
H2 : There exists a function
δ
(
r
)
{\displaystyle \delta (r)}
defined for
R
0
<
r
<
R
{\displaystyle R_{0}<r<R}
such that
0
<
δ
(
r
)
<
π
{\displaystyle 0<\delta (r)<\pi }
and as
r
→
R
{\displaystyle r\to R}
F
(
r
e
i
θ
)
∼
F
(
r
)
e
i
θ
a
(
r
)
−
1
2
θ
2
b
(
r
)
{\displaystyle F(re^{i\theta })\sim F(r)e^{i\theta a(r)-{\frac {1}{2}}\theta ^{2}b(r)}}
uniformly for
|
θ
|
≤
δ
(
r
)
{\displaystyle |\theta |\leq \delta (r)}
H3 : Uniformly for
δ
(
r
)
≤
|
θ
|
≤
π
{\displaystyle \delta (r)\leq |\theta |\leq \pi }
and as
r
→
R
{\displaystyle r\to R}
F
(
r
e
i
θ
)
=
o
(
F
(
r
)
b
(
r
)
)
{\displaystyle F(re^{i\theta })=o\left({\frac {F(r)}{\sqrt {b(r)}}}\right)}
To find the coefficients of a function, we can use the Cauchy coefficient formula . This requires us to find the integral of a path in the complex plane. Imagine trying to estimate this integral, displayed as the red and green line below.
The biggest contribution to the integral comes from around the saddle-point (displayed in red) and the tail's contribution (displayed in green) is negligible (by H3 ).
Therefore, to estimate the integral of the entire path you can estimate the integral of just the red part of the path. This is the asymptotic relation described in H2 .
Example from Wilf[7] and Flajolet and Sedgewick[8] .
Say we want to estimate the coefficients of
e
z
{\displaystyle e^{z}}
:
e
z
{\displaystyle e^{z}}
has radius of convergence
+
∞
{\displaystyle +\infty }
and is positive for all
z
≥
0
{\displaystyle z\geq 0}
.
H1 :
a
(
z
)
=
z
(
e
z
)
′
e
z
=
z
e
z
e
z
=
z
{\displaystyle a(z)=z{\frac {(e^{z})'}{e^{z}}}=z{\frac {e^{z}}{e^{z}}}=z}
. Therefore,
lim
z
→
+
∞
z
=
+
∞
{\displaystyle \lim _{z\to +\infty }z=+\infty }
.
H1 :
b
(
z
)
=
z
2
d
2
d
z
2
ln
e
z
+
z
d
d
z
ln
e
z
=
z
2
d
2
z
d
z
2
+
z
d
z
d
z
=
z
{\displaystyle b(z)=z^{2}{\frac {d^{2}}{dz^{2}}}\ln e^{z}+z{\frac {d}{dz}}\ln e^{z}=z^{2}{\frac {d^{2}z}{dz^{2}}}+z{\frac {dz}{dz}}=z}
. Therefore,
lim
z
→
+
∞
z
=
+
∞
{\displaystyle \lim _{z\to +\infty }z=+\infty }
.
Find the saddle-point
ζ
{\displaystyle \zeta }
by solving the equation
a
(
ζ
)
=
ζ
=
n
{\displaystyle a(\zeta )=\zeta =n}
. Therefore,
ζ
=
n
{\displaystyle \zeta =n}
and the path of integration is the circle of radius
n
{\displaystyle n}
centred at the origin.
Choose
δ
(
n
e
i
θ
)
=
n
−
2
5
{\displaystyle \delta (ne^{i\theta })=n^{-{\frac {2}{5}}}}
.
H3 : For
n
−
2
5
≤
|
θ
|
≤
π
{\displaystyle n^{-{\frac {2}{5}}}\leq |\theta |\leq \pi }
as
n
→
+
∞
{\displaystyle n\to +\infty }
|
e
n
e
i
θ
|
=
e
n
cos
θ
≤
e
n
cos
n
−
2
5
=
o
(
e
n
n
)
{\displaystyle |e^{ne^{i\theta }}|=e^{n\cos \theta }\leq e^{n\cos n^{-{\frac {2}{5}}}}=o\left({\frac {e^{n}}{\sqrt {n}}}\right)}
.
H2 : For
n
<
1
e
n
e
i
θ
∼
e
n
+
i
θ
n
−
1
2
θ
2
n
=
e
n
e
i
θ
n
−
1
2
θ
2
n
{\displaystyle n<1\quad e^{ne^{i\theta }}\sim e^{n+i\theta n-{\frac {1}{2}}\theta ^{2}n}=e^{n}e^{i\theta n-{\frac {1}{2}}\theta ^{2}n}}
(due to the power series expansion of
e
i
θ
{\displaystyle e^{i\theta }}
).
Apply the theorem:
[
z
n
]
e
z
∼
e
n
n
n
2
π
n
{\displaystyle [z^{n}]e^{z}\sim {\frac {e^{n}}{n^{n}{\sqrt {2\pi n}}}}}
.
Saddle-points of higher order [ edit | edit source ]
Theorem from Flajolet and Sedgewick[9] .
If
F
(
z
)
{\displaystyle F(z)}
has a saddle-point of order
p
{\displaystyle p}
:
[
z
n
]
F
(
z
)
∼
ω
p
+
1
Γ
(
1
p
+
1
)
F
(
ζ
)
ζ
(
n
+
1
)
−
f
(
p
+
1
)
(
ζ
)
/
(
p
+
1
)
!
(
p
+
1
)
{\displaystyle [z^{n}]F(z)\sim {\frac {\omega }{p+1}}\Gamma ({\frac {1}{p+1}}){\frac {F(\zeta )}{\zeta ^{(n+1)}{\sqrt[{(p+1)}]{-f^{(p+1)}(\zeta )/(p+1)!}}}}}
where
ω
p
=
1
{\displaystyle \omega ^{p}=1}
.
↑ Flajolet and Sedgewick 2009, pp. 553.
↑ Flajolet and Sedgewick 2009, pp. 551-554.
↑ Flajolet and Sedgewick 2009, pp. 549.
↑ Flajolet and Sedgewick 2009, pp. 565.
↑ Wilf 2006, pp. 199.
↑ After Walter Hayman .
↑ Wilf 2006, pp. 198.
↑ Flajolet and Sedgewick 2009, pp. 555-557.
↑ Flajolet and Sedgewick 2009, pp. 603.
Flajolet, Philippe; Sedgewick, Robert (2009). Analytic Combinatorics (PDF) . Cambridge University Press.
Wilf, Herbert S. (2006). Generatingfunctionology (PDF) (3rd ed.). A K Peters, Ltd.
Widder, David Vernon (1941). The Laplace Transform . Princeton University Press.