Return to computing page for the first course APMA0330
Return to computing page for the second course APMA0340
Return to computing page for the fourth course APMA0360
Return to Mathematica tutorial for the first course APMA0330
Return to Mathematica tutorial for the second course APMA0340
Return to Mathematica tutorial for the fourth course APMA0360
Return to the main page for the course APMA0330
Return to the main page for the course APMA0340
Return to the main page for the course APMA0360
Introduction to Linear Algebra with Mathematica
This section is about a classical integral transformation, known as the
Fourier
transformation. This is the most
important and most personal discovery of Fourier, in which he had
no predecessors.
Since the Fourier transform is expressed through an indefinite integral, its numerical evaluation is an ill-posed problem. It is a custom to use the Cauchy principal value regularization for its definition, as well as for its inverse. Fourier transform gives the spectral decomposition of the derivative operator (more precisely, the momentum operator) \( {\bf j}\,\texttt{D} , \) where \( \texttt{D} = {\text d}/{\text d}x \) and j is the unit vector in the positive vertical direction on the complex plane ℂ. Fourier transformation and its applications is a wide area and books are written for this subject. Therefore, we are forced to include only basic results that we cannot avoid when dealing with differential equations.
As we have seen in the previous chapter, Fourier series is a useful tool for representing either periodic
functions or functions confined in limited range of interest. However, in many
problems, the function of interests, such as a single unrepeated pulse of force
or voltage, is nonperiodic over an infinite range. In such a case, we can still
imagine that the function is periodic with the period approaching infinity. In
this limit, the Fourier series becomes the Fourier integral.
To extend the concept of Fourier series to nonperiodic functions, let us
consider an absolutely integable function f ∈ 𝔏¹(ℝ) that satisfies Dirichlet consitions at every finite subinterval.
A standard Fourier series on the circle 𝕋 = ℝ/(2ℓℕ) of length 2ℓ, −ℓ ≤ t ≤ ℓ, can be written either
in exponential form
\[
f(t) \sim \frac{a_0}{2} + \sum_{k\ge 1} \left[ a_k \cos \left( \frac{\pi}{\ell}\,k t \right) + b_k \sin \left( \frac{\pi}{\ell}\, k t \right) \right] = S[f] .
\]
Here j is a unite imaginary vector on the complex plane ℂ, so j² = −1, and «P.V.» is the abbreviation for Cauchy principal value regularization.
The series S[f] may be thought of as an expansion of a periodic
function (of period T = 2ℓ) into simple harmonics. The coefficients in the Fourier expansion are determined via Euler--Fourier formulas:
\[
\begin{bmatrix} a_k (f) \\ b_k (f) \end{bmatrix} = \frac{1}{\ell} \int_{-\ell}^{\ell} f(x) \begin{bmatrix} \cos \left( \frac{\pi}{\ell}\,k x \right) \\ \sin \left( \frac{\pi}{\ell}\, k x \right) \end{bmatrix} {\text d} x
, \qquad k \in \mathbb{N} = \left\{ 0, 1, 2, 3, \ldots \right\} .
\]
Clearly, the choice of period T and the way of considering the Fourier series either in exponential or trigonometric form is just a matter of convenience because the finite partial sums are the same:
Each individual term either \( \displaystyle e^{n{\bf j}\pi t/\ell} \) or \( \displaystyle \cos \frac{k\pi t}{\ell} , \quad \sin \frac{k\pi t}{\ell} \) in Fourier series is a periodic function. Its
period Tk is determined by the relation that when t is increased by Tk, the
function returns to its previous value,
\[
\sin \frac{k\pi}{\ell} \left( t + T_k \right) = \sin \left( \frac{k\pi}{\ell}\, t + \frac{k\pi}{\ell}\, T_k \right) = \sin \frac{k\pi}{\ell}\, t .
\]
Now if t stands for time, then νn is just the usual temporal frequency. If the
variable is x, standing for distance, νn is simply the
spatial frequency. The distribution of the set of all frequencies νn is called the frequency
spectrum (plural: frequency spectra). To see what happens to the frequency spectra as ℓ increases, consider the cases where ℓ = 1, 5, 10, and 100. The corresponding frequencies of the
spectra are as follows:
n = 0
n = 1
n = 2
n = 3
n = 4
…
ℓ = 1,
νn =
0.0 ,
0.50
1.0
1.5
2.0
…
ℓ = 5,
νn =
0.0,
0.10
0.2
0.3
0.4
…
ℓ = 10,
νn =
0.0 ,
0.05
0.10
0.15
0.20
…
ℓ = 100,
νn =
0.0 ,
0.005
0.10
0.015
0.020
…
It is seen that as ℓ increases, the discrete spectrum becomes more and more
dense. It will approach a continuous spectrum as ℓ → ∞, and the Fourier
series appears to be an integral. This is indeed the case, if f(t) is absolutely
integrable over the infinite range.
Often the angular frequency, defined as ωn = 2π νn, is used to simplify the
writing. Since
According to our assumption that f(t) is absolutely integrable over the infinite range, this means that f ∈ 𝔏¹(ℝ) even when ℓ → ∞. Therefore,
Each of these integrals is known as Fourier integral. This development is purely formal.
However, it can be made rigorous, which is shown in the following example.
Example 1:
We assume that function f() is absolutely integable and satisfies Dirichlet consitions at every finite subinterval, so
\[
f(x) = \frac{a_0}{2} + \sum_{k\ge 1} \left[ a_k \cos \left( \frac{\pi}{\ell}\, k x \right) + b_k \sin \left( \frac{\pi}{\ell}\, k x \right) \right]
\]
at every finite interval (−ℓ, ℓ) assuming that function f is continuous at x.
For a periodic function f of period T, its Fourier coefficients are
There are several common conventions for defining the Fourier transform of an integrable
complex-valued function f : ℝ → ℂ.
In applications, the function f(x) is usually referred to as a
signal.
Here we will use the following definition, which is most common in
applications. The Fourier transform of the function f is traditionally denoted
by adding a circumflex:
\( \displaystyle {\hat {f}} \) or \( ℱ\left[ f \right] \) or \( f^F . \)
Actually, the Fourier transform measures the frequency content of the signal
f.
The exponential Fourier transform (or spectrum) of the function f is the complex-valued function defined for the real variable ξ defined (if it exists) as an improperRiemann integral
where \( \xi\cdot t = \xi_1 t_1 + \xi_2 t_2 + \cdots + \xi_n t_n \) is
the inner product and j is the unit vector in the positive
vertical direction on the complex plane ℂ so j² =
-1. The prefix V.P. indicates that the improper integral is evaluated
in the Cauchy principal value sense.
The functions f and
\( \displaystyle {\hat {f}} \) often are referred to as a Fourier integral pair or Fourier transform pair.
The units of variable ξ in Fourier transform formula \eqref{EqT.1} should be reciprocal to variable t because their product must be dimensionless. Indeed, expanding exponential function into Maclaurin power series \( \displaystyle e^u = 1 + u + \frac{u^2}{2} + \frac{u^3}{3!} + \cdots , \) we see that all powers of u = tξ should have the same dimension, which requires u to be dimensionless. If t has time units, then ξ should have units of frequency in order to make their product dimensionless.
The Fourier transform is usually defined in some function spaces. The most common spaces are defined below.
Let 𝔏¹(ℝ) denote the space of functions on ℝ that are Lebesgue-integrable on (−∞, ∞) functions with the norm
\[
\| f \| = \| f \|_1 = \int_{-\infty}^{\infty} \left\vert f(t) \right\vert {\text d}t < \infty .
\]
In this space, all functions which are equal almost everywhere are identified.
The space 𝔏∞(ℝ) is the vector space of bounded measurable functions on ℝ, with the supremum norm (also called the uniform norm or the Chebyshev norm or the infinity norm) defined by
Under this norm, the space of all continuous functions is a Banach space that is denoted as ℭ(ℝ) or C(ℝ).
Theorem 1:
Let f∈𝔏¹(ℝ) be a function which is Lebesgue-integrable on ℝ. Then its Fourier transform
ξ → fF(ξ) of f is a continuous bounded function for all ξ ∈ ℝ. So \( ℱ \) : 𝔏¹(ℝ) → ℭ(ℝ) ⊂ 𝔏∞(ℝ) and \( \| f^{F} \|_{\infty} \le \| f \|_1 . \)
Observe that for any \( \xi \in {\mathbb R}^n ,\)
\[
\left\vert \hat{f} \right\vert \le \int | f (t) |\,{\text d}t = \| f \|_1 .
\]
Therefore, the integral of Fourier transform of f∈𝔏¹(ℝ)
converges uniformly with respect to ξ on ℝ.
To show that Fourier transform fF is continuous, let 𝑎 and b be real numbers with 𝑎 < b
and use the triangle inequality to show that
By the uniform convergence of the integral defining fF, the numbers
𝑎 and b can be chosen so that the first two terms on the fight-hand side above are as
small as desired. With 𝑎 and b already chosen, the third term, which is no larger than
can also be made as small as desired by the continuity of the exponential if ξ − η is
small enough. This shows that Fourier transform fF is continuous.
◂
Example 2:
The Fourier transform of the lorentzian function with parameter 𝑎 > 0
Theorem 2:
Let f ∈ 𝔏¹(ℝ) be an integrable function such that its Fourier transform fF is itself integrable. Then
\[
ℱ^{-1} \left[ f^F \right] = f(x) \qquad \mbox{for almost all }x \in\mathbb{R} .
\]
There are some functions that are not necessarily integrable, but whose square is. Such is the “sine cardinal” function: \( \mbox{sinc}(x) = x^{-1} \sin x . \) It turns out that in physics, square integrable functions are of paramount importance and occur frequently. It is therefore advisable to extend the definition of the Fourier transform to the class of square integrable functions.
Let 𝔏²(ℝ) denote the space of measurable functions defined on ℝ, with complex values (up to equality almost everywhere) which are square integrable, with the norm
\[
\left\langle f , g \right\rangle = \int_{-\infty}^{\infty} \overline{f}(t)\,g(t)\, {\text d}t = \left\langle f \.\vert\, g \right\rangle ,
\]
𝔏²(ℝ) becomes the Hilbert space. The Fourier transform maps 𝔏²(ℝ) → 𝔏²(ℝ) as an (isometric) isomorphism.
A fundamental result due to Riesz and Fischer, which is not obvious at all, shows that 𝔏²(ℝ) is complete.
Note that the inverse Fourier transformation is an ill-posed problem; therefore, its application must be done with care (see Kabanikhin's survey).
In the above definition, the principal value means that the limit is taken over
symmetrical interval
So the standard definition requires that both bounds N and M approach infinity independently of each other.
The Fourier transformation and its inverse are a bounded operations in the space of square
integrable functions denoted by 𝔏² (other common notations are L² or L2). The following equality was proved hy Michel Plancherel in 1910. It is also known as Parseval's formula:
Plancherel's Theorem:
The Fourier transform is an isometry on 𝔏², that is,
\( \| f \|_{𝔏^2}^2 = \int_{-\infty}^{\infty} | f(x) |^2
{\text d}x = \left( 2\pi \right)^{-1} \int_{-\infty}^{\infty} | \hat{f}(\xi ) |^2 {\text d}\xi
= \left( 2\pi \right)^{-1} \| \hat{f} \|_{𝔏^2}^2 . \) In multidimensional case, we have
Recall that a real-valued function f : ℝ → ℝ is called an absolutely integrable function if it is a function whose absolute value is integrable, meaning that the integral of the absolute value over the whole domain is finite:
\begin{equation} \label{EqT.6}
\| f \|_1 = \int_{-\infty}^{\infty} \left\vert f(x) \right\vert {\text d} x < \infty .
\end{equation}
We abbreviate it as f ∈ 𝔏¹(ℝ).
A square-integrable function, also called a quadratically integrable function or 𝔏²(ℝ) is a real- or complex-valued measurable function for which the integral of the square of the absolute value is finite:
\begin{equation} \label{EqT.7}
\| f \|^2_2 = \int_{-\infty}^{\infty} \left\vert f(x) \right\vert^2 {\text d} x < \infty .
\end{equation}
A function of bounded variation is a real-valued function whose total variation is bounded (finite). This is equivalent to say that the function has on a compact interval finite number of maximum and minimum; a function of finite variation can be represented by the difference of two monotonic functions having discontinuities, but at most countably many. Obviously, a function of bounded variation cannot have an infinite jump. A real-valued function f is said to satisfy the Dirichlet conditions if
f is absolutely integrable.
f is of bounded variation in any given compact interval.
f must have a finite number of discontinuities in any given bounded interval, and the discontinuities cannot be infinite.
A sufficient condition for existence of the Fourier transform \( \displaystyle {\hat {f}} \) is its absolutely integrability, f ∈ 𝔏¹(ℝ). In this case, \( \displaystyle {\hat {f}} \) is uniformly continuous on ℝ and
The inversion Fourier transformation formula is based on the following
statement.
Lemma: If a function f(x+u) satisfies the Dirichlet conditions in an interval 𝑎 < u < b, then
\[
\lim_{\omega \to \infty} \frac{2}{\pi} \int_a^b f(x+u) \,\frac{\sin\,\omega u}{\omega}\,{\text d} u = \begin{cases}
f(x+0) + f(x-0) , & \ \mbox{ if } a < 0 < b ,
\\
f(x+0) , & \ \mbox{ if } a=0 < b ,
\\
f(x-0) , & \ \mbox{ if } a < 0 = b ,
\\
0 , & \ 0 < a < b \mbox{ or } a < b < 0 .
\end{cases}
\]
The Fourier integral exists not for arbitrary functions, but for functions that approached zero at infinity. Although the exponential Fourier integral may not converge for a particular function f, the following functions
where ξ = u + jv, may exist: the latter for large enough positive v, and the former for large in absolute value negative v. The inverse Fourier transform gives
The statement that f can be reconstructed from
\( \displaystyle {\hat {f}} \)
is known as the Fourier inversion theorem, and was first introduced in Fourier'sAnalytical Theory of Heat.
Example 3:
Suppose a function f(t) and its derivative df/dt are both piecewise continuous functions for all t ≥ 0. If the function f(t) is not integrable, then its Fourier transform does not exist. However, it may happen that f(t) times an exponentially decay function could be integrable, so the Fourier transform of such product exists. We define an extension
\[
g(t) = \begin{cases}
e^{-ct} f(t) , & \ \mbox{ for } t \ge 0, \\
0, & \ \mbox{ for } t < 0,
\end{cases}
\]
where c is a positive real constant. Then obviously
\( \int_{\mathbb{R}} \left\vert g(t) \right\vert {\text d}t < \infty , \) is convergent so that its Fourier transform exists. According to the Fourier integral theorem
The latter is used in Mathematica under the name FourierTransform.
There is no agreement on what particular definition of Fourier transform to be
used. Of course, theoretical expositions of this topic prefer to use unitary
versions.
Theorem 5:
The Fourier transformation gives the spectral representation of the momentum operator \( \displaystyle \hat{p} = -{\bf j}\,\frac{\text d}{{\text d} x} ,
\) that is,
This main property of the Fourier transform can be extended for multi-dimensional case.
Corollary:
If a differentiable function is absolutely integrable, that is
\( f \in 𝔏^1 \left( {\mathbb R}^n \right) , \) and
\( \partial f/\partial x_j \in 𝔏^1 \left( {\mathbb R}^n
\right) , \) then the Fourier transform of the derivative is
The sinc function sinc(x) is a function that arises frequently in signal processing and
the theory of Fourier transforms. Its inverse Fourier transform is called the
"sampling function" or "filtering function." The full name of the function
is "sine cardinal," but it is commonly referred to by its abbreviation, "sinc."
In Mathematica, sinc function has a default notation: Sinc[x].
The zero crossings of the unnormalized sinc are at non-zero integer multiples
of π, while zero crossings of the normalized sinc occur at non-zero integers.
The function \( \displaystyle y(x) = a\,\mbox{sinc}(a\,x)
= \frac{\sin ax}{x} \) is a bounded solution of the initial value problem for the following second order differential
equation with regular singular point at the origin
Limit[Integrate[(1 + x^2)^(-1) *a*Sinc[a*x], {x, -Infinity,
Infinity}], a -> Infinity]
\[Pi]
The other solution \( \displaystyle \frac{\cos ax}{x} \)
of the differential equation \( x\, y'' + 2\,y' + a^2 x\,y =0 \) is unbounded at x = 0, unlike its sinc function counterpart;
obviously, sinc(0) = 1.
The sinc function is a Forier transform of the tent function
\[
f(x) = \begin{cases}
0, & \ \mbox{ for} \quad x < -w , \\
h \left( 1 - \frac{|x|}{w} \right) , & \ \mbox{ for} \quad |x| < w , \\
0, & \ \mbox{ for} \quad x > w.
\end{cases}
\]
Example 4:
In applications, it is common to approximate functions with piecewise constant
(or step) functions. Although these functions are simple, they are very
important: they are used to approximate other more complicated functions.
A piecewise function is a function that is defined by several subfunctions.
If each piece is a constant function, then the piecewise function is called
Piecewise constant function or Step function. Let us consider one of them:
This step function is commonly referred to as filtering function because the
multiplication by it leads to elimination of the high frequency contributions
to the signal. Therefore, it is also called a low-pass filter.
Its Fourier transform is
We verify the answers with standard Mathematica commands:
f0[x_] = Refine[Piecewise[{{1, -a < x < a}}], a > 0];
Sqrt[2*Pi]*Refine[FourierTransform[f0[x], x, s], a > 0]
(2 Sin[a s])/s
and
Refine[InverseFourierTransform[a*Sinc[a*x], x, t], a > 0]/Sqrt[2*Pi]
1/4 (Sign[a - t] + Sign[a + t])
Note that Mathematica uses the unitary definition for Fourier
transformations and its inverse:
\( \displaystyle f^F (\xi ) = \frac{1}{\sqrt{2\pi}}
\int f(x)\,e^{{\bf j} x\cdot \xi} \,{\text d} x \) and
\( \displaystyle f (x ) = \frac{1}{\sqrt{2\pi}}
\int f^F (\xi )\,e^{-{\bf j} x\cdot \xi} \,{\text d} \xi . \)
Multiplying the Fourier transform \( \hat{f} (\xi ) \)
by the low-pass filter Π(ξ) effectively clips all the high
frequencies (those of frequencies that are > ξ). By taking the inverse
transform of this product, we remove the contribution of the high frequencies
of the signal f(x). Calculations show that
The Riemann-Lebesque Lemma:
If f ∈ 𝔏¹(ℝ), then
\( \displaystyle \lim_{\xi \to \infty} \,\left\vert \hat{f} (\xi ) \right\vert = 0 , \) so
\( \displaystyle \lim_{\xi \to \infty} \,\int_{-\infty}^{\infty} f(t)\,e^{{\bf j} t\cdot \xi} \,{\text d} t = 0 . \)
The convolution theorem:
If f, g : ℝ → ℝ are integrable and g is piecewise contintinuous.
Then the convolution f ☆ g is integrable on ℝ and its Fourier transform is the product of
their Fourier transforms:
\[
ℱ \left[ f\star g \right] = ℱ \left[ f \right] \cdot
ℱ
\left[ g \right] , \qquad\mbox{with} \quad \left( f\star g \right) (x) =
\int f(x-t)\,g(t)\,{\text d}t .
\]
Note that evaluation of the convolution integral (which is usually denoted either by ☆ or *) is an ill-posed problem.
So the limit in the right-hand side does not exist because the exponential function \( e^{{\bf j}B\xi} \) has no limit at infinity. Now we find its limit in weak sense. Choosing a probe function
ϕ, we multiply by it and integrate:
To find its value, we connect the end points -K and K on real axis ℝ with semi-circle in complex plane ℂ to make a close loop. Then we apply the residue theorem. Since we have half of a circle, we have only half of the residure:
Talvila, E., Fourier transform inversion using an elementary differential equation and a contour integral, American Mathematical Monthly, 2019, Vol. 126, No. 8, pp.717--727.
Titchmarsh, E.C. Introduction to the Theory of Fourier Integrals, 3rd ed. Oxford, England: Clarendon Press, 1948.
Yip, P., Sine and cosine transforms from the book The Transforms and Applications Handbook: Second Edition. Ed. Alexander D. Poularikas, Boca Raton: CRC Press LLC, 2000.
Return to Mathematica page
Return to the main page (APMA0360)
Return to the Part 1 Basic Concepts
Return to the Part 2 Fourier series
Return to the Part 3 Integral Transformations
Return to the Part 4 Parabolic Differential Equations
Return to the Part 5 Hyperbolic Differential Equations
Return to the Part 6 Elliptic Equations
Return to the Part 7 Numerical Methods