Return to computing page for the first course APMA0330
Return to computing page for the second course APMA0340
Return to computing page for the fourth course APMA0360
Return to Mathematica tutorial for the first course APMA0330
Return to Mathematica tutorial for the second course APMA0340
Return to Mathematica tutorial for the fourth course APMA0360
Return to the main page for the course APMA0330
Return to the main page for the course APMA0340
Return to the main page for the course APMA0360
Introduction to Linear Algebra with Mathematica
The Schwartz space 𝒮(ℝ) was introduced by the French mathematician Laurent Schwartz (1915--2002), a different person from a German mathematician Hermann Schwarz, whose name is associated with the Cauchy-Bunyakovsky-Schwarz inequality. Actually, -Schwarz's contribution to this inequality is quite subtle---his 1888 paper contains no new information except excellent translation into German.
In opposite to to the Banach space 𝔏¹(ℝ) and Hilbert space 𝔏²(ℝ), the Fourier transform and its inverse are both well-defined in the Schwartz space 𝒮(ℂ) = S(ℂ).
We always use the notation ∫ f for \( \displaystyle \int_{-\infty}^{+\infty} f(x)\.{\text d}x \) throughout this chapter; especially,
the limits of integration are always ±∞ if nothing is said to the contrary.
The Schwartz space 𝒮 (or S) consists of those infinitely differentiable
complex-valued functions f ∈ 𝒮 on ℝ such that, for all non-negative integers 𝑎, b,
\[
\lim_{|x| \to \infty} |x|^a \left( \frac{\text d}{{\text d}x} \right)^b f(x) = 0 .
\]
Functions in the Schwartz space decay so rapidly at infinity that, even after differentiating or multiplying by x an arbitrary (finite) number of times, the resulting functions still decay at infinity.
Therefore, 𝒮(ℝ) = S = S(ℝ, ℂ) is called the class of rapidly decreasing complex-valued functions on ℝ because all their derivatives are bounded upon multiplication by any polynomial.
For any ϵ > 0, the Gaussian \( \displaystyle \quad e^{- \epsilon x^2} \quad \) is in 𝒮. Smooth functions of compact support provide additional examples. For convenience, the existence of such functions is presented below.
Example 1:
First we define a function h on ℝ by
\[
h(t) = \begin{cases}
0, & \quad\mbox{for} t \le 9 ,
\\
e^{-1/t} &\quad\mbox{for} t > 0 .
\end{cases}
\]
This function is infinitely differentiable on all of ℝ, and
all of its derivatives vanish at 0. Put g(t) = h(t) h(1 − t). Then g is also infinitely
differentiable. Furthermore, g(t) > 0 for 0 < t < 1 and g(t) = 0 otherwise. Thus, function g
is a smooth function with compact support.
■
End of Example 1
This example can be extended:
Proposition 1:
Let I denote any closed bounded interval on ℝ and let J denote any open interval containing I. Then there is an infinitely differentiable function g : ℝ → [0, 1] such that g = 1 on I and g = 0 off J.
Theorem 1:
The Schwartz space 𝒮 is a complex vector space. It is closed
under differentiation and under multiplication by x.
Left to the reader.
The Fourier transform of a function f ∈ 𝒮 is defined as the improper integral:
\begin{equation} \label{EqSchwartz.1}
ℱ(f) = f^F (\xi ) = \int_{-\infty}^{+\infty} f(x)\, e^{-{\bf j}x\xi} {\text d}x ,
\end{equation}
where j is the imaginary unit on the complex plane ℂ so j² = −1.
Sometimes the Fourier transform is defined with the factor √2π:
The inverse Fourier transform of a function fF ∈ 𝒮 is
\begin{equation} \label{EqSchwartz.2}
ℱ^{-1} \left[ f^F (\xi ) \right] (x) = \frac{1}{2\pi} \int_{-\infty}^{+\infty} f^F (\xi )\, e^{{\bf j}x\xi} {\text d}\xi = \frac{1}{2\pi}\,\lim_{N,M\to +\infty} \int_{-M}^{N} f^F (\xi )\, e^{{\bf j}x\xi} {\text d}\xi .
\end{equation}
The Wolfram Mathematicaweb page on the Fourier transform defines this transformation using two parameters, and symemtric definition of the Fourier transform:
\[
ℱ \left[ f (x) \right] (\xi ) = \frac{1}{\sqrt{2\pi}} \int_{-\infty}^{+\infty} f (x )\, e^{-{\bf j}x\xi} {\text d}x .
\]
FourierTransform[Exp[-t^2]*Sin[t], t, s]
Mathematica also has a numerical approximation to the Fourier transform with build-in command: NFourierTransform. The inverse Fourier transform is also implemented in Wolfram language:
Example 2:
Let Gσ denote the Gaussian distribution with variance σ²:
\[
G_{\sigma} (x) = \frac{1}{\sigma \sqrt{2\pi}}\, e^{- x^2/2\sigma^2} .
\]
This is a probability distribution because \( \displaystyle \quad \int_{\mathbb{R}} G_{\sigma} (x)\,{\text d}x = 1 . \)
NormalDistribution[0, sigma]
We can show this as follows. Let
\[
I = \int_{-\infty}^{+\infty} e^{-x^2 /2} {\text d} x .
\]
Then square I and use polar coordinates, we get
\[
I^2 = \int_{-\infty}^{+\infty} \int_{-\infty}^{+\infty} e^{-x^2 /2} e^{-y^2 /2}{\text d} x\,{\text d} y = \int_0^{2\pi} {\text d}\theta \int_0^{\infty} e^{-r^2 /2} r\,{\text d} r = 2\pi .
\]
Its Fourier transform is
Observation 1:
The Fourier transform is a linear transformation
in the Schwartz space, ℱ : 𝒮(ℝ) ⇾ 𝒮(ℂ) and ℱ :
𝒮(ℂ) ⇾ 𝒮(ℂ).
The definition of 𝒮 regards differentiation and multiplication on an equal
footing. Let \( \displaystyle \quad \mathtt{D} = {\text d}/{\text d}x \quad \)
denote differentiation and let M = Mjξ denote multiplication operator by jξ.
Working on 𝒮 is convenient for several reasons; in particular, the Fourier
transform exchanges these operations. Furthermore, as we will show in the following Theorem, the Fourier transform maps 𝒮 to itself bijectively. We can interpret the last
two items of the following Proposition as saying that the Fourier transform gives the spectral decomposition for the derivative operator.
Theorem 2:
The Fourier transform in the Schwartz space 𝒮
\[
ℱ(f) = f^F (\xi ) = \hat{f} (\xi ) = \int_{-\infty}^{+\infty} f(x)\, e^{-{\bf j}x\xi} {\text d}x
\]
possesses the following properties.
The Fourier transform ℱ maps the Schwartz space onto itself.
The inverse transform ℱ−1 does what it should:
\[
ℱ^{-1} \left( f^F \right) = f \in 𝒮.
\]
\( \displaystyle \quad \texttt{D} = ℱ^{-1} M \,ℱ \quad \) and \( \displaystyle \quad M = ℱ\,\texttt{D}\,ℱ^{-1} . \)
For any function f from 𝒮 = S, we have using integration by pars that
\[
ℱ_{x\to\xi}\left[ f' \right] = \int f' (x)\,e^{-{\bf j}x\xi} {\text d}x = -\int f(x) \left( e^{-{\bf j}x\xi} \right)' {\text d} x = {\bf j}\xi \int f(x) \, e^{-{\bf j}x\xi} {\text d}x .
\]
Also, by the rapid decrease of f ∈ 𝒮,
\[
ℱ_{x\to\xi}\left[ -{\bf j}x \,f \right] = \frac{\text d}{{\text d}x} \left[ f^F \right] ,
\]
and so, by induction,
\[
ℱ_{x\to\xi}\left[ \texttt{D}^p \left( -{\bf j} x \right)^q f \right] = \left( {\bf j} \xi \right)^p \texttt{D}^p f^F ,
\]
for any nonnegative integers p and q. Therefore,
\[
\left\vert \xi \right\vert^p \left\vert \texttt{D}^q f^F \right\vert \le \left\| \texttt{D}^p x^q f \right|_1 < \infty .
\]
Hence, the Fourier transform of f ∈ 𝒮 also belongs to 𝒮.
Now let f be a function with compact support and regard it as an
infinitely differentiable function on the circle −T/2 ≤ x ≤ T/2, as is periodic and extended by zero outside this interval [−T/2, T/2]. Then you can express f for |x| < T/2 as a rapidly convergent Fourier series of period T:
\begin{align*}
f(x) &= \sum_{n=-\infty}^{\infty} e^{{\bf j}nx/T} \frac{1}{T} \int_{-T/2}^{T/2} f(y)\,e^{-{\bf j}ny/T} {\text d}y
\\
&= \sum_{n=-\infty}^{\infty} e^{{\bf j}nx/T} \frac{1}{T} \, f^F \left( \frac{n}{T} \right) .
\end{align*}
But this is just a Riemann sum approximating to the integral
\[
ℱ_{y\to x}\left[ f^F (y) \right] = \int_{-\infty}^{\infty} f^F (y) \,e^{{\bf j}yx} {\text d}y .
\]
In order to prove that
\[
ℱ^{-1} \left[ f^F \right] = f ,
\]
for functions with compact support, you have only to check that the sum converges to the integral as T ↑ ∞
Example 3:
■
End of Example 3
Lemma 1:
For f, g ∈ 𝒮, we have
\[
\int_{-\infty}^{+\infty} f(x)\,\hat{g}(x)\,{\text d} x = \int_{-\infty}^{+\infty} \hat{f} (\xi )\,g(\xi )\,{\text d} \xi .
\]
Because of the rapid decay of f and g, we can write either side of the identity above
as a double integral, and integrate in either order. Then each side of this identity equals the double integral
\[
\int_{-\infty}^{+\infty} {\text d} \xi \,\int_{-\infty}^{+\infty} {\text d} x \,f(x)\,g(\xi )\, e^{-{\bf j}x\xo} .
\]
Example 4:
■
End of Example 4
Lemma 2:
Suppose that f is differentiable on ℝ and that its defivative is bounded. Let function g
satisfy the following conditions:
Since f is differentiable and f′ is bounded, the mean-value theorem
of calculus implies the following inequality
\[
\left\vert f(b) - f(a) \right\vert \le \sup_t \left\vert f' (t) \right\vert |b-a| = M \left\vert b-a \right\vert .
\]
We have \( \displaystyle \quad f(x) = f' (t)\,\int_{-\infty}^{+\infty} g(y) \,{\tyext d} y = \int_{-\infty}^{+\infty} f(x)\,g(y) \,{\tyext d} y \quad \) because of the first property of function g. Using mean value theorem, we get
\[
\left\vert \int_{-\infty}^{+\infty} f(x + \epsilon y)\,g(y)\,{\text d}y - f(x) \right\vert = \left\vert \int_{-\infty}^{+\infty} \left( f(x + \epsilon y) - f(x) \right) g(y) \,{\text d} y \right\vert
\]
\[
\le M \int_{-\infty}^{+\infty} \left\vert \epsilon\,y \right\vert |g(y)|\,{\text d}y .
\]
Since |yg(y)| is integrable, the expression in the right-hand side is bounded by a constant times ϵ. The desired conclusion then follows by the definition of a limit.
Example 5:
■
End of Example 5
Lemma 3:
If h ∈ 𝒮, then
\[
\lim_{\epsilon\to 0} \int_{-\infty}^{+\infty} h(t)\, e^-\epsilon^2 t^2 /2{} {\text d}t = \int_{-\infty}^{+\infty} h(t)\, {\text d}t .
\]
Given et > 0, we must show that
\[
\ledt\vert \int_{-\infty}^{+\infty} h(t) \left( 1 - e^{-\epsilon^2 t^2 /2} \right) {\text d}t \right\vert < \epsilon'
\]
for sufficiently small ϵ. Since h decays rapidly at ∞, there is an R such that
\[
\left\vert \int_{|t| > R} h(t) \left( 1 - e^{-\epsilon^2 t^2 /2} \right) {\text d}t \right\vert \le \int_{|t| > R} |h(t)|\,{\text d}t \lt; \frac{\epsilon'}{2} .
\]
Once this R is determined, we can choose ϵ sufficiently small such that
\[
\left\vert \int_{-R}^R h(t) \left( 1 - e^{-\epsilon^2 t^2 /2} \right) {\text d}t \right\vert \le 2R\,\sup |h| \left( 1 - e^{-\epsilon^2 t^2 /2} \right) < \frac{\epsilon'}{2} .
\]
The needed inequality follows.
Example 6:
■
End of Example 6
It is tempting to plug ϵ = 0 into the left-hand side or
into the limit in Lemma 3. Doing so is not valid without some assumptions;
the limit of an integral is not necessarily the integral of the limit. The reason is
that an integral is itself a limit, and one cannot in general interchange the order of
limits.
Theorem 3:
The Fourier transformation ℱ is a bijective map of the Schwartz space 𝒮 to itself. Furthermore, for f ∈ 𝒮, we
have the Fourier inversion formula
\[
ℱ^{-1} \left[ f^F (\xi ) \right] (x) = \frac{1}{2\pi} \int_{-\infty}^{+\infty} f^F (\xi )\, e^{{\bf j}x\xi} {\text d}\xi = \frac{1}{2\pi}\,\lim_{N,M\to +\infty} \int_{-M}^{N} f^F (\xi )\, e^{{\bf j}x\xi} {\text d}\xi = f \in 𝒮.
\tag{2}
\]
We use the Gaussian (with σ = 1) as an approximate identity and
apply Lemma 2. Let
\[
g(y) = \frac{1}{\sqrt{2\pi}} \,e^{-y^2 /2} .
\]
Since this function satisfies the hypotheses of Lemma 2, we get
\[
f(x) = \lim_{\epsilon\to 0} \frac{1}{\sqrt{2\pi}} \,\int_{-\infty}^{+\infty} f(x + \epsilon y)\,g(y)\,{\text d}y = \lim_{\epsilon\to 0} \frac{1}{\sqrt{2\pi}} \,\int_{-\infty}^{+\infty} f(x + \epsilon y)\,e^{-y^2 /2} \,{\text d}y .
\]
We know from Example 2 that the Fourier transform of the normal distribution is again the Gaussian distribution. So
\[
f(x) = \lim_{\epsilon\to 0} \frac{1}{2\pi} \int_{-\infty}^{+\infty} f(x + \epsilon y) \,{\text d}y \,\frac{1}{2\pi} \int_{-\infty}^{+\infty} e^{-\eta^2 /2} e^{-{\bf j}\,y\eta} {\text d}\eta .
\tag{E.1}
\]
In (E.1) we make the change of variables t = x + ϵy, obtaining
\[
f(x) = \lim_{\epsilon\to 0} \frac{1}{\sqrt{2\pi}} \,\int_{-\infty}^{+\infty} {\text d}t\,f(t)\, \frac{1}{\sqrt{2\pi}} \,\int_{-\infty}^{+\infty} {\text d}\eta\,e^{-\eta^2 /2} e^{-{\bf j}\left( t-x \right) \frac{\eta}{\epsilon}}
\]
Now we change variables by setting η = ϵξ; doing so introduces the factor \( \displaystyle \quad e^{-\epsilon^2 \xi^2 /2} \quad \)
and enables us to interchange the order of integration. The result gives
\[
f(x) = \lim_{\epsilon\to 0} \frac{1}{\sqrt{2\pi}} \,\int_{-\infty}^{+\infty} {\text d}\xi\,e^{-{\bf j}t\xi} \frac{1}{\sqrt{2\pi}} \,\int_{-\infty}^{+\infty} {\text d}t\,f(t)\, e^{-\epsilon^2 \eta^2 /2 e^{{\bf j} x\xi} .
\]
The inner integral is simply the Fourier transform of f. Hence we obtain
\[
f(x) = \lim_{\epsilon\to 0} \frac{1}{\sqrt{2\pi}} \,\int_{-\infty}^{+\infty} \hat{f} (\xi ) \, e^{{\bf j}x\xi} e^{- \epsilon^2 \xi^2 /2} {\text d}\xi .
\tag{E.2}
\]
To finally obtain the inversion formula, we use Lemma 3 to interchange the limit
and integral in (E.2)
Example 7:
■
End of Example 7
The inversion formula has the following consequence: For f ∈ 𝒮, we have
(ℱ² f)(x) = f(−x). Hence ℱ4 is the identity operator.
Prove that ex&rup2; belongs to 𝒮.
Let f(x, y) = |x||y| for (x, y) ≠ (0, 0). Show that
\[
\lim_{x\to 0} \lim_{y\to 0} f(x,y) \ne \lim_{y\to 0} \lim_{x\to 0} f(x,y) .
\]
Loomis, L.H. and Sternberg, S., Advanced Calculus, Jones & Bartlett, 1989.
Reed, M. and Simon, B., Methods of Modern Mathematical Physics, I: Func-
tional Analysis, Academic Press, 1972
Reed, M. and Simon, B., Methods of Modern Mathematical Physics, II: Fourier
Analysis, Self–Adjointness, Academic Press, 1975
Rudin, W., Functional Analysis, McGraw-Hill,
Return to Mathematica page
Return to the main page (APMA0340)
Return to the Part 1 Basic Concepts
Return to the Part 2 Fourier Series
Return to the Part 3 Integral Transformations
Return to the Part 4 Parabolic PDEs
Return to the Part 5 Hyperbolic PDEs
Return to the Part 6 Elliptic PDEs
Return to the Part 6P Potential Theory
Return to the Part 7 Numerical Methods