The Wolfram Mathematica notebook which contains the code that produces all the Mathematica output in this web page may be downloaded at this link.
We denote by 𝔽 one of the following four fields: ℤ, a set of integers, ℚ, a set of rational numbers, ℝ, a set of real numbers, and ℂ, a set of complex numbers. However, norm definition involves only two of them, either ℝ or ℂ.
Dot Product
We met many times in previous sections a special linear combination of numerical vectors. For instance, a linear equation in n unknownsNote: The definition of the dot product does not restrict of applying it to two distinct isomorphic versions of the Cartesian product 𝔽n. So you can find the dot product of a row vector with a column vector. However, we avoid writing it as matrix multiplication,
Mathematica does not distinguish rows from columns. Dot product can be accomplished with two Mathematica commands:
Dot[a, b]
a . b

At the beginning of twentieth century, it was discovered that the dot product is needed for definition of dual spaces (see section in Part3). Then left-hand part of Eq.\eqref{EqDot.1} defines a linear functional on any n dimensional vector space independently on what field is used (ℂ or ℝ). Then one of the multipliers, say y in Eq.\eqref{EqDot.2}, is called a vector, but another counterpart, x is known as a covector. Such treatment of vectors in the dot product breaks their "equal "rights;" in many practical problems, these vectors, x and y, are indeed different, but sometimes look the same.
In geometry, to distinguish these two partners in Eq.\eqref{EqDot.2}, the vector y is called contravariant vector, and the covector x is referred to as covariant vector. In order to decide between these partners who is who, it is common to use superscript for coordinates of contravariant vector, y = [ y¹, y², y³], and subscript for covariant vectors, x = [x₁, x₂, x₃]. In physics, covariant vectors are also called bra-vectors, while contravariant vectors are known as ket-vectors.
Properties of dot product
The following basic properties of the dot product are important. They are all
easily proven from the above definition. In the following properties, u,
Note:
The inequality in part (4) was first proved by the French mathematician, engineer, and physicist baron Augustin-Louis Cauchy in 1821.
In 1859, Viktor Bunyakovsky extended this inequality to its integral version (that is, for the case where we have continuous summation). 30 years later, in 1888, Hermann Schwarz established the general form of this inequality, valid in vector spaces endowed with dot product.
Therefore, this inequality is usually referred to as Cauchy–Schwarz inequality, also Cauchy–Bunyakovsky–Schwarz inequality, or simply CBS-inequality.
Now suppose that neither u nor v is zero. It follows that ∥u∥ > 0 and ∥v∥ > 0 because the dot product x • x > 0 for any nonzero vector x. We have
\begin{align*}
0 &\le \left( \frac{{\bf u}}{\| {\bf u} \|} + \frac{{\bf v}}{\| {\bf v} \|} \right) \bullet \left( \frac{{\bf u}}{\| {\bf u} \|} + \frac{{\bf v}}{\| {\bf v} \|} \right)
\\
&= \left( \frac{{\bf u}}{\| {\bf u} \|} \bullet \frac{{\bf u}}{\| {\bf u} \|} \right) + 2 \left( \frac{{\bf u}}{\| {\bf u} \|} \bullet \frac{{\bf v}}{\| {\bf v} \|} \right) + \left( \frac{{\bf v}}{\| {\bf v} \|} \bullet \frac{{\bf v}}{\| {\bf v} \|} \right)
\\
&= \frac{1}{\| {\bf u} \|^2} \left( {\bf u} \bullet {\bf u} \right) + \frac{2}{\| {\bf u} \| \cdot \| {\bf v} \|} \left( {\bf u} \bullet {\bf v} \right) + \frac{1}{\| {\bf v} \|^2} \left( {\bf v} \bullet {\bf v} \right)
\\
&= \frac{1}{\| {\bf u} \|^2} \, \| {\bf u} \|^2 + 2 \left( \frac{{\bf u}}{\| {\bf u} \|} \bullet \frac{{\bf v}}{\| {\bf v} \|} \right) + \frac{1}{\| {\bf v} \|^2} \, \| {\bf v} \|^2
\\
&= 1 + 2 \left( \frac{{\bf u}}{\| {\bf u} \|} \bullet \frac{{\bf v}}{\| {\bf v} \|} \right) + 1
\end{align*}
Hence, −∥u∥ · ∥v∥ ≤ u • v. Similarly,
\begin{align*}
0 &\le \left( \frac{{\bf u}}{\| {\bf u} \|} - \frac{{\bf v}}{\| {\bf v} \|} \right) \bullet \left( \frac{{\bf u}}{\| {\bf u} \|} - \frac{{\bf v}}{\| {\bf v} \|} \right)
\\
&= \left( \frac{{\bf u}}{\| {\bf u} \|} \bullet \frac{{\bf u}}{\| {\bf u} \|} \right) - 2 \left( \frac{{\bf u}}{\| {\bf u} \|} \bullet \frac{{\bf v}}{\| {\bf v} \|} \right) + \left( \frac{{\bf v}}{\| {\bf v} \|} \bullet \frac{{\bf v}}{\| {\bf v} \|} \right)
\\
&= \frac{1}{\| {\bf u} \|^2} \left( {\bf u} \bullet {\bf u} \right) - \frac{2}{\| {\bf u} \| \cdot \| {\bf v} \|} \left( {\bf u} \bullet {\bf v} \right) + \frac{1}{\| {\bf v} \|^2} \left( {\bf v} \bullet {\bf v} \right)
\\
&= \frac{1}{\| {\bf u} \|^2} \, \| {\bf u} \|^2 - 2 \left( \frac{{\bf u}}{\| {\bf u} \|} \bullet \frac{{\bf v}}{\| {\bf v} \|} \right) + \frac{1}{\| {\bf v} \|^2} \, \| {\bf v} \|^2
\\
&= 1 - 2 \left( \frac{{\bf u}}{\| {\bf u} \|} \bullet \frac{{\bf v}}{\| {\bf v} \|} \right) + 1
\end{align*}
Therefore, u • v ≤ ∥u∥ · ∥v∥. By combining the two inequalities, we obtain the Caushy inequality.
A vector space, by definition, has no metric inside it, which is very desirable property. It turns out that the scalar product can be used to define length or distance between vectors transferring ℝn into a metric space, known as the Euclidean space.
Upon introducing the norm (meaning length or magnitude) of a vector, \( \displaystyle \quad \| {\bf v} \| = +\sqrt{{\bf v} \bullet {\bf v}} , \quad \) the Cauchy inequality can be written as
Geometric Properties of the Dot Product
Many years before Gibbs definition, ancient Greeks discovered that geometrically the product of the corresponding entries of the two sequences of numbers is equivalent to the product of their magnitudes and the cosine of the angle between them. This leads to introducing a metric (or length or distance) in the Cartesian product ℝ³ transferring it into the Euclidean space.
Originally, it was the three-dimensional physical space, but in modern mathematics there are Euclidean spaces of any positive integer dimension n, which are called Euclidean n-spaces.
Geometrical analysis yields further interesting properties of the dot product
operation that can then be used in nongeometric applications. If we rewrite the Cauchy inequality as an equality with parameter k:
Augustin-Louis Cauchy
Viktor Yakovlevich Bunyakovsky
Hermann Amandus Schwarz
Dot Product and Linear Transformations
Dot product in coordinate systems
The concepts of angle and radius were already used by ancient Greek astronomer and astrologer Hipparchus (190–120 BC). Although, Grégoire de Saint-Vincent and Bonaventura Cavalieri independently introduced the system's concepts in the mid-17th century, though the actual term polar coordinates has been attributed to Gregorio Fontana in the 18th century.
The polar coordinate system specifies a given point P(x, y) in a plane by using a distance r and an angle θ as its two coordinates (r, θ), where r is the point's distance from a reference point called the pole, and θ is the point's direction from the pole relative to the direction of the abscissa. The distance r from the pole is called the radial coordinate, radial distance or simply radius, and the angle θ is called the angular coordinate, polar angle, or azimuth.
The polar coordinates r and θ can be converted to the Cartesian coordinates x and y by using the trigonometric functions sine and cosine or complex numbers:
The polar coordinate system is extended to three dimensions in two ways: the cylindrical coordinate system adds a second distance coordinate, and the spherical coordinate system adds a second angular coordinate.
When ρ₁, θ₁, ϕ₁ and ρ₂, θ₂, ϕ₂ are known for two vectors u and v, we have
Applications
Scalar products are intimately associated with a variety of physical concepts. For example, the work done by a force applied at a point is defined as the product of the displacement and the component of the force in the direction of displacement (i.e., the projection of the force onto the direction of the displacement). Thus the component of the force perpendicular to the displacement "does no work." If F is the force and s is the displacement, then the work W is by definition equal toThe dot product is very important in physics. Let us consider an example. In classical mechanics, it is true that the ‘work’ that is done when an object is moved equals the dot product of the force acting on the object and the displacement vector:
Naturally, other physical quantities can be expressed in such a way. For example, the electrostatic potential energy gained by moving a charge q along a path C in an electric field E is −q∫C E • dr. We may also note that Ampère’s law concerning the magnetic field B associated with a current-carrying wire can be written as \[ \oint_C {\bf B} \bull {\text d}{bf r} = \mu_0 I , \] where I is the current enclosed by a closed path C traversed in a right-handed sense with respect to the current direction. ■
It is not always guaranteed that one can use such special coordinate systems (polar coordinates are an example in which the local orthonormal basis of vectors is not the coordinate basis). However, the dot product between a vector x and a covector y is invariant under all transformations because this product defines a functional generated by covector y. Then the given dot product is just one representation of this linear functional in particular coordinates. Making linear transformation with matrix A, we get
We can use the dot product to find the angle between two vectors. From the definition of the dot product, we get
The prime example of dot operation is work that is defined as the scalar product of force and displacement. The presence of cos(θ) ensures the requirement that the work done by a force perpendicular to the displacement is zero.
The dot product is clearly commutative, 𝑎 · b = b · 𝑎. Moreover, it distributes over vector addition
One can use the distributive property of the dot product to show that if (ax, ay, az) and (bx, by, bz) represent the components of a and b along the axes x, y, and z, then
The dot product of any two vectors of the same dimension can be done with the dot operation given as Dot[vector 1, vector 2] or with use of a period “. “ .
Applications in Physics
- What is the angle between the vectors i + j and i + 3j?
- What is the area of the quadrilateral with vertices at (1, 1), (4, 2), (3, 7) and (2, 3)?
- Aldaz, J. M.; Barza, S.; Fujii, M.; Moslehian, M. S. (2015), "Advances in Operator Cauchy—Schwarz inequalities and their reverses", Annals of Functional Analysis, 6 (3): 275–295, doi:10.15352/afa/06-3-20
- Bunyakovsky, Viktor (1859), "Sur quelques inegalités concernant les intégrales aux différences finies" (PDF), Mem. Acad. Sci. St. Petersbourg, 7 (1): 6
- Cauchy, A.-L. (1821), "Sur les formules qui résultent de l'emploie du signe et sur > ou <, et sur les moyennes entre plusieurs quantités", Cours d'Analyse, 1er Partie: Analyse Algébrique 1821; OEuvres Ser.2 III 373-377
- Deay, T. and Manogue, C.A., he Geometry of the Dot and Cross Products, Journal of Online Mathematics and Its Applications 6.
- Gibbs, J.W. and Wilson, E.B., Vector Analysis: A Text-Book for the Use of Students of Mathematics & Physics: Founded Upon the Lectures of J. W. Gibbs, Nabu Press, 2010.
- Schwarz, H. A. (1888), "Über ein Flächen kleinsten Flächeninhalts betreffendes Problem der Variationsrechnung" (PDF), Acta Societatis Scientiarum Fennicae, XV: 318, archived (PDF) from the original on 2022-10-09
- Solomentsev, E. D. (2001) [1994], "Cauchy inequality", Encyclopedia of Mathematics, EMS Press
- Vector addition