Generally speaking, a tensor is defined as a series of some entries (for instance, numbers, functions, etc.) labeled by N indexes, with N called the order of the tensor. In this context, a scalar, which is one number and labeled by zero index, is a zeroth-order tensor. Many physical quantities are scalars, including energy, free energy, magnetization, and so on. Graphically, we use a dot to represent a scalar.
A D-component vector consists of D entries/numbers labeled by one index, and thus is a first-order tensor. For example, one can write the state vector of a spin-1/2 in a chosen basis (say the eigenstates of the spin operator S) as
A matrix is in fact a second-order tensor. Considering two spins as an example, the state vector can be written under an irreducible representation as a four- dimensional vector. Instead, under the local basis of each spin, we write it as
It is then natural to define an N-th order tensor. Considering, e.g., N spins, the 2N coefficients can be written as an N-th order tensor C, satisfying
In above, we use states of spin-1/2 as examples, where each index can take two values. For a spin-S state, each index can take d = 2S + 1 values, with d called the bond dimension. Besides quantum states, operators can also be written as tensors. A spin-1/2 operator Sα (α = x, y, z) is a (2 × 2) matrix by fixing the basis, where we have Sαt ₁ t ₂ e ₁ s ₂ = 〈 t ₁ t ₂ ∣ Sα ∣ s ₁ s ₂ 〉. In the same way, an N-spin operator can be written as a 2N-th order tensor, with N bra and N ket indexes.
We would like to stress some conventions about the “indexes” of a tensor (including matrix) and those of an operator. A tensor is just a group of numbers, where their indexes are defined as the labels labeling the elements. Here, we always put all indexes as the lower symbols, and the upper “indexes” of a tensor (if exist) are just a part of the symbol to distinguish different tensors. For an operator which is defined in a Hilbert space, it is represented by a hatted letter, and there will be no “true” indexes, meaning that both upper and lower “indexes” are just parts of the symbol to distinguish different operators.
- Anton, Howard (2005), Elementary Linear Algebra (Applications Version) (9th ed.), Wiley International
- Cartan, E., "Sur certaines expressions différentielles et le problème de Pfaff", Annales Scientifiques de l'École Normale Supérieure, 16: 239–332, doi:10.24033/asens.467