Introduction to Linear Algebra
Fundamentals
- Introduction
- Linear Systems
- Vectors
- Linear combinations
- Matrices
- Planes in ℝ³
- Row operations
- Gaussian elimination
- Reduced Row-Echelon Form
- Equation A x = b
- Sensitivity of solutions
- Iterative methods
- Linear independence
- Plane transformations
- Space transformations
- Linear transformations
- Affine maps
- Exercises
- Answers
Computations
- Introduction
- Manipulation of matrices
- Matrix transformations
- Block matrices
- Determinants
- Cofactors
- Cramer's rule
- Partitioned matrices
- Elementary Matrices
- Inverse matrices
- Elimination: A = LU
- PLU factorization
- Reflection
- Givens rotation
- Special matrices
- Exercises
- Answers
Direct Methods
- Introduction
- Motivation
- Vector Spaces
- Bases
- Dimension
- Coordinate systems
- Change of basis
- Linear transformations
- Compositions
- Isomorphisms
- Dual spaces
- Dual transformations
- Subspaces
- Intersections
- Direct sums
- Quotient spaces
- Vector products
- Cross products
- Matrix spaces
- Row space
- Range or Column space
- Rank
- Null spaces or Kernels
- Dimension Theorems
- Four subspaces
- Solving A x = b
- Exercises
- Answers
Iterative Methods
- Introduction
- Richardson's algorithm
- Jacpbi's algorithm
- Gauss--Seidel method
- SOR method
- SSOR method
- Convergence
- Gradient method
- Conjugate gradient
- Krylov subspaces
Eigenvalues
- Introduction
- Dot product
- Bilinear transformations
- Inner product
- Norm and distance
- Matrix norms
- Dual norms
- Dual transformations
- Orthogonality
- Gram--Schmidt Process
- Orthogonal sets
- Self-adjoint matrices
- Unitary matrices
- Projection operators
- QR-decomposition
- Least Square Approximation
- Quadratic forms
- Exercises
- Answers
SVD
- Introduction
- LU-decomposition
- Sylvester Formula
- Cholesky decomposition
- Schur decomposition
- Jordan decomposition
- Positive Matrices
- Roots
- Polar Factorization
- Spectral Decomposition
- Singular values
- SVD <
- Pseudoinverse
- Exercises
- Answers
Eigenvalues
- GPS Problem
- Graph Theory
- Error Correcting Codes
- Electric Circuits
- Markov Chains
- Cryptography
- Wave-length Transfer Matrix
- Computer Graphics
- Linear Programming
- Hill's Determinant
- Fibonacci Matrices
- Discrete Fourier Transform
- Fast Fourier Transform
- Curve fitting
Functions of Matrices
- Introduction
- Similar matrices
- Diagonalization
- Sylvester Formula
- The Resolvent Method
- Polynomial Interpolation
- Positive Matrices
- Roots <
- Pseudoinverse
- Exercises
- Answers
Miscellany
- Circles along curves
- TNB frames
- Tensors I
- Tensors II
- Differential forms
- Calculus
- Vector Representations
- Matrix Representations
- Change of Basis
- Orthonormal Diagonalization
- Generalized Inverse
Preliminaries
- Complex Number Operations
- Sets
- Polynomials
- Polynomials and Matrices
- Computer solves Systems of Linear Equations
- Location of Eigenvalues
- Power Method
- Iterative Method
- Similarity and Diagonalization
Glossary
Reference
This Book is licensed under Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License
Krylov Subspaces
Many iterative methods for solving linear systems Ax = b and for finding eigenvalues and eigenvectors of a matrix A are based on the Krylov space 𝕂
Numerical Analysis and Scientific Computation by J. Leader
- Krylov, A. N. (1931). "О численном решении уравнения, которым в технических вопросах определяются частоты малых колебаний материальных систем" [On the Numerical Solution of Equation by Which are Determined in Technical Problems the Frequencies of Small Vibrations of Material Systems]. Izvestiia Akademii Nauk SSSR (in Russian). 7 (4): 491–539.