Table of contents
5 chapters · 13 sections
Vectors & Data
- 1.1Data as vectors and matrices
- 1.2Norms and distances
- 1.3Inner products and similarity
Projections
- 2.1Orthogonal projections
- 2.2Least squares as projection
Matrix Decompositions
- 3.1Eigen-decomposition
- 3.2Singular value decomposition
- 3.3Low-rank approximation
Principal Component Analysis
- 4.1Covariance matrix
- 4.2PCA via SVD
- 4.3Dimensionality reduction
Embeddings
- 5.1Word and image embeddings
- 5.2Attention as matrix products