Zahri-Edu › Math-University › Mathematics for Machine Learning & AI

AI 111

Linear Algebra for Machine Learning

Vectors and matrices as data, projections, least squares, eigendecomposition, SVD, PCA and low-rank approximation, with computational examples.

In preparation

The lecture notes for this course are being written. Below is the planned table of contents; chapters will be published one by one.

Table of contents

5 chapters · 13 sections

1

Vectors & Data

  1. 1.1Data as vectors and matrices
  2. 1.2Norms and distances
  3. 1.3Inner products and similarity
2

Projections

  1. 2.1Orthogonal projections
  2. 2.2Least squares as projection
3

Matrix Decompositions

  1. 3.1Eigen-decomposition
  2. 3.2Singular value decomposition
  3. 3.3Low-rank approximation
4

Principal Component Analysis

  1. 4.1Covariance matrix
  2. 4.2PCA via SVD
  3. 4.3Dimensionality reduction
5

Embeddings

  1. 5.1Word and image embeddings
  2. 5.2Attention as matrix products