Lesson 1
Vectors
No exercise images committed
Mathematics of AI
Exercises
Handwritten work organized by lesson, with each exported page available in reading order.
- Images
- 177
- Historical Reviews
- 8
LessonArtifacts
Lesson 2
Matrices as Linear Transformations
Lesson 3
Matrix Multiplication and Composition
Lesson 4
Determinants
Lesson 5
Inverse Matrices
Lesson 6
Eigenvectors and Eigenvalues
Lesson 7
Change of Basis
Lesson 8
Projection
Lesson 9
Least Squares
Lesson 10
Singular Value Decomposition
Lesson 11
Principal Component Analysis
Lesson 12
Covariance
Lesson 13
Probability as Linear Algebra
Lesson 14
Covariance Geometry
Page 1: exercise-1.jpgPage 2: exercise-2.jpgPage 3: exercise-3.jpgPage 4: exercise-4.jpgPage 5: exercise-5.jpgPage 6: practice-1-exercise-1.jpgPage 7: practice-1-exercise-2.jpgPage 8: practice-1-exercise-3.jpgPage 9: practice-2-exercise-1.jpgPage 10: practice-2-exercise-2.jpgPage 11: practice-2-exercise-3.jpgPage 12: practice-2-exercise-4.jpgPage 13: practice-2-exercise-5.jpgPage 14: practice-2-exercise-6.jpg
Lesson 15
Multivariate Gaussian
Lesson 16
Maximum Likelihood Estimation
Lesson 17
Loss Functions
Lesson 18
MAP Estimation
Lesson 19
Bayesian Estimation Introduction
Lesson 20
Bayesian Estimation Update
Lesson 21
Bayesian Predictive Distributions
Lesson 22
Model Complexity
Lesson 23
Regularization
Lesson 24
Early Stopping
Lesson 25
Dropout
Lesson 26
Gradient Descent
Lesson 27
Stochastic Gradient Descent
Lesson 28
Momentum
Lesson 29
Adam
Lesson 30
Learning Rate Schedules
Lesson 31
Hessians and Curvature
Lesson 32
Convexity
Lesson 33
Constrained Optimization
Lesson 34
Partial Derivatives
Lesson 35
Gradients
Lesson 36
Jacobians
Lesson 37
Chain Rule for Computation Graphs
Page 1: exercise-01.jpgPage 2: exercise-02.jpgPage 3: exercise-03.jpgPage 4: exercise-04.jpgPage 5: exercise-05.jpgPage 6: exercise-06.jpgPage 7: exercise-07.jpgPage 8: exercise-08.jpgPage 9: exercise-09.jpgPage 10: exercise-10.jpgPage 11: exercise-11.jpgPage 12: exercise-12.jpgPage 13: exercise-13.jpgPage 14: exercise-14.jpgPage 15: exercise-15.jpgPage 16: exercise-16.jpgPage 17: exercise-17.jpgPage 18: exercise-18.jpg
Lesson 38
Matrix Calculus Notation
Lesson 39
Taylor Series and Local Approximation
No exercise images committed
Lesson 40
Perceptrons and Linear Layers
No exercise images committed