Interactive Linear Algebra, Chapter 6: Orthogonality
by Dan Margalit, Joseph Rabinoff · Georgia Institute of Technology
Free open textbook chapter from Georgia Tech covering dot products, orthogonal complements, orthogonal projection, orthogonal sets with Gram-Schmidt, and the method of least squares, with interactive 3D demonstrations, worked examples and exercises.
More resources on Orthogonality
Wolfram MathWorld
MathWorld is an online mathematics encyclopedia from Wolfram Research offering detailed, browsable articles on topics across the math spectrum, including algebra, geometry, calculus, and number theory. Each entry includes definitions, theorems, formulas, diagrams, worked examples, and links to further reading.
Linear Algebra - Khan Academy
Learn linear algebra fundamentals, including matrices, vectors, and transformations, with Khan Academy's comprehensive course.
Linear combinations, span, and basis vectors | Chapter 2, Essence of linear algebra
Chapter 2 of 3Blue1Brown's Essence of Linear Algebra series, a short animated lesson on linear combinations, span and basis vectors in 2D and 3D. Viewers learn to picture which points a set of vectors can reach and what linear dependence means geometrically.
Linear Algebra (MIT 18.06)
Matrix theory and linear algebra: systems of equations, elimination, vector spaces and subspaces, orthogonality and least squares, determinants, eigenvalues and positive definite matrices. Includes 35 lecture videos plus problem sets and exams with solutions, giving the fluency needed for applied mathematics, engineering and data science.
Unit II: Least Squares, Determinants and Eigenvalues (MIT 18.06SC)
Covers orthogonal subspaces, projections, least squares, Gram-Schmidt, determinants and cofactors, eigenvalues, diagonalization, matrix exponentials and Markov matrices. Each session pairs a lecture video with summary notes, a recitation problem-solving video, and problems with solutions, so learners can fit data by least squares and diagonalize matrices.
Mathematics for Machine Learning: Linear Algebra
In this course on Linear Algebra we look at what linear algebra is and how it relates to vectors and matrices. Then we look through what vectors and matrices are and how to work with them, including the knotty problem of eigenvalues and eigenvectors, and how to use these to solve problems. Finally we look at how to use these to do fun things with datasets - like how to rotate images of faces and how to extract eigenvectors to look at how the Pagerank algorithm works. Since we're aiming at data-driven applications, we'll be implementing some of these ideas in code, not just on pencil and paper. Towards the end of the course, you'll write code blocks and encounter Jupyter notebooks in Python, but don't worry, these will be quite short, focussed on the concepts, and will guide you through if you’ve not coded before. At the end of this course you will have an intuitive understanding of vectors and matrices that will help you bridge the gap into linear algebra problems, and how to apply these concepts to machine learning.