What do you think?
Rate this book
Unraveling principal component analysis: A long-form guide through the mathematical fundamentals of data science and machine learning
Principal component analysis is probably the most extraordinary method of data analysis every devised. With a simple linear operation we can tease out human expression, age and sex from raw photographs. We can tell chimpanzee from human by the shape of a shoulder bone, and we can guess where someone lives, just from their DNA.
The method is easy to explain and easy to apply. But that doesn’t tell you where the magic comes from. It doesn’t tell you why a linear operation should be enough to turn a frowning person into a smiling one.
For that, we need to dig deeper. We need to dig up the foundations. That’s what this book is for. It starts with a quick and to-the-point introduction to what principal component analysis is, and how it works.
Then, it peels back the layers of the onion one by one. We dive into eigenvectors and -values, the spectral theorem, the singular value decomposition and rank decompositions.
Along the way, we’ll touch on subjects like complex numbers, determinants, characteristic polynomials and the fundamental theorem of algebra. We’ll do our best to cover them in the most intuitive way possible, with plenty of examples and illustrations. But the most important rule is that we leave no stone unturned. We will explain everything down to the foundations, without skipping any steps.
The method is easy to explain and easy to apply. But that doesn’t tell you where the magic comes from. It doesn’t tell you why a linear operation should be enough to turn a frowning person into a smiling one.
For that, we need to dig deeper. We need to dig up the foundations. That’s what this book is for. It starts with a quick and to-the-point introduction to what principal component analysis is, and how it works.
Then, it peels back the layers of the onion one by one. We dive into eigenvectors and -values, the spectral theorem, the singular value decomposition and rank decompositions.
Along the way, we’ll touch on subjects like complex numbers, determinants, characteristic polynomials and the fundamental theorem of algebra. We’ll do our best to cover them in the most intuitive way possible, with plenty of examples and illustrations. But the most important rule is that we leave no stone unturned. We will explain everything down to the foundations, without skipping any steps.
265 pages, Paperback
Published July 2, 2023
3 people are currently reading
16 people want to read
Ratings & Reviews
Friends & Following
Create a free account to discover what your friends think of this book!
Community Reviews
Displaying 1 of 1 review
December 21, 2025
I read only the first 60 pages. At this stage I think I got enough information on the PCA to follow scientific papers utilizing PCA (Turchin's papers on social complexity and papers on Ancient DNA). Excellent book giving both intuition, theory and application on PCA.
But really basic knowledge and understanding of linear algebra is required and even for me with Master Degree in Mathematics but with 70 year old brain the book was quite heavy to follow.
Even for this 60 pages I used many many hours.
But really basic knowledge and understanding of linear algebra is required and even for me with Master Degree in Mathematics but with 70 year old brain the book was quite heavy to follow.
Even for this 60 pages I used many many hours.
Displaying 1 of 1 review