# Machine Learning Week 5 ## PCA(continue) * Reconstruction * To find a linear transformation $W\in \mathbb{R}^{M\times m}$ minimize the reconstruction error. * Projecting to $S_{PCA}$ yields the minimum mean squared error among all possible m-dimensional subspaces. * Eckart-Young-Mirsky Theorem * ![](https://i.imgur.com/fuYcaoj.png) * How EYM proves PCA yields minimum reconstruction error 1. WLOG assume zero mean. 2. ![](https://i.imgur.com/20nHmjx.png) 3. ![](https://i.imgur.com/SzXCPco.png) 4. Since![](https://i.imgur.com/usQsZAd.png) ![](https://i.imgur.com/qHOwKEa.png) * Proof of EYM Theorem * See the lecture.