The Equivalence Between Principal Component Analysis and Nearest Flat in the Least Square Sense

In this paper, we declare the equivalence between the principal component analysis and the nearest q-flat in the least square sense by showing that, for given m data points, the linear manifold with nearest distance is identical to the linear manifold with largest variance. Furthermore, from this observation, we give a new simpler proof for the approach to find the nearest q-flat.

[1]  Guangliang Chen,et al.  Spectral Curvature Clustering (SCC) , 2009, International Journal of Computer Vision.

[2]  P. Tseng.  Nearest q-Flat to m Points , 2000 .

[3]  G. Lerman,et al.  Robust recovery of multiple subspaces by geometric l_p minimization , 2011, 1104.3770.

[4]  H. Abdi,et al.  Principal component analysis , 2010 .

[5]  Edoardo Amaldi,et al.  A two-phase heuristic for the bottleneck k-hyperplane clustering problem , 2013, Comput. Optim. Appl..

[6]  Guangliang Chen,et al.  Foundations of a Multi-way Spectral Clustering Framework for Hybrid Linear Modeling , 2008, Found. Comput. Math..

[7]  Paul S. Bradley,et al.  k-Plane Clustering , 2000, J. Glob. Optim..

[8]  Lan Bai,et al.  Proximal Plane Clustering via Eigenvalues , 2013, ITQM.

[9]  I. Jolliffe.  Principal Component Analysis , 2002 .

[10]  Y. Jiang,et al.  Spectral Clustering on Multiple Manifolds , 2011, IEEE Transactions on Neural Networks.

[11]  Gilad Lerman,et al.  Randomized hybrid linear modeling by local best-fit flats , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Andreas Spanias,et al.  Multilevel dictionary learning for sparse representation of images , 2011, 2011 Digital Signal Processing and Signal Processing Education Meeting (DSP/SPE).

[13]  Guillermo Sapiro,et al.  Classification and clustering via dictionary learning with structured incoherence and shared features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Markus Ringnér,et al.  What is principal component analysis? , 2008, Nature Biotechnology.

[15]  Guillermo Sapiro,et al.  Discriminative k-metrics , 2009, ICML '09.

[16]  A. Stewart Fotheringham,et al.  Principal Component Analysis on Spatial Data: An Overview , 2013 .