TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE

Euclidean statistics are often generalized to Riemannian manifolds by replacing straight-line interpolations with geodesic ones. While these Riemannian models are familiar-looking, they are restricted by the inflexibility of geodesics, and they rely on constructions which are optimal only in Euclidean domains. We consider extensions of Principal Component Analysis (PCA) to Riemannian manifolds. Classic Riemannian approaches seek a geodesic curve passing through the mean that optimize a criteria of interest. The requirements that the solution both is geodesic and must pass through the mean tend to imply that the methods only work well when the manifold is mostly flat within the support of the generating distribution. We argue that instead of generalizing linear Euclidean models, it is more fruitful to generalize non-linear Euclidean models. Specifically, we extend the classic Principal Curves from Hastie & Stuetzle to data residing on a complete Riemannian manifold. We show that for elliptical distributions in the tangent of spaces of constant curvature, the standard principal geodesic is a principal curve. The proposed model is simple to compute and avoids many of the pitfalls of traditional geodesic approaches. We empirically demonstrate the effectiveness of the Riemannian principal curves on several manifolds and datasets.

[1]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[2]  C. Rader Discrete Fourier transforms when the number of data samples is prime , 1968 .

[3]  R. Singleton An algorithm for computing the mixed radix fast Fourier transform , 1969 .

[4]  C. Burrus,et al.  Fast Convolution using fermat number transforms with applications to digital filtering , 1974 .

[5]  C. Rader,et al.  On the application of the number theoretic methods of high-speed convolution to two-dimensional filtering , 1975 .

[6]  S. Winograd On computing the Discrete Fourier Transform. , 1976, Proceedings of the National Academy of Sciences of the United States of America.

[7]  H. Karcher Riemannian center of mass and mollifier smoothing , 1977 .

[8]  T. Parks,et al.  A prime factor FFT algorithm using high-speed convolution , 1977 .

[9]  D. Kendall SHAPE MANIFOLDS, PROCRUSTEAN METRICS, AND COMPLEX PROJECTIVE SPACES , 1984 .

[10]  P. Diggle A Kernel Method for Smoothing Point Process Data , 1985 .

[11]  W. Kendall Probability, Convexity, and Harmonic Maps with Small Image I: Uniqueness and Fine Existence , 1990 .

[12]  R. Tibshirani Principal curves revisited , 1992 .

[13]  W. Stuetzle,et al.  Extremal properties of principal curves in the plane , 1996 .

[14]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[15]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[16]  John M. Lee Introduction to Smooth Manifolds , 2002 .

[17]  P. Thomas Fletcher,et al.  Statistics of shape via principal geodesic analysis on Lie groups , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[18]  P. Thomas Fletcher,et al.  Principal geodesic analysis for the study of nonlinear statistics of shape , 2004, IEEE Transactions on Medical Imaging.

[19]  Rachid Deriche,et al.  Inferring White Matter Geometry from Di.usion Tensor MRI: Application to Connectivity Mapping , 2004, ECCV.

[20]  Xavier Pennec,et al.  A Riemannian Framework for Tensor Computing , 2005, International Journal of Computer Vision.

[21]  Anuj Srivastava,et al.  Statistical shape analysis: clustering, learning, and testing , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Fatih Murat Porikli,et al.  Covariance Tracking using Model Update Based on Lie Algebra , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[23]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[24]  Thomas C. M. Lee,et al.  Automatic parameter selection for a k-segments algorithm for computing principal curves , 2006, Pattern Recognit. Lett..

[25]  Xavier Pennec,et al.  Intrinsic Statistics on Riemannian Manifolds: Basic Tools for Geometric Measurements , 2006, Journal of Mathematical Imaging and Vision.

[26]  Nicolas Courty,et al.  Exact Principal Geodesic Analysis for data on SO(3) , 2007, 2007 15th European Signal Processing Conference.

[27]  T. Hastie,et al.  Principal Curves , 2007 .

[28]  A. Munk,et al.  INTRINSIC SHAPE ANALYSIS: GEODESIC PCA FOR RIEMANNIAN MANIFOLDS MODULO ISOMETRIC LIE GROUP ACTIONS , 2007 .

[29]  R. Vidal,et al.  Intrinsic mean shift for clustering on Stiefel and Grassmann manifolds , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Søren Hauberg,et al.  Gaussian-Like Spatial Priors for Articulated Tracking , 2010, ECCV.

[31]  Rama Chellappa,et al.  Statistical Computations on Grassmann and Stiefel Manifolds for Image and Video-Based Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Rama Chellappa,et al.  Towards view-invariant expression analysis using analytic shape manifolds , 2011, Face and Gesture 2011.

[33]  Cristian Sminchisescu,et al.  Latent structured models for human pose estimation , 2011, 2011 International Conference on Computer Vision.

[34]  Søren Hauberg,et al.  A Geometric take on Metric Learning , 2012, NIPS.

[35]  Anuj Srivastava,et al.  Elastic Geodesic Paths in Shape Space of Parameterized Surfaces , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Michael J. Black,et al.  Lie Bodies: A Manifold Representation of 3D Human Shape , 2012, ECCV.

[37]  Søren Hauberg,et al.  Unscented Kalman Filtering on Riemannian Manifolds , 2013, Journal of Mathematical Imaging and Vision.

[38]  J. Marron,et al.  Analysis of principal nested spheres. , 2012, Biometrika.

[39]  Laurent Younes,et al.  Spaces and manifolds of shapes in computer vision: An overview , 2012, Image Vis. Comput..

[40]  Søren Hauberg,et al.  Natural metrics and least-committed priors for articulated tracking , 2012, Image Vis. Comput..

[41]  Marleen de Bruijne,et al.  Tree-Space Statistics and Approximations for Large-Scale Analysis of Anatomical Trees , 2013, IPMI.

[42]  Ross T. Whitaker,et al.  Regularization-free principal curve estimation , 2013, J. Mach. Learn. Res..

[43]  P. Thomas Fletcher,et al.  Probabilistic Principal Geodesic Analysis , 2013, NIPS.

[44]  Victor M. Panaretos,et al.  Principal Flows , 2014 .

[45]  Søren Hauberg,et al.  Model Transport: Towards Scalable Transfer Learning on Manifolds , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Stefan Sommer,et al.  Optimization over geodesics for exact principal geodesic analysis , 2010, Advances in Computational Mathematics.

[47]  Baba C. Vemuri,et al.  Tracking on the Product Manifold of Shape and Orientation for Tractography from Diffusion MRI , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[48]  Cristian Sminchisescu,et al.  Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.