Principal Curves on Riemannian Manifolds

Euclidean statistics are often generalized to Riemannian manifolds by replacing straight-line interpolations with geodesic ones. While these Riemannian models are familiar-looking, they are restricted by the inflexibility of geodesics, and they rely on constructions which are optimal only in Euclidean domains. We consider extensions of Principal Component Analysis (PCA) to Riemannian manifolds. Classic Riemannian approaches seek a geodesic curve passing through the mean that optimizes a criteria of interest. The requirements that the solution both is geodesic and must pass through the mean tend to imply that the methods only work well when the manifold is mostly flat within the support of the generating distribution. We argue that instead of generalizing linear Euclidean models, it is more fruitful to generalize non-linear Euclidean models. Specifically, we extend the classic Principal Curves from Hastie & Stuetzle to data residing on a complete Riemannian manifold. We show that for elliptical distributions in the tangent of spaces of constant curvature, the standard principal geodesic is a principal curve. The proposed model is simple to compute and avoids many of the pitfalls of traditional geodesic approaches. We empirically demonstrate the effectiveness of the Riemannian principal curves on several manifolds and datasets.

[1]  Victor M. Panaretos,et al.  Principal Flows , 2014 .

[2]  Marleen de Bruijne,et al.  Tree-Space Statistics and Approximations for Large-Scale Analysis of Anatomical Trees , 2013, IPMI.

[3]  Nicolas Courty,et al.  Exact Principal Geodesic Analysis for data on SO(3) , 2007, 2007 15th European Signal Processing Conference.

[4]  Søren Hauberg,et al.  A Geometric take on Metric Learning , 2012, NIPS.

[5]  Søren Hauberg,et al.  Probabilistic Solutions to Differential Equations and their Application to Riemannian Statistics , 2013, AISTATS.

[6]  J. Marron,et al.  Analysis of principal nested spheres. , 2012, Biometrika.

[7]  H. Karcher Riemannian center of mass and mollifier smoothing , 1977 .

[8]  Preface A Panoramic View of Riemannian Geometry , 2003 .

[9]  Ross T. Whitaker,et al.  Regularization-free principal curve estimation , 2013, J. Mach. Learn. Res..

[10]  John M. Lee Introduction to Smooth Manifolds , 2002 .

[11]  René Vidal,et al.  Intrinsic mean shift for clustering on Stiefel and Grassmann manifolds , 2009, CVPR.

[12]  Thomas C. M. Lee,et al.  Automatic parameter selection for a k-segments algorithm for computing principal curves , 2006, Pattern Recognit. Lett..

[13]  W. Stuetzle,et al.  Extremal properties of principal curves in the plane , 1996 .

[14]  Baba C. Vemuri,et al.  Tracking on the Product Manifold of Shape and Orientation for Tractography from Diffusion MRI , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Fatih Murat Porikli,et al.  Covariance Tracking using Model Update Based on Lie Algebra , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[16]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[17]  Xavier Pennec,et al.  Intrinsic Statistics on Riemannian Manifolds: Basic Tools for Geometric Measurements , 2006, Journal of Mathematical Imaging and Vision.

[18]  Cristian Sminchisescu,et al.  Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Cristian Sminchisescu,et al.  Latent structured models for human pose estimation , 2011, 2011 International Conference on Computer Vision.

[20]  W. Kendall Probability, Convexity, and Harmonic Maps with Small Image I: Uniqueness and Fine Existence , 1990 .

[21]  P. Thomas Fletcher,et al.  Probabilistic Principal Geodesic Analysis , 2013, NIPS.

[22]  Anuj Srivastava,et al.  Statistical shape analysis: clustering, learning, and testing , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[24]  Rama Chellappa,et al.  Statistical Computations on Grassmann and Stiefel Manifolds for Image and Video-Based Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Anuj Srivastava,et al.  Elastic Geodesic Paths in Shape Space of Parameterized Surfaces , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  P. Thomas Fletcher,et al.  Statistics of shape via principal geodesic analysis on Lie groups , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[27]  Søren Hauberg,et al.  Model Transport: Towards Scalable Transfer Learning on Manifolds , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Rachid Deriche,et al.  Inferring White Matter Geometry from Di.usion Tensor MRI: Application to Connectivity Mapping , 2004, ECCV.

[29]  T. Hastie,et al.  Principal Curves , 2007 .

[30]  Søren Hauberg,et al.  Unscented Kalman Filtering on Riemannian Manifolds , 2013, Journal of Mathematical Imaging and Vision.

[31]  P. Thomas Fletcher,et al.  Principal geodesic analysis for the study of nonlinear statistics of shape , 2004, IEEE Transactions on Medical Imaging.

[32]  A. Munk,et al.  INTRINSIC SHAPE ANALYSIS: GEODESIC PCA FOR RIEMANNIAN MANIFOLDS MODULO ISOMETRIC LIE GROUP ACTIONS , 2007 .

[33]  Ross T. Whitaker,et al.  Manifold modeling for brain population analysis , 2010, Medical Image Anal..

[34]  Michael J. Black,et al.  Lie Bodies: A Manifold Representation of 3D Human Shape , 2012, ECCV.

[35]  R. Vidal,et al.  Intrinsic mean shift for clustering on Stiefel and Grassmann manifolds , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  D. Kendall SHAPE MANIFOLDS, PROCRUSTEAN METRICS, AND COMPLEX PROJECTIVE SPACES , 1984 .

[37]  P. Diggle A Kernel Method for Smoothing Point Process Data , 1985 .

[38]  A. Munk,et al.  Intrinsic shape analysis: Geodesic principal component analysis for Riemannian manifolds modulo Lie group actions. Discussion paper with rejoinder. , 2010 .

[39]  Søren Hauberg,et al.  Natural metrics and least-committed priors for articulated tracking , 2012, Image Vis. Comput..

[40]  Xavier Pennec,et al.  A Riemannian Framework for Tensor Computing , 2005, International Journal of Computer Vision.

[41]  Rama Chellappa,et al.  Towards view-invariant expression analysis using analytic shape manifolds , 2011, Face and Gesture 2011.

[42]  Laurent Younes,et al.  Spaces and manifolds of shapes in computer vision: An overview , 2012, Image Vis. Comput..

[43]  R. Tibshirani Principal curves revisited , 1992 .

[44]  Stefan Sommer,et al.  Optimization over geodesics for exact principal geodesic analysis , 2010, Advances in Computational Mathematics.

[45]  Søren Hauberg,et al.  Gaussian-Like Spatial Priors for Articulated Tracking , 2010, ECCV.