Mixture Probabilistic Principal Geodesic Analysis

Dimensionality reduction on Riemannian manifolds is challenging due to the complex nonlinear data structures. While probabilistic principal geodesic analysis~(PPGA) has been proposed to generalize conventional principal component analysis (PCA) onto manifolds, its effectiveness is limited to data with a single modality. In this paper, we present a novel Gaussian latent variable model that provides a unique way to integrate multiple PGA models into a maximum-likelihood framework. This leads to a well-defined mixture model of probabilistic principal geodesic analysis (MPPGA) on sub-populations, where parameters of the principal subspaces are automatically estimated by employing an Expectation Maximization algorithm. We further develop a mixture Bayesian PGA (MBPGA) model that automatically reduces data dimensionality by suppressing irrelevant principal geodesics. We demonstrate the advantages of our model in the contexts of clustering and statistical shape analysis, using synthetic sphere data, real corpus callosum, and mandible data from human brain magnetic resonance~(MR) and CT images.

[1]  I. Holopainen Riemannian Geometry , 1927, Nature.

[2]  M. Obata Certain conditions for a Riemannian manifold to be isometric with a sphere , 1962 .

[3]  D. Kendall SHAPE MANIFOLDS, PROCRUSTEAN METRICS, AND COMPLEX PROJECTIVE SPACES , 1984 .

[4]  I. Jolliffe Principal Component Analysis and Factor Analysis , 1986 .

[5]  David J. Ketchen,et al.  THE APPLICATION OF CLUSTER ANALYSIS IN STRATEGIC MANAGEMENT RESEARCH: AN ANALYSIS AND CRITIQUE , 1996 .

[6]  Sam T. Roweis,et al.  EM Algorithms for PCA and SPCA , 1997, NIPS.

[7]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[8]  Christopher M. Bishop,et al.  Bayesian PCA , 1998, NIPS.

[9]  Christopher M. Bishop,et al.  Mixtures of Probabilistic Principal Component Analyzers , 1999, Neural Computation.

[10]  Junghui Chen,et al.  Mixture Principal Component Analysis Models for Process Monitoring , 1999 .

[11]  Timothy F. Cootes,et al.  A mixture model for representing shape variation , 1999, Image Vis. Comput..

[12]  Michael E. Tipping,et al.  Probabilistic Principal Component Analysis , 1999 .

[13]  Robert Tibshirani,et al.  Estimating the number of clusters in a data set via the gap statistic , 2000 .

[14]  P. Thomas Fletcher,et al.  Principal geodesic analysis for the study of nonlinear statistics of shape , 2004, IEEE Transactions on Medical Imaging.

[15]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[16]  Fatih Murat Porikli,et al.  Pedestrian Detection via Classification on Riemannian Manifolds , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  P. Rousseeuw,et al.  Partitioning Around Medoids (Program PAM) , 2008 .

[18]  Søren Hauberg,et al.  Manifold Valued Statistics, Exact Principal Geodesic Analysis and the Effect of Linear Approximations , 2010, ECCV.

[19]  Rama Chellappa,et al.  Statistical Computations on Grassmann and Stiefel Manifolds for Image and Video-Based Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  P. Thomas Fletcher,et al.  Geodesic Regression and the Theory of Least Squares on Riemannian Manifolds , 2012, International Journal of Computer Vision.

[21]  Geodesic Regression and the Theory of Least Squares on Riemannian Manifolds , 2013 .

[22]  P. Thomas Fletcher,et al.  Probabilistic Principal Geodesic Analysis , 2013, NIPS.

[23]  Stefan Sommer,et al.  Optimization over geodesics for exact principal geodesic analysis , 2010, Advances in Computational Mathematics.

[24]  Moo K. Chung,et al.  Unified Heat Kernel Regression for Diffusion, Kernel Smoothing and Wavelets on Manifolds and Its Application to Mandible Growth Modeling in CT Images , 2014, Medical Image Anal..

[25]  P. Fletcher,et al.  Probabilistic geodesic models for regression and dimensionality reduction on riemannian manifolds , 2016 .

[26]  Baba C. Vemuri,et al.  Robust Fréchet Mean and PGA on Riemannian Manifolds with Applications to Neuroimaging , 2017, IPMI.

[27]  Christophe Ley,et al.  Modern Directional Statistics , 2017 .