Recursive Computation of the Fréchet Mean on Non-positively Curved Riemannian Manifolds with Applications

Computing the Riemannian center of mass or the finite sample Frechet mean has attracted enormous attention lately due to the easy availability of data that are manifold valued. Manifold-valued data are encountered in numerous domains including but not limited to medical image computing, mechanics, statistics, machine learning. It is common practice to estimate the finite sample Frechet mean by using a gradient descent technique to find the minimum of the Frechet function when it exists. The convergence rate of this gradient descent method depends on many factors including the step size and the variance of the given manifold-valued data. As an alternative to the gradient descent technique, we propose a recursive (incremental) algorithm for estimating the Frechet mean/expectation (iFEE) of the distribution from which the sample data are drawn. The proposed algorithm can be regarded as a geometric generalization of the well-known incremental algorithm for computing arithmetic mean, since it reinterprets this algebraic formula in terms of geometric operations on geodesics in the more general manifold setting. In particular, given known formulas for geodesics, iFEE does not require any optimization in contrast to the non-incremental counterparts and offers significant improvement in efficiency and flexibility. For the case of simply connected, complete and nonpositively curved Riemannian manifolds, we prove that iFEE converges to the true expectation in the limit. We present several experiments demonstrating the efficiency and accuracy of iFEE in comparison to the non-incremental counterpart for computing the finite sample Frechet mean of symmetric positive definite matrices as well as applications of iFEE to K-means clustering and diffusion tensor image segmentation.

[1]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.

[2]  Fatih Murat Porikli,et al.  Human Detection via Classification on Riemannian Manifolds , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Ghassan Hamarneh,et al.  DT-MRI segmentation using graph cuts , 2007, SPIE Medical Imaging.

[4]  M. Fréchet Les éléments aléatoires de nature quelconque dans un espace distancié , 1948 .

[5]  Zhizhou Wang,et al.  Tensor Field Segmentation Using Region Based Active Contour Model , 2004, ECCV.

[6]  Chi-Kwong Li Geometric Means , 2003 .

[7]  P. Thomas Fletcher,et al.  Riemannian geometry for the statistical analysis of diffusion tensor data , 2007, Signal Process..

[8]  Michael Lindenbaum,et al.  Sequential Karhunen-Loeve basis extraction and its application to images , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[9]  H. Le,et al.  Limit theorems for empirical Fr\'echet means of independent and non-identically distributed manifold-valued random variables , 2011, 1102.0228.

[10]  Maher Moakher,et al.  Symmetric Positive-Definite Matrices: From Geometry to Applications and Visualization , 2006, Visualization and Processing of Tensor Fields.

[11]  Baba C. Vemuri,et al.  On A Nonlinear Generalization of Sparse Coding and Dictionary Learning , 2013, ICML.

[12]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[13]  Hanqing Lu,et al.  Real-Time Visual Tracking via Incremental Covariance Model Update on Log-Euclidean Riemannian Manifold , 2009, 2009 Chinese Conference on Pattern Recognition.

[14]  James W. Davis,et al.  A recursive filter for linear systems on Riemannian manifolds , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[16]  René Vidal,et al.  On the Convergence of Gradient Descent for Finding the Riemannian Center of Mass , 2011, SIAM J. Control. Optim..

[17]  Zhizhou Wang,et al.  DTI segmentation using an information theoretic tensor dissimilarity measure , 2005, IEEE Transactions on Medical Imaging.

[18]  Rachid Deriche,et al.  Statistics on the Manifold of Multivariate Normal Distributions: Theory and Application to Diffusion Tensor MRI Processing , 2006, Journal of Mathematical Imaging and Vision.

[19]  J. Cheeger,et al.  Comparison theorems in Riemannian geometry , 1975 .

[20]  Xavier Pennec,et al.  A Riemannian Framework for Tensor Computing , 2005, International Journal of Computer Vision.

[21]  Baba C. Vemuri,et al.  Statistical Analysis of Tensor Fields , 2010, MICCAI.

[22]  Anthony J. Yezzi,et al.  Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification , 2001, IEEE Trans. Image Process..

[23]  D. Kendall SHAPE MANIFOLDS, PROCRUSTEAN METRICS, AND COMPLEX PROJECTIVE SPACES , 1984 .

[24]  Baba C. Vemuri,et al.  Recursive Karcher Expectation Estimators And Geometric Law of Large Numbers , 2013, AISTATS.

[25]  Maher Moakher,et al.  A Differential Geometric Approach to the Geometric Mean of Symmetric Positive-Definite Matrices , 2005, SIAM J. Matrix Anal. Appl..

[26]  Strong and Weak Laws of Large Numbers for Frechet Sample Means in Bounded Metric Spaces , 2012 .

[27]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Yongdo Lim,et al.  Weighted inductive means , 2014 .

[29]  Aarnout Brombacher,et al.  Probability... , 2009, Qual. Reliab. Eng. Int..

[30]  Harald Sverdrup-Thygeson Strong Law of Large Numbers for Measures of Central Tendency and Dispersion of Random Variables in Compact Metric Spaces , 1981 .

[31]  R. Bhattacharya,et al.  LARGE SAMPLE THEORY OF INTRINSIC AND EXTRINSIC SAMPLE MEANS ON MANIFOLDS—II , 2003 .

[32]  H. Le,et al.  Locating Fréchet means with application to shape spaces , 2001, Advances in Applied Probability.

[33]  Baba C. Vemuri,et al.  Tensor Splines for Interpolation and Approximation of DT-MRI With Applications to Segmentation of Isolated Rat Hippocampi , 2007, IEEE Transactions on Medical Imaging.

[34]  N. Hitchin A panoramic view of riemannian geometry , 2006 .

[35]  N. Ayache,et al.  Log‐Euclidean metrics for fast and simple calculus on diffusion tensors , 2006, Magnetic resonance in medicine.

[36]  J. Weickert,et al.  Level-Set Methods for Tensor-Valued Images , 2003 .

[37]  H. Ziezold On Expected Figures and a Strong Law of Large Numbers for Random Elements in Quasi-Metric Spaces , 1977 .

[38]  Rama Chellappa,et al.  Statistical Computations on Grassmann and Stiefel Manifolds for Image and Video-Based Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Hongdong Li,et al.  Rotation Averaging , 2013, International Journal of Computer Vision.

[40]  Sebastian Ehrlichmann,et al.  Metric Spaces Of Non Positive Curvature , 2016 .

[41]  P. Basser,et al.  Estimation of the effective self-diffusion tensor from the NMR spin echo. , 1994, Journal of magnetic resonance. Series B.

[42]  S. Helgason LIE GROUPS AND SYMMETRIC SPACES. , 1968 .

[43]  Baba C. Vemuri,et al.  A Novel Dynamic System in the Space of SPD Matrices with Applications to Appearance Tracking , 2013, SIAM J. Imaging Sci..

[44]  Shun-ichi Amari,et al.  Information geometry on hierarchy of probability distributions , 2001, IEEE Trans. Inf. Theory.

[45]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[46]  Baba C. Vemuri,et al.  Efficient Recursive Algorithms for Computing the Mean Diffusion Tensor and Applications to DTI Segmentation , 2012, ECCV.

[47]  R. Bhattacharya,et al.  Large sample theory of intrinsic and extrinsic sample means on manifolds--II , 2005, math/0507423.

[48]  Hasan Ertan Ceting Intrinsic Mean Shift for Clustering on Stiefel and Grassmann Manifolds , 2009 .

[49]  Federico Poloni,et al.  An effective matrix geometric mean satisfying the Ando-Li-Mathias properties , 2010, Math. Comput..

[50]  Karl-Theodor Sturm,et al.  Probability Measures on Metric Spaces of Nonpositive Curvature , 2003 .

[51]  P. Thomas Fletcher,et al.  Principal Geodesic Analysis on Symmetric Spaces: Statistics of Diffusion Tensors , 2004, ECCV Workshops CVAMIA and MMBIA.

[52]  Carl-Fredrik Westin,et al.  Segmentation of Thalamic Nuclei from DTI Using Spectral Clustering , 2006, MICCAI.

[53]  Peter Meer,et al.  Nonlinear Mean Shift over Riemannian Manifolds , 2009, International Journal of Computer Vision.

[54]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[55]  R. Bhatia,et al.  Riemannian geometry and matrix geometric means , 2006 .

[56]  Xavier Pennec,et al.  Intrinsic Statistics on Riemannian Manifolds: Basic Tools for Geometric Measurements , 2006, Journal of Mathematical Imaging and Vision.