Nonlinear Mean Shift over Riemannian Manifolds

The original mean shift algorithm is widely applied for nonparametric clustering in vector spaces. In this paper we generalize it to data points lying on Riemannian manifolds. This allows us to extend mean shift based clustering and filtering techniques to a large class of frequently occurring non-vector spaces in vision. We present an exact algorithm and prove its convergence properties as opposed to previous work which approximates the mean shift vector. The computational details of our algorithm are presented for frequently occurring classes of manifolds such as matrix Lie groups, Grassmann manifolds, essential matrices and symmetric positive definite matrices. Applications of the mean shift over these manifolds are shown.

[1]  Narendra Ahuja,et al.  A Robust Probabilistic Estimation Framework for Parametric Image Models , 2004, ECCV.

[2]  Gregory D. Hager,et al.  Multiple kernel tracking with SSD , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[3]  Peter Meer,et al.  Simultaneous multiple 3D motion estimation via mode finding on Lie groups , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[4]  P. Basser,et al.  MR diffusion tensor spectroscopy and imaging. , 1994, Biophysical journal.

[5]  Robert M. Haralick,et al.  Analysis and solutions of the three point perspective pose estimation problem , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  J. Xavier,et al.  HESSIAN OF THE RIEMANNIAN SQUARED DISTANCE FUNCTION ON CONNECTED LOCALLY SYMMETRIC SPACES WITH APPLICATIONS , 2006 .

[7]  B. Vemuri,et al.  Fiber tract mapping from diffusion tensor MRI , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[8]  P. Perona,et al.  Motion estimation via dynamic vision , 1996, IEEE Trans. Autom. Control..

[9]  P. Absil,et al.  Riemannian Geometry of Grassmann Manifolds with a View on Algorithmic Computation , 2004 .

[10]  Rachid Deriche,et al.  Vector-valued image regularization with PDEs: a common framework for different applications , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Haifeng Chen,et al.  Robust fusion of uncertain information , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  S. Shankar Sastry,et al.  Optimization Criteria and Geometric Algorithms for Motion and Structure Estimation , 2001, International Journal of Computer Vision.

[13]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[14]  Thomas S. Huang,et al.  Theory of Reconstruction from Image Motion , 1992 .

[15]  Venu Madhav Govindu,et al.  Lie-algebraic averaging for globally consistent motion estimation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[16]  Stanley T. Birchfield,et al.  Spatiograms versus histograms for region-based tracking , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Ruzena Bajcsy,et al.  Euclid meets Fourier : Applying harmonic analysis to essential matrix estimation in omnidirectional cameras , .

[18]  Kenichi Kanatani,et al.  Geometric Structure of Degeneracy for Multi-body Motion Segmentation , 2004, ECCV Workshop SMVP.

[19]  Y. Chikuse.  Statistics on special manifolds , 2003 .

[20]  Anuj Srivastava,et al.  Statistical shape analysis: clustering, learning, and testing , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Peter Meer,et al.  Nonlinear Mean Shift for Clustering over Analytic Manifolds , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[22]  Rachid Deriche,et al.  DT-MRI Images: Estimation, Regularization, and Application , 2003, EUROCAST.

[23]  H. Karcher.  Riemannian center of mass and mollifier smoothing , 1977 .

[24]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Gérard G. Medioni,et al.  Tensor Voting: A Perceptual Organization Approach to Computer Vision and Machine Learning , 2006, Tensor Voting.

[26]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[27]  Peter Meer,et al.  Discontinuity Preserving Filtering over Analytic Manifolds , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Nicholas Ayache,et al.  Uniform Distribution, Distance and Expectation Problems for Geometric Features Processing , 1998, Journal of Mathematical Imaging and Vision.

[29]  P. Thomas Fletcher,et al.  Population Shape Regression from Random Design Data , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[30]  Gene H. Golub,et al.  Matrix computations , 1983 .

[31]  Robert T. Collins,et al.  Mean-shift blob tracking through scale space , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[32]  Peter Meer,et al.  Synergism in low level vision , 2002, Object recognition supported by user interaction for service robots.

[33]  Nicholas Ayache,et al.  Geometric Means in a Novel Vector Space Structure on Symmetric Positive-Definite Matrices , 2007, SIAM J. Matrix Anal. Appl..

[34]  Bruno Pelletier.  Kernel density estimation on Riemannian manifolds , 2005 .

[35]  W. Förstner,et al.  A Metric for Covariance Matrices , 2003 .

[36]  David Nistér,et al.  Preemptive RANSAC for live structure and motion estimation , 2005, Machine Vision and Applications.

[37]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[38]  Rachid Deriche,et al.  Inferring White Matter Geometry from Di.usion Tensor MRI: Application to Connectivity Mapping , 2004, ECCV.

[39]  Michael Werman,et al.  Affine Invariance Revisited , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[40]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Larry S. Davis,et al.  Efficient Kernel Density Estimation Using the Fast Gauss Transform with Applications to Color Modeling and Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Carlo Tomasi,et al.  Mean shift is a bound optimization , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Pietro Perona,et al.  Motion Estimation on the Essential Manifold , 1994, ECCV.

[44]  Xavier Pennec,et al.  A Riemannian Framework for Tensor Computing , 2005, International Journal of Computer Vision.

[45]  Yakup Genc,et al.  Nonlinear Mean Shift for Robust Pose Estimation , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[46]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Bo Thiesson,et al.  Image and Video Segmentation by Anisotropic Kernel Mean Shift , 2004, ECCV.

[48]  P. Thomas Fletcher,et al.  Principal geodesic analysis for the study of nonlinear statistics of shape , 2004, IEEE Transactions on Medical Imaging.

[49]  John B. Moore,et al.  Essential Matrix Estimation Using Gauss-Newton Iterations on a Manifold , 2007, International Journal of Computer Vision.

[50]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[51]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Larry S. Davis,et al.  Mean-shift analysis using quasiNewton methods , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[53]  P. Thomas Fletcher,et al.  Statistics of shape via principal geodesic analysis on Lie groups , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[54]  Anuj Srivastava,et al.  Riemannian Analysis of Probability Density Functions with Applications in Vision , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[55]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[56]  Miguel Á. Carreira-Perpiñán,et al.  Gaussian Mean-Shift Is an EM Algorithm , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  金谷 健一.  Group-theoretical methods in image understanding , 1990 .

[58]  W. Rossmann.  Lie Groups: An Introduction through Linear Groups , 2002 .