Generalized Mode and Ridge Estimation

The generalized density is a product of a density function and a weight function. For example, the average local brightness of an astronomical image is the probability of finding a galaxy times the mean brightness of the galaxy. We propose a method for studying the geometric structure of generalized densities. In particular, we show how to find the modes and ridges of a generalized density function using a modification of the mean shift algorithm and its variant, subspace constrained mean shift. Our method can be used to perform clustering and to calculate a measure of connectivity between clusters. We establish consistency and rates of convergence for our estimator and apply the methods to data from two astronomical problems.

[1]  Deniz Erdogmus,et al.  Locally Defined Principal Curves and Surfaces , 2011, J. Mach. Learn. Res..

[2]  Larry A. Wasserman,et al.  Nonparametric Ridge Estimation , 2012, ArXiv.

[3]  Simon Salamon,et al.  MORSE THEORY IN THE 1990’S , 2001 .

[4]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[5]  Surajit Ray,et al.  A Nonparametric Statistical Approach to Clustering via Mode Identification , 2007, J. Mach. Learn. Res..

[6]  E. Giné,et al.  Rates of strong uniform consistency for multivariate kernel density estimators , 2002 .

[7]  Jesse Freeman,et al.  in Morse theory, , 1999 .

[8]  James Stephen Marron,et al.  Some asymptotics for multimodality tests based on kernel density estimates , 1992 .

[9]  Uwe Einmahl,et al.  Uniform in bandwidth consistency of kernel-type function estimators , 2005 .

[10]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[11]  M. Wand,et al.  ASYMPTOTICS FOR GENERAL MULTIVARIATE KERNEL DENSITY DERIVATIVE ESTIMATORS , 2011 .

[12]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  David H. Eberly,et al.  Ridges in Image and Data Analysis , 1996, Computational Imaging and Vision.

[15]  T. Sousbie.  The persistent cosmic web and its filamentary structure I: Theory and implementation , 2010, 1009.4015.

[16]  ChengYizong.  Mean Shift, Mode Seeking, and Clustering , 1995 .

[17]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[18]  Gérard Biau,et al.  Simple estimation of the mode of a multivariate density , 2003 .

[19]  Joseph P. Romano.  On weak convergence and optimality of kernel density estimates of the mode , 1988 .