Mean Shift, Mode Seeking, and Clustering

Mean shift, a simple interactive procedure that shifts each data point to the average of data points in its neighborhood is generalized and analyzed in the paper. This generalization makes some k-means like clustering algorithms its special cases. It is shown that mean shift is a mode-seeking process on the surface constructed with a "shadow" kernal. For Gaussian kernels, mean shift is a gradient mapping. Convergence is studied for mean shift iterations. Cluster analysis if treated as a deterministic problem of finding a fixed point of mean shift that characterizes the data. Applications in clustering and Hough transform are demonstrated. Mean shift is also considered as an evolutionary strategy that performs multistart global optimization. >

[1]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[2]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[3]  P. Brucker On the Complexity of Clustering Problems , 1978 .

[4]  Shokri Z. Selim,et al.  K-Means-Type Algorithms: A Generalized Convergence Theorem and Characterization of Local Optimality , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  R. S. Wallace,et al.  A modified Hough transform for lines , 1985, CVPR 1985.

[6]  King-Sun Fu,et al.  Conceptual Clustering in Knowledge Organization , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  B. Silverman Density estimation for statistics and data analysis , 1986 .

[8]  G. T. Timmer,et al.  Stochastic global optimization methods part I: Clustering methods , 1987, Math. Program..

[9]  Rose,et al.  Statistical mechanics and phase transitions in clustering. , 1990, Physical review letters.

[10]  K. Roeder Density estimation with confidence sets exemplified by superclusters and voids in the galaxies , 1990 .

[11]  Geoffrey C. Fox,et al.  Constrained Clustering as an Optimization Method , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Robert C. Kohberger,et al.  Cluster Analysis (3rd ed.) , 1994 .

[13]  P. Sopp Cluster analysis. , 1996, Veterinary immunology and immunopathology.