Convexity dependent anisotropic diffusion for mode detection in cluster analysis

Abstract In cluster analysis, regions of high local density of data points, which might correspond to significant clusters, can be found from the modes of the underlying probability density function (pdf). However, due to irregularities in the data distribution, the modes and the valleys of the pdf are often ill defined so that mode detection can lead to poor results. In this paper, an anisotropic diffusion process is proposed in order to reinforce the smoothing of the pdf in the modal regions where it is concave and in the valleys where it is convex, while preserving the boundaries between them. This adaptive smoothing procedure is combined with a strategy which consists in applying a forward diffusion when the pdf is concave and a backward diffusion when it is convex. Iterations of this convexity dependent anisotropic diffusion tend to enhance the modes and to deepen the valleys of the underlying pdf, so that mode detection becomes trivial. Experiment and comparative results with some well-known clustering algorithms over simulated datasets show the effectiveness of the proposed clustering method.

[1]  Ross T. Whitaker,et al.  A multi-scale approach to nonuniform diffusion , 1993 .

[2]  Jack-Gérard Postaire,et al.  A Markov random field model for mode detection in cluster analysis , 2008, Pattern Recognit. Lett..

[3]  Kai Ming Ting,et al.  Density-ratio based clustering for discovering clusters with varying densities , 2016, Pattern Recognit..

[4]  Abderrahmane Sbihi,et al.  Image Processing Techniques for Unsupervised Pattern Classification , 2007 .

[5]  Haojie Li,et al.  Discriminative anisotropic propagation with heat source estimation for robust object tracking , 2017, Neural Computing and Applications.

[6]  Ezzedine Ben Braiek,et al.  An advanced and adaptive mathematical function for an efficient anisotropic image filtering , 2016, Comput. Math. Appl..

[7]  Abderrahmane Sbihi,et al.  Mode Extraction by Multivalue Morphology for Cluster Analysis , 1996 .

[8]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Jack-Gérard Postaire,et al.  Convexity dependent morphological transformations for mode detection in cluster analysis , 1994, Pattern Recognit..

[10]  James Bailey,et al.  Information theoretic measures for clusterings comparison: is a correction for chance necessary? , 2009, ICML '09.

[11]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[12]  Scott T. Acton,et al.  Diffusion Partial Differential Equations for Edge Detection , 2009 .

[13]  E. H. Sbai,et al.  Cluster analysis by adaptive rank-order filters , 2001, Pattern Recognit..

[14]  Alessandro Laio,et al.  Clustering by fast search and find of density peaks , 2014, Science.

[15]  Charu C. Aggarwal,et al.  Data Clustering , 2013 .

[16]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[18]  Jack-Gérard Postaire,et al.  A relaxation scheme for improving a convexity based clustering method , 1994, Pattern Recognit. Lett..

[19]  J.-G. Postaire,et al.  A clustering method based on multidimensional texture analysis , 2006, Pattern Recognit..

[20]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[21]  Jack-Gérard Postaire,et al.  A Fast Algorithm for Nonparametric Probability Density Estimation , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Jack-Gérard Postaire,et al.  Mode Detection by Relaxation , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Jack-Gérard Postaire,et al.  Clustering by mode boundary detection , 1989, Pattern Recognit. Lett..

[24]  Dirk P. Kroese,et al.  Kernel density estimation via diffusion , 2010, 1011.2602.

[25]  Rongfang Bie,et al.  Clustering by fast search and find of density peaks via heat diffusion , 2016, Neurocomputing.

[26]  Maria Petrou,et al.  On the choice of the parameters for anisotropic diffusion in image processing , 2013, Pattern Recognit..

[27]  Jun Zhang,et al.  A segmentation algorithm for SAR images based on the anisotropic heat diffusion equation , 2008, Pattern Recognit..

[28]  Dorin Comaniciu,et al.  A common framework for nonlinear diffusion, adaptive smoothing, bilateral filtering and mean shift , 2004, Image Vis. Comput..