Finding Salient Regions in Images: Nonparametric Clustering for Image Segmentation and Grouping

A major problem in content-based image retrieval (CBIR) is the unsupervised identification of perceptually salient regions in images. We contend that this problem can be tackled by mapping the pixels into various feature-spaces, whereupon they are subjected to a grouping algorithm. In this paper we develop a robust and versatile nonparametric clustering algorithm that is able to handle the unbalanced and highly irregular clusters encountered in such CBIR applications. The strength of our approach lies not so much in the clustering itself, but rather in the definition and use of two cluster-validity indices that are independent of the cluster topology. By combining them, an optimal clustering can be identified, and experiments confirm that the associated clusters do, indeed, correspond to perceptually salient image regions.

[1]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[2]  Peter E. Hart,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[3]  G.B. Coleman,et al.  Image segmentation by clustering , 1979, Proceedings of the IEEE.

[4]  R. Tapia,et al.  Nonparametric Function Estimation, Modeling, and Simulation , 1987 .

[5]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[6]  Peter J. Rousseeuw,et al.  Finding Groups in Data: An Introduction to Cluster Analysis , 1990 .

[7]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Rosalind W. Picard,et al.  Interactive Learning Using a "Society of Models" , 2017, CVPR 1996.

[9]  P. Sopp.  Cluster analysis. , 1996, Veterinary immunology and immunopathology.

[10]  Tom Minka,et al.  Interactive learning with a "society of models" , 1997, Pattern Recognit..

[11]  Hichem Frigui,et al.  Clustering by competitive agglomeration , 1997, Pattern Recognit..

[12]  Serge J. Belongie,et al.  Region-based image querying , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[13]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Florica Mindru,et al.  Fully Unsupervised Clustering Using Center-Surround Receptive Fields with Applications to Color-Segmentation , 1997, CAIP.

[15]  Nicholas R. Howe.  Percentile blobs for image similarity , 1998, Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173).

[16]  J.R. Smith,et al.  Decoding image semantics using composite region templates , 1998, Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173).

[17]  E. Vicario,et al.  Using weighted spatial relationships in retrieval by visual contents , 1998 .

[18]  Greet Frederix,et al.  Non-parametric clustering for segmentation and grouping , 1998 .

[19]  A. Del Bimbo,et al.  Using weighted spatial relationships in retrieval by visual contents , 1998, Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173).

[20]  B. S. Manjunath,et al.  NeTra: A toolbox for navigating large image databases , 1997, Multimedia Systems.

[21]  R. A. Gaskins,et al.  Nonparametric roughness penalties for probability densities , 2022 .