Segmentation data visualizing and clustering

Browsing, searching and retrieving images from large databases based on low level color or texture visual features have been widely studied in recent years but are also often limited in terms of usefulness. In this paper, we propose a new framework that allows users to effectively browse and search in large image database based on their segmentation-based descriptive content and, more precisely, based on the geometrical layout and shapes of the different objects detected and segmented in the scene. This descriptive information, provided at a higher level of abstraction, can be a significant and complementary information which helps the user to browse through the collection in an intuitive and efficient manner. In addition, we study and discuss various ways and tools for efficiently clustering or for retrieving a specific subset or class of images in terms of segmentation-based descriptive content which can also be used to efficiently summarize the content of the image database. Experiments conducted on the Berkeley Segmentation Datasets show that this new framework can be effective in supporting image browsing and retrieval tasks.

[1]  Jian-Yun Nie,et al.  Semantic-Based Cross-Media Image Retrieval , 2005, ICAPR.

[2]  Jörg-Stefan Praßni,et al.  A random walker based approach to combining multiple segmentations , 2008, 2008 19th International Conference on Pattern Recognition.

[3]  Marina Meila,et al.  Comparing clusterings: an axiomatic view , 2005, ICML.

[4]  W. Torgerson.  Multidimensional scaling: I. Theory and method , 1952 .

[5]  Allen Y. Yang,et al.  Unsupervised segmentation of natural images via lossy data compression , 2008, Comput. Vis. Image Underst..

[6]  Daniel Heesch,et al.  A survey of browsing models for content based image retrieval , 2008, Multimedia Tools and Applications.

[7]  Jian-Yun Nie,et al.  Toward Cross-Language and Cross-Media Image Retrieval , 2004, CLEF.

[8]  Max Mignotte,et al.  MDS-Based Multiresolution Nonlinear Dimensionality Reduction Model for Color Image Segmentation , 2011, IEEE Transactions on Neural Networks.

[9]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  A. Householder,et al.  Discussion of a set of points in terms of their mutual distances , 1938 .

[11]  Joemon M. Jose,et al.  An adaptive technique for content-based image retrieval , 2006, Multimedia Tools and Applications.

[12]  Max Mignotte,et al.  A label field fusion model with a variation of information estimator for image segmentation , 2014, Inf. Fusion.

[13]  Gerald Schaefer,et al.  Interactive Browsing of Image Repositories - (Invited Paper) , 2012, ICCVG.

[14]  Joemon M. Jose,et al.  A Simulated User Study of Image Browsing Using High-Level Classification , 2009, SAMT.

[15]  Daniel Küttel,et al.  Efficient Combination of Probabilistic Sampling Approximations for Robust Image Segmentation , 2006, DAGM-Symposium.

[16]  Sanjoy Dasgupta,et al.  Robust Euclidean embedding , 2006, ICML.

[17]  Zhi-Hua Zhou,et al.  SOM Ensemble-Based Image Segmentation , 2004, Neural Processing Letters.

[18]  Max Mignotte.  A de-texturing and spatially constrained K-means approach for image segmentation , 2011, Pattern Recognit. Lett..

[19]  Max Mignotte,et al.  A Label Field Fusion Bayesian Model and Its Penalized Maximum Rand Estimator for Image Segmentation , 2010, IEEE Transactions on Image Processing.

[20]  Ilaria Bartolini,et al.  Adaptively browsing image databases with PIBE , 2006, Multimedia Tools and Applications.

[21]  Max Mignotte,et al.  Segmentation by Fusion of Histogram-Based $K$-Means Clusters in Different Color Spaces , 2008, IEEE Transactions on Image Processing.

[22]  Max Mignotte.  Nonparametric multiscale energy-based mode and its application in some imagery problems , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Sandro Vega-Pons,et al.  A Survey of Clustering Ensemble Algorithms , 2011, Int. J. Pattern Recognit. Artif. Intell..

[24]  Soumya Ghosh,et al.  A general framework for reconciling multiple weak segmentations of an image , 2009, 2009 Workshop on Applications of Computer Vision (WACV).

[25]  Max Mignotte,et al.  A Multiresolution Markovian Fusion Model for the Color Visualization of Hyperspectral Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[26]  John Wright,et al.  Segmentation of Multivariate Mixed Data via Lossy Data Coding and Compression , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  M. Meilă.  Comparing clusterings---an information based distance , 2007 .

[28]  Max Mignotte,et al.  A hierarchical graph-based markovian clustering approach for the unsupervised segmentation of textured color images , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[29]  Max Mignotte,et al.  A non-stationary MRF model for image segmentation from a soft boundary map , 2012, Pattern Analysis and Applications.

[30]  John Wright,et al.  Segmentation of multivariate mixed data via lossy coding and compression , 2007, Electronic Imaging.

[31]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[32]  Stephen P. Banks,et al.  Signal Processing, Image Processing and Pattern Recognition , 1991 .

[33]  Gerald Schaefer,et al.  A next generation browsing environment for large image repositories , 2010, Multimedia Tools and Applications.

[34]  Patrick J. F. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 2003 .