Human Perception-Driven, Similarity-Based Access to Image Databases

Similarity-based access to image databases assumes one or more similarity models. Although this assumption affects the retrieval precision of a system considerably, it is rarely described explicitly. Furthermore, because the similarity model is typically hard-coded into the system, it is very difficult if not impossible to use such a system for applications that do not fit the same similarity model. In this work, we develop a framework for designing similaritybased image access systems that are driven by human perception, and hence can be tailored for multiple, diverse applications. The driving components of the approach are Principal Components-based feature selection, perception modeling via psychophysical experiments and Genetic Algorithm-driven distance function optimization. While our framework is general and flexible, we demonstrate the application in a particular image access scenario: Shapebased retrieval of skin lesion images. The experimental results show that, by incorporating human perception of similarity into the system, retrieval performance may be significantly improved.

[1]  Clement T. Yu,et al.  Segmentation of skin cancer images , 1999, Image Vis. Comput..

[2]  Jan P. Allebach,et al.  Methodology for designing image similarity metrics based on human visual system models , 1997, Electronic Imaging.

[3]  David L. Levine,et al.  Users guide to the PGAPack parallel genetic algorithm library , 1995 .

[4]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[5]  Robert M. Haralick,et al.  Feature normalization and likelihood-based similarity measures for image retrieval , 2001, Pattern Recognit. Lett..

[6]  Luciano da Fontoura Costa,et al.  Shape Analysis and Classification: Theory and Practice , 2000 .

[7]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[8]  Jianying Hu,et al.  Matching and retrieval based on the vocabulary and grammar of color patterns , 2000, IEEE Trans. Image Process..

[9]  F. Gregory Ashby,et al.  Toward a Unified Theory of Similarity and Recognition , 1988 .

[10]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[11]  A. E. Eiben,et al.  Evolutionary computing: the most powerful problem solver in the universe? , 2002 .

[12]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[13]  T. White,et al.  The labeled dissimilarity scale: A metric of perceptual dissimilarity , 2000, Perception & psychophysics.

[14]  G. Nathalie,et al.  Towards the introduction of human perception in a natural scene classification system , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[15]  E. Y. Chang,et al.  Toward perception-based image retrieval , 2000, 2000 Proceedings Workshop on Content-based Access of Image and Video Libraries.

[16]  Mandyam D. Srinath,et al.  Contour sequence moments for the classification of closed planar shapes , 1987, Pattern Recognit..

[17]  Charles A. Bouman,et al.  Perceptual image similarity experiments , 1998, Electronic Imaging.

[18]  B. Manly Randomization, Bootstrap and Monte Carlo Methods in Biology , 2018 .

[19]  Brian Scassellati,et al.  Retrieving images by 2D shape: a comparison of computation methods with human perceptual judgments , 1994, Electronic Imaging.

[20]  Yves Van de Peer,et al.  zt: A Sofware Tool for Simple and Partial Mantel Tests , 2002 .

[21]  J. S. Payne,et al.  Can texture and image content retrieval methods match human perception? , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[22]  Gregory Ashby,et al.  Toward a Unified Theory of Similarity and Recognition , 1988 .

[23]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.