NNk Networks for Content-Based Image Retrieval

This paper describes a novel interaction technique to support content-based image search in large image collections. The idea is to represent each image as a vertex in a directed graph. Given a set of image features, an arc is established between two images if there exists at least one combination of features for which one image is retrieved as the nearest neighbour of the other. Each arc is weighted by the proportion of feature combinations for which the nearest neighour relationship holds. By thus integrating the retrieval results over all possible feature combinations, the resulting network helps expose the semantic richness of images and thus provides an elegant solution to the problem of feature weighting in content-based image retrieval. We give details of the method used for network generation and describe the ways a user can interact with the structure. We also provide an analysis of the network’s topology and provide quantitative evidence for the usefulness of the technique.

[1]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[2]  Thierry Pun,et al.  Strategies for positive and negative relevance feedback in image retrieval , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[3]  Lada A. Adamic,et al.  Search in Power-Law Networks , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Stefan M. Rüger,et al.  Performance Comparison of Different Similarity Models for CBIR with Relevance Feedback , 2003, CIVR.

[5]  Wei-Ying Ma,et al.  Image and Video Retrieval , 2003, Lecture Notes in Computer Science.

[6]  Stefan Bornholdt,et al.  Handbook of Graphs and Networks: From the Genome to the Internet , 2003 .

[7]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[8]  D. W. Dearholt,et al.  Properties of pathfinder networks , 1990 .

[9]  Roger W. Schvaneveldt,et al.  Pathfinder associative networks: studies in knowledge organization , 1990 .

[10]  Paul A. Viola,et al.  Boosting Image Retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[11]  S. Dongen A cluster algorithm for graphs , 2000 .

[12]  Béla Bollobás,et al.  Random Graphs , 1985 .

[13]  W. Bruce Croft,et al.  A comparison of a network structure and a database system used for document retrieval , 1985, Inf. Syst..

[14]  Iain Campbell,et al.  The ostensive model of developing information needs , 2000 .

[15]  Chaomei Chen,et al.  Similarity-Based Image Browsing , 2000 .

[16]  Jon M. Kleinberg,et al.  Navigation in a small world , 2000, Nature.

[17]  Simone Santini,et al.  Integrated browsing and querying for image databases , 2000, IEEE MultiMedia.

[18]  M. Newman Random Graphs as Models of Networks , 2002, cond-mat/0202208.

[19]  Simone Santini,et al.  Emergent Semantics through Interaction in Image Databases , 2001, IEEE Trans. Knowl. Data Eng..