Towards Artistic Collections Navigation Tools Based on Relevance Feedback

Artistic image collections are usually managed via textual metadata into standard content management systems. More sophisticated searches can be performed using image retrieval technologies based on visual content. Nevertheless, the problem of the information presentation remains. In this paper we try to move beyond the classic grid-styled presentation model, suggesting a novel use of relevance feedback as a navigation tool. Relevance feedback is therefore used to warp the view and allow the user to spatially navigate the image collection, and at the same time focus on his retrieval aim. This is obtained exploiting a distance based space warping on the 2D projection of the distance matrix. Multitouch gestures are employed to provide feedbacks by natural interaction with the system.

[1]  Mark Kucente.  Natural interaction , 1998, SIGGRAPH '98.

[2]  Antonio Torralba,et al.  Building the gist of a scene: the role of global image features in recognition. , 2006, Progress in brain research.

[3]  Ling Liu,et al.  Encyclopedia of Database Systems , 2009, Encyclopedia of Database Systems.

[4]  Fatih Murat Porikli,et al.  Pedestrian Detection via Classification on Riemannian Manifolds , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[6]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[7]  Rita Cucchiara,et al.  Surfing on artistic documents with visually assisted tagging , 2010, ACM Multimedia.

[8]  Jörg A. Walter.  H-MDS: a new approach for interactive visualization with multidimensional scaling in the hyperbolic space , 2004, Inf. Syst..

[9]  Christos Faloutsos,et al.  FastMap: a fast algorithm for indexing, data-mining and visualization of traditional and multimedia datasets , 1995, SIGMOD '95.

[10]  Geoffrey E. Hinton,et al.  Stochastic Neighbor Embedding , 2002, NIPS.

[11]  Alexandr Andoni,et al.  Near-Optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[12]  Rita Cucchiara,et al.  Automatic segmentation of digitalized historical manuscripts , 2011, Multimedia Tools and Applications.

[13]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[14]  Cordelia Schmid,et al.  Product Quantization for Nearest Neighbor Search , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Daniel Heesch,et al.  A survey of browsing models for content based image retrieval , 2008, Multimedia Tools and Applications.

[16]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[18]  Tsuhan Chen,et al.  Mean shift feature space warping for relevance feedback , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[19]  G Pellacani,et al.  Computer description of colours in dermoscopic melanocytic lesion images reproducing clinical assessment. , 2003, The British journal of dermatology.

[20]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[21]  Rita Cucchiara,et al.  Optimized Block-Based Connected Components Labeling With Decision Trees , 2010, IEEE Transactions on Image Processing.

[22]  Mario Ganzeboom.  Natural interaction , 2008 .