Color-Sketch Simulator: A Guide for Color-Based Visual Known-Item Search

In order to evaluate the effectiveness of a color-sketch retrieval system for a given multimedia database, tedious evaluations involving real users are required as users are in the center of query sketch formulation. However, without any prior knowledge about the bottlenecks of the underlying sketch-based retrieval model, the evaluations may focus on wrong settings and thus miss the desired effect. Furthermore, users have usually no clues or recommendations to draw color-sketches effectively. In this paper, we aim at a preliminary analysis to identify potential bottlenecks of a flexible color-sketch retrieval model. We present a formal framework based on position-color feature signatures, enabling comprehensive simulations of users drawing a color sketch.

[1]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[2]  John P. Collomosse,et al.  Scalable Sketch-Based Image Retrieval Using Color Gradient Features , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[3]  Jakub Lokoc,et al.  Video Hunter at VBS 2017 , 2017, MMM.

[4]  Martin Krulis,et al.  Efficient extraction of clustering-based feature signatures using GPU architectures , 2015, Multimedia Tools and Applications.

[5]  Luca Rossetto,et al.  Interactive video search tools: a detailed analysis of the video browser showdown 2015 , 2016, Multimedia Tools and Applications.

[6]  Kai Uwe Barthel,et al.  Navigating a Graph of Scenes for Exploring Large Video Collections , 2016, MMM.

[7]  Jakub Lokoc,et al.  Video Retrieval with Feature Signature Sketches , 2014, SISAP.

[8]  Heiko Schuldt,et al.  Enhanced Retrieval and Browsing in the IMOTION System , 2017, MMM.

[9]  Anurag Mittal,et al.  Similarity-Invariant Sketch-Based Image Retrieval in Large Databases , 2014, ECCV.

[10]  Klaus Schöffmann,et al.  Video Interaction Tools , 2015, ACM Comput. Surv..

[11]  Christian Beecks,et al.  Distance based similarity models for content based multimedia retrieval , 2013 .

[12]  Jose M. Saavedra,et al.  Sketch based Image Retrieval using Learned KeyShapes (LKS) , 2015, BMVC.

[13]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[14]  Stephen E. Robertson,et al.  Understanding inverse document frequency: on theoretical arguments for IDF , 2004, J. Documentation.