Benchmarks for storage and retrieval in multimedia databases

There is a substantial body of research on computer methods for managing collections of images and videos. There is little evidence that this research has had important impact on an any community yet. I use an invitation to speak on a topic on which I am not expert to air some opinions about evaluating image retrieval research. In my opinion, there is little to be gained in measuring current solutions with reference collections, because these solutions differ so widely from user needs that the exercise becomes empty. The user studies literature is not well enough read by the image retrieval community. As a result, we tend to study somewhat artificial problems. A study of the user needs literature suggests that we will need to solve deep problems to produce useful solutions to image retrieval problems, but that there may be a need for a number of technologies that can be built in practice. I believe we should concentrate on these issues, rather than on measuring the performance of current systems.

[1]  Toshikazu Kato,et al.  Trademark: Multimedia image database system with intelligent human interface , 1990, Systems and Computers in Japan.

[2]  Stelios C. Orphanoudakis,et al.  Graphical Tools and Retrieval Strategies for Medical Image Databases , 1991 .

[3]  Bonnie Holt,et al.  ‘Quick, who painted fish?’: searching a picture database with the QBIC project at UC Davis , 1994 .

[4]  Raya Fidel,et al.  Challenges in Indexing Electronic Text and Images , 1994 .

[5]  Bonnie Holt,et al.  Retrieving art images by image content: the UC Davis QBIC project , 1994 .

[6]  Joseph L. Mundy.  The Image Understanding Environment Program , 1995, IEEE Expert.

[7]  Alberto Del Bimbo,et al.  Iconic Retrievial by Contents from Databases of Cardiological Sequences , 1997, VDB.

[8]  T. Smith.  A digital library for geographically referenced materials , 1996, Computer.

[9]  Joseph L. Mundy.  IU for military and intelligence applications: how automatic will it get? , 1997, Other Conferences.

[10]  Shih-Fu Chang,et al.  Visually Searching the Web for Content , 1997, IEEE Multim..

[11]  Peter G. B. Enser,et al.  Analysis of user need in image archives , 1997, J. Inf. Sci..

[12]  P. O'Reilly,et al.  Content-based search in medieval manuscripts , 1997, TENCON '97 Brisbane - Australia. Proceedings of IEEE TENCON '97. IEEE Region 10 Annual Conference. Speech and Image Technologies for Computing and Telecommunications (Cat. No.97CH36162).

[13]  Shih-Fu Chang,et al.  Visual information retrieval from large distributed online repositories , 1997, CACM.

[14]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  James Ze Wang,et al.  Classifying Objectionable Websites Based on Image Content , 1998, IDMS.

[16]  S.T.C. Wong.  CBIR in medicine: still a long way to go , 1998, Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173).

[17]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[18]  James Ze Wang,et al.  System for screening objectionable images , 1998, Comput. Commun..

[19]  Takeo Kanade,et al.  Rotation invariant neural network-based face detection , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[20]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  S. Sclaroff,et al.  Combining textual and visual cues for content-based image retrieval on the World Wide Web , 1998, Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173).

[22]  Leonidas J. Guibas,et al.  A metric for distributions with applications to image databases , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[23]  Anil K. Jain,et al.  Shape-Based Retrieval: A Case Study With Trademark Image Databases , 1998, Pattern Recognit..

[24]  Raimondo Schettini,et al.  Similarity retrieval of trademark images , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[25]  Peter G. B. Enser,et al.  Visual image retrieval: seeking the alliance of concept-based and content-based paradigms , 2000, J. Inf. Sci..

[26]  Takeo Kanade,et al.  A statistical method for 3D object detection applied to faces and cars , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[27]  David A. Forsyth,et al.  Learning the semantics of words and pictures , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[28]  Thierry Pun,et al.  Performance evaluation in content-based image retrieval: overview and proposals , 2001, Pattern Recognit. Lett..

[29]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .