Video Search Using a Visual Dictionary

This paper presents an original approach to video shot retrieval, which is an adaptation of the common text-based paradigm. The idea of our approach is to describe images using a small number of visual elements chosen in a visual dictionary. The user may select some elements from the visual dictionary to compose a query and search for specific video shots. In our approach, we automatically compute those visual elements to compose a global visual dictionary, and we select the most representative to build a query visual dictionary. We propose a method to evaluate automatically the efficiency of this query visual dictionary for retrieving shots, and we present experimental results on the tree video BBC rushes task.

[1]  Hugh E. Williams,et al.  RMIT University at TRECVID 2004 , 2004, TRECVID.

[2]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[3]  Jitendra Malik,et al.  Blobworld: A System for Region-Based Image Indexing and Retrieval , 1999, VISUAL.

[4]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Rosalind W. Picard A Society of Models for Video and Image Libraries , 1996, IBM Syst. J..

[6]  Yihong Gong,et al.  Image indexing and retrieval based on color histograms , 1996, Multimedia Tools and Applications.

[7]  Zhongfei Zhang,et al.  Hidden semantic concept discovery in region based image retrieval , 2004, CVPR 2004.

[8]  Nozha Boujemaa,et al.  New image retrieval paradigm: logical composition of region categories , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[9]  Lei Zhu,et al.  Keyblock: an approach for content-based image retrieval , 2000, ACM Multimedia.

[10]  Hugh E. Williams,et al.  RMIT University at TREC 2004 , 2004, TREC.

[11]  Joo-Hwee Lim,et al.  Categorizing Visual Contents by Matching Visual "Keywords" , 1999, VISUAL.

[12]  Rosalind W. Picard Toward a Visual Thesaurus , 1995, MIRO.