An improved system for concept-based video retrieval

In this paper, we present a common framework of concept-based video retrieval and propose several methods to improve the performance of the system. 12 kinds of features, including color, texture, shape and local features are examined, including a modified HOG which is defined on image edges to reduce its computational complexity. The concept cooccurrence matrix and several assistant methods (B&W detection, audio detection and motion detection) are suggested to enhance the performance of the video retrieval system. Extensive experiments on TRECVID 2010 show the effectiveness of our proposed methods.

[1]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[2]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, CAIP.

[3]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[4]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[6]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[10]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  Jianrong Cao,et al.  A method for classification of scenery documentary using MPEG-7 edge histogram descriptor , 2005, Proceedings of 2005 IEEE International Workshop on VLSI Design and Video Technology, 2005..