A novel framework for semantic-based video retrieval

In this paper, a novel framework for semantic-based video retrieval is proposed. 15 low-level visual features on different levels are extracted and a supervised SVM classifier is trained for each feature. We have explored early fusion schemes between SIFT and SURF, and evaluated 4 kinds of later fusion strategies. Experiments on TRECVID dataset show that the proposed system is effective and stable.

[1]  Chong-Wah Ngo,et al.  Columbia University/VIREO-CityU/IRIT TRECVID2008 High-Level Feature Extraction and Interactive Video Search , 2008, TRECVID.

[2]  Dong Wang,et al.  THU and ICRC at TRECVID 2007 , 2007, TRECVID.

[3]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[5]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[6]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[7]  Dennis Koelma,et al.  The MediaMill TRECVID 2008 Semantic Video Search Engine , 2008, TRECVID.

[8]  Chong-Wah Ngo,et al.  Towards optimal bag-of-features for object categorization and semantic video retrieval , 2007, CIVR '07.

[9]  J. Daugman.  Two-dimensional spectral analysis of cortical receptive field profiles , 1980, Vision Research.

[10]  Tao Liu,et al.  A new framework for high-level feature extraction , 2009, 2009 4th IEEE Conference on Industrial Electronics and Applications.

[11]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[12]  Sheng Tang,et al.  TRECVID 2007 Search Tasks by NUS-ICT , 2007, TRECVID.

[13]  Dong Wang,et al.  Video diver: generic video indexing with diverse features , 2007, MIR '07.

[14]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, CVPR Workshops.

[17]  Duy-Dinh Le,et al.  Concept Detection Using Local Binary Patterns and SVM , 2006, TRECVID.

[18]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .