Content-based search of video using color, texture, and motion

We present an implementation of a system for content-based search and retrieval of video based on low-level visual features. The system consists of three parts, automatic video partition, feature extraction, video search and retrieval. Three primary features, color texture and motion are used for indexing. They are represented by color histograms, Gabor texture features, and motion histograms. Most of the processing is done directly in the MPEG compressed domain. Testing on sports and movie databases have shown good retrieval performance.

[1]  David Doermann,et al.  Archiving, indexing, and retrieval of video in the compressed domain , 1996, Other Conferences.

[2]  Yuzhuo Zhong,et al.  Robust approach to video segmentation using compressed data , 1997, Electronic Imaging.

[3]  Edoardo Ardizzone,et al.  Multifeature image and video content-based storage and retrieval , 1996, Other Conferences.

[4]  B. S. Manjunath,et al.  Tools for texture- and color-based search of images , 1997, Electronic Imaging.

[5]  Arun N. Netravali,et al.  Digital Video: An introduction to MPEG-2 , 1996 .

[6]  Yihong Gong,et al.  Image retrieval based on color features: an evaluation study , 1995, Other Conferences.

[7]  Boon-Lock Yeo,et al.  On the extraction of DC sequence from MPEG compressed video , 1995, Proceedings., International Conference on Image Processing.

[8]  Bangalore S. Manjunath,et al.  Tools for texture/color based search of images , 1997 .

[9]  Sanjeev R. Kulkarni,et al.  Automated analysis and annotation of basketball video , 1997, Electronic Imaging.

[10]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Shih-Fu Chang,et al.  Clustering methods for video browsing and annotation , 1996, Electronic Imaging.

[12]  James Lee Hafner,et al.  Efficient Color Histogram Indexing for Quadratic Form Distance Functions , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Amarnath Gupta,et al.  Virage video engine , 1997, Electronic Imaging.

[14]  Giridharan Iyengar,et al.  VideoBook: an experiment in characterization of video , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[15]  Shih-Fu Chang,et al.  Local color and texture extraction and spatial query , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.