Indexing and Matching of Video Shots Based on Motion and Color Analysis

This paper concerns two fundamental issues in video shots retrieval: key frame identification and similarity measurement between the key frames. We propose a simple key frame extraction algorithm based on optical flow. The algorithm emphasizes the motion extremum in the shot. Color histograms in HSV color space are adopted to describe the content of the extracted key frames and a new model is proposed to measure the similarity between the key frames from different shots. Preliminary experiments have shown that the proposed method outperforms existing ones in retrieving sport video shots

[1]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[2]  B. D. Lucas Generalized image matching by the method of differences , 1985 .

[3]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[4]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[5]  Jun Yu,et al.  An efficient method for scene cut detection , 2001, Pattern Recognit. Lett..

[6]  Wayne H. Wolf,et al.  Key frame selection by motion analysis , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[7]  Tianming Liu,et al.  A novel video key-frame-extraction algorithm based on perceived motion energy model , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  A. Murat Tekalp,et al.  Group-of-frames/pictures color histogram descriptors for multimedia applications , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[9]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[10]  Seong-Whan Lee,et al.  Automatic video parsing using shot boundary detection and camera operation analysis , 2001, Pattern Recognit..

[11]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[12]  A. Murat Tekalp,et al.  Content-based video abstraction , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[13]  Jitendra Malik,et al.  Recognition of Images in Large Databases Using a Learning Framework , 1997 .

[14]  Stephen W. Smoliar,et al.  An integrated system for content-based video retrieval and browsing , 1997, Pattern Recognit..

[15]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[16]  Wei Xiong,et al.  Automatic video data structuring through shot partitioning and key-frame computing , 1997, Machine Vision and Applications.