Real-time and automatic close-up retrieval from compressed videos

This paper proposes a thorough scheme, by virtue of camera zooming descriptor with two-level threshold, to automatically retrieve close-ups directly from moving picture experts group (MPEG) compressed videos based on camera motion analysis. A new algorithm for fast camera motion estimation in compressed domain is presented. In the retrieval process, camera-motion-based semantic retrieval is built. To improve the coverage of the proposed scheme, close-up retrieval in all kinds of videos is investigated. Extensive experiments illustrate that the proposed scheme provides promising retrieval results under real-time and automatic application scenario.

[1]  Ming-Ting Sun,et al.  Global motion estimation from coarsely sampled motion vector field and the applications , 2003, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Ebroul Izquierdo,et al.  An Object- and User-Driven System for Semantic-Based Image Annotation and Retrieval , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Yi-Ping Phoebe Chen,et al.  Classification of self-consumable highlights for soccer video summaries , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[4]  Marios C. Angelides,et al.  Modeling Content for Semantic-Level Querying of Multimedia , 2004, Multimedia Tools and Applications.

[5]  Yannis Avrithis,et al.  Semantic Image Segmentation and Object Labeling , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Yong Ho Moon,et al.  A hybrid motion-vector coding scheme based on an estimation of the locality for motion-vector difference , 2006, IEEE Trans. Circuits Syst. Video Technol..

[7]  Yannis Avrithis,et al.  Personalized Content Retrieval in Context Using Ontological Knowledge , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Ying Weng,et al.  Robust-to-rotation texture descriptor for image retrieval in wavelets domain , 2006, J. Electronic Imaging.

[9]  Xiuzi Ye,et al.  A Semantic Description Scheme of Soccer Video Based on MPEG-7 , 2004, PCM.

[10]  Wen-Shyong Hsieh,et al.  Automatic feature-based global motion estimation in video sequences , 2004, IEEE Transactions on Consumer Electronics.

[11]  Bo Zhang,et al.  Relevance feedback in region-based image retrieval , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Jun-Wei Hsieh,et al.  Motion-based video retrieval by trajectory matching , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Linmi Tao,et al.  Hidden Markov Model Based Events Detection in Soccer Video , 2004, ICIAR.

[14]  Chia-Wen Lin,et al.  Fast coarse-to-fine video retrieval using shot-level spatio-temporal statistics , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Sanjeev R. Kulkarni,et al.  Rapid estimation of camera motion from compressed video with application to video annotation , 2000, IEEE Trans. Circuits Syst. Video Technol..

[16]  Kin-Man Lam,et al.  A new key frame representation for video segment retrieval , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Marcel Worring,et al.  Systematic evaluation of logical story unit segmentation , 2002, IEEE Trans. Multim..

[18]  Ying Weng,et al.  Video extraction for fast content access to MPEG compressed videos , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Peter H. N. de With,et al.  Enabling arbitrary rotational camera motion using multisprites with minimum coding cost , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Ramesh C. Jain,et al.  A survey on the use of pattern recognition methods for abstraction, indexing and retrieval of images and video , 2002, Pattern Recognit..

[21]  Ying Weng,et al.  Dominant colour extraction in DCT domain , 2006, Image Vis. Comput..