Reliable camera motion estimation from compressed MPEG videos using machine learning approach

Abstract. As an important feature in characterizing video content, camera motion has been widely applied in various multimedia and computer vision applications. A novel method for fast and reliable estimation of camera motion from MPEG videos is proposed, using support vector machine for estimation in a regression model trained on a synthesized sequence. Experiments conducted on real sequences show that the proposed method yields much improved results in estimating camera motions while the difficulty in selecting valid macroblocks and motion vectors is skipped.

[1]  Pawel Strumillo,et al.  Refinement of depth from stereo camera ego-motion parameters , 2008 .

[2]  Ivan V. Bajic,et al.  Video Object Tracking in the Compressed Domain Using Spatio-Temporal Markov Random Fields , 2013, IEEE Transactions on Image Processing.

[3]  Shih-Fu Chang,et al.  Survey of compressed-domain features used in audio-visual indexing and analysis , 2003, J. Vis. Commun. Image Represent..

[4]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[5]  Ling Zhuang,et al.  Parameter Optimization of Kernel-based One-class Classifier on Imbalance Learning , 2006, J. Comput..

[6]  Sanjeev R. Kulkarni,et al.  Rapid estimation of camera motion from compressed video with application to video annotation , 2000, IEEE Trans. Circuits Syst. Video Technol..

[7]  Li Li,et al.  A Survey on Visual Content-Based Video Indexing and Retrieval , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  Ivan V. Bajic,et al.  A Joint Approach to Global Motion Estimation and Motion Segmentation From a Coarsely Sampled Motion Vector Field , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Bernd Freisleben,et al.  Estimation of arbitrary camera motion in MPEG videos , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[10]  Zygmunt Pizlo,et al.  Camera Motion-Based Analysis of User Generated Video , 2010, IEEE Transactions on Multimedia.

[11]  Mike Brookes,et al.  Precise real-time outlier removal from motion vector fields for 3D reconstruction , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[12]  Jinchang Ren,et al.  ANN vs. SVM: Which one performs better in classification of MCCs in mammogram imaging , 2012, Knowl. Based Syst..

[13]  Joachim Köhler,et al.  LIVE: An Integrated Production and Feedback System for Intelligent and Interactive TV Broadcasting , 2011, IEEE Transactions on Broadcasting.

[14]  J. WANG,et al.  Moving Camera Moving Object Segmentation in Compressed Video Sequences , 2009, Int. J. Image Graph..

[15]  Michael G. Strintzis,et al.  Statistical Motion Information Extraction and Representation for Semantic Video Analysis , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Jinchang Ren,et al.  Detection of dirt impairments from archived film sequences : survey and evaluations , 2010 .

[17]  Ioannis Pitas,et al.  Camera Motion Estimation Using a Novel Online Vector Field Model in Particle Filters , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Stephen W. Smoliar,et al.  Video parsing and browsing using compressed data , 1995, Multimedia Tools and Applications.

[19]  Henri Nicolas,et al.  Compressed domain indexing of scalable H.264/SVC streams , 2009, Signal Process. Image Commun..

[20]  R. Venkatesh Babu,et al.  Compressed domain video retrieval using object and global motion descriptors , 2006, Multimedia Tools and Applications.

[21]  Juan Chen,et al.  Extracting Objects and Events from MPEG Videos for Highlight-based Indexing and Retrieval , 2010, J. Multim..

[22]  Ying Weng,et al.  Fast camera motion estimation in MPEG compressed domain , 2011, IEEE Transactions on Consumer Electronics.