Real-Time and Multi-Video-Object Segmentation for Compressed Video Sequences

We propose a real-time object segmentation method based on Gaussian mixture model(GMM) for MPEG compressed video. Computational superiority and multi video objects are the main advantages of compressed domain processing. In the paper, first, we introduce the macro-block structure of the MPEG encoded video and the preprocession of video vectors, then we build a GMM of motion vectors and adopt the genetic-based expectation-maximization algorithm (GA-EM) to compute its multivariate parameters. It is able to estimate automatically the number of objects of the motion model using the minimum description length (MDL) criterion. At last, we give the steps of objects extraction. It is proved that the algorithm is real-time and effective from the experiment results.

[1]  Kai-Kuang Ma,et al.  Spatiotemporal segmentation of moving video objects over MPEG compressed domain , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[2]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[3]  Thomas Bäck,et al.  Evolutionary Algorithms in Theory and Practice , 1996 .

[4]  O. Sukmarg,et al.  Fast object detection and segmentation in MPEG compressed domain , 2000, 2000 TENCON Proceedings. Intelligent Systems and Technologies for the New Millennium (Cat. No.00CH37119).

[5]  Lei Xu,et al.  BYY harmony learning, structural RPCL, and topological self-organizing on mixture models , 2002, Neural Networks.

[6]  Lorenzo Favalli,et al.  Object tracking for retrieval applications in MPEG-2 , 2000, IEEE Trans. Circuits Syst. Video Technol..

[7]  Ya-Qin Zhang,et al.  A confidence measure based moving object extraction system built for compressed domain , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).