Modeling of Video Sequences by Gaussian Mixture: Application in Motion Estimation by Block Matching Method

This article investigates a new method of motion estimation based on block matching criterion through the modeling of image blocks by a mixture of two and three Gaussian distributions. Mixture parameters (weights, means vectors, and covariance matrices) are estimated by the Expectation Maximization algorithm (EM) which maximizes the log-likelihood criterion. The similarity between a block in the current image and the more resembling one in a search window on the reference image is measured by the minimization of Extended Mahalanobis distance between the clusters of mixture. Performed experiments on sequences of real images have given good results, and PSNR reached 3 dB.

[1]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[2]  Thomas J. Hebert,et al.  Bayesian pixel classification using spatially variant finite mixtures and the generalized EM algorithm , 1998, IEEE Trans. Image Process..

[3]  David J. Heeger,et al.  Optical flow using spatiotemporal filters , 2004, International Journal of Computer Vision.

[4]  Wee Ser,et al.  A new successive elimination algorithm for fast block matching in motion estimation , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[5]  Harry Wechsler,et al.  Derivation of optical flow using a spatiotemporal-Frequency approach , 1987, Comput. Vis. Graph. Image Process..

[6]  Chok-Kwan Cheung,et al.  Adaptive motion tracking block matching algorithms for video coding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[7]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[8]  S. Erturk,et al.  Digital image stabilization with sub-image phase correlation based global motion estimation , 2003, IEEE Trans. Consumer Electron..

[9]  R. A. Packwood,et al.  Variable size block matching motion compensation for object-based video coding , 1997 .

[10]  Geoffrey E. Hinton,et al.  A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants , 1998, Learning in Graphical Models.

[11]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[12]  Vania V. Estrela,et al.  Regularized pel-recursive motion estimation using generalized cross-validation and spatial adaptation , 2003, 16th Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI 2003).

[13]  Aroh Barjatya,et al.  Block Matching Algorithms For Motion Estimation , 2004 .

[14]  Joachim Weickert,et al.  Reliable Estimation of Dense Optical Flow Fields with Large Displacements , 2000, International Journal of Computer Vision.

[15]  A. Marchewka,et al.  Motion analysis for image sequence coding , 2006 .

[16]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[17]  Vasileios Argyriou,et al.  Performance study of gradient correlation for sub-pixel motion estimation in the frequency domain , 2005 .

[18]  Frederic Dufaux,et al.  Motion estimation techniques for digital TV: a review and a new contribution , 1995, Proc. IEEE.

[19]  C. Stiller,et al.  Estimating Motion in Image Sequences A tutorial on modeling and computation of 2 D motion , 2022 .

[20]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[21]  Driss Aboutajdine,et al.  A new fast full search block matching algorithm using frequency domain , 2005, Proceedings of the Eighth International Symposium on Signal Processing and Its Applications, 2005..

[22]  C. Stiller,et al.  Estimating motion in image sequences , 1999, IEEE Signal Process. Mag..

[23]  Mohamed Afify.  Extended baum-welch reestimation of Gaussian mixture models based on reverse Jensen inequality , 2005, INTERSPEECH.

[24]  S. Rogers,et al.  Cluster merging based on weighted mahalanobis distance with application in digital mammograph , 1998, Proceedings of the IEEE 1998 National Aerospace and Electronics Conference. NAECON 1998. Celebrating 50 Years (Cat. No.98CH36185).

[25]  Michael I. Jordan,et al.  On Convergence Properties of the EM Algorithm for Gaussian Mixtures , 1996, Neural Computation.

[26]  P. Deb.  Finite Mixture Models , 2008 .