Video Mosaic with Block Matching and M-Estimation

Video mosaic is to make a wide or a panoramic image from video sequence by assembling the individual overlapping video frames. In this paper a technique is presented for video mosaic, which employs block matching based on phase correlation and robust M-estimation method. Initial point correspondences between each pair of consecutive frames are computed by block matching method based on phase correlation, then M-estimation method is used to identify and reject outliers and the alignment parameters between the consecutive frames is subsequently estimated by Levenberg-Marquardt iterative nonlinear minimization algorithm. Some mosaic examples are constructed to testify the availability of this approach.

[1]  Steve Mann,et al.  Video orbits of the projective group a simple approach to featureless estimation of parameters , 1997, IEEE Trans. Image Process..

[2]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[3]  Georgios Tziritas,et al.  Panoramic view construction , 2003, Signal Process. Image Commun..

[4]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[5]  Rolf Isermann,et al.  Robust regression and outlier-detection for combustion engine measurements , 2007 .

[6]  Stanley J. Reeves,et al.  Mosaic image compression , 2005, IS&T/SPIE Electronic Imaging.

[7]  P. Anandan,et al.  Efficient representations of video sequences and their applications , 1996, Signal Process. Image Commun..

[8]  C. D. Kuglin,et al.  The phase correlation image alignment method , 1975 .

[9]  Richard Szeliski,et al.  Video mosaics for virtual environments , 1996, IEEE Computer Graphics and Applications.

[10]  Chiou-Ting Hsu,et al.  Feature-based video mosaic , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).