Consistent image alignment for video mosaicing

Image mosaicing is widely used in computer vision applications. In this paper, a new globally consistent image alignment method for video mosaicing is presented. Due to various uncertainties on noise, illumination, and modeling, the problem of global image alignment is considered as a stochastic estimation problem. The augmented system state consists of the transformation parameters of video image sequences. The system motion model, the augmentation model, and the observation model are constructed. The homography parameters of image sequences are augmented and estimated recursively with augmented Kalman filter in a common state vector and covariance matrix. Some experimental results are provided to validate the performance of the proposed method. The proposed image alignment method can handle the uncertainty efficiently. Image alignment is globally consistent and accurate.

[1]  Eun-Young Elaine Kang,et al.  Progressive Multi-image Registration based on Feature Tracking , 2006, IPCV.

[2]  Naoki Chiba,et al.  Feature-Based Image Mosaicing , 1998, MVA.

[3]  Charles V. Stewart,et al.  A Feature-Based Technique for Joint Linear Estimation of High-Order Image-to-Mosaic Transformations: Mosaicing the Curved Human Retina , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Gérard G. Medioni,et al.  A graph-based global registration for 2D mosaics , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[5]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[6]  Tsuhan Chen,et al.  Compression with mosaic prediction for image-based rendering applications , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[7]  David Capel,et al.  Image Mosaicing and Super-resolution , 2004, Distinguished Dissertations.

[8]  Jun-Wei Hsieh,et al.  Fast stitching algorithm for moving object detection and mosaic construction , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[9]  Jason Jianjun Gu,et al.  Graph-based Automatic Consistent Image Mosaicking , 2004, 2004 IEEE International Conference on Robotics and Biomimetics.

[10]  E. Helmer,et al.  Cloud-Free Satellite Image Mosaics with Regression Trees and Histogram Matching. , 2005 .

[11]  Michal Irani,et al.  Video indexing based on mosaic representations , 1998, Proc. IEEE.

[12]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[13]  S. Negahdaripour,et al.  Underwater mosaic creation using video sequences from different altitudes , 2005, Proceedings of OCEANS 2005 MTS/IEEE.

[14]  Xavier Cufí,et al.  Augmented state Kalman filtering for AUV navigation , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[15]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[16]  David J. Kriegman,et al.  Practical Global Optimization for Multiview Geometry , 2006, ECCV.

[17]  M. V. Subramanyam,et al.  Feature Based Image Registration and Mosaicing , 2015 .

[18]  Aníbal Ollero,et al.  Homography Based Kalman Filter for Mosaic Building. Applications to UAV position estimation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[19]  Javier Civera,et al.  Drift-Free Real-Time Sequential Mosaicing , 2009, International Journal of Computer Vision.

[20]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[21]  Wenbin Chen,et al.  Video Stabilization Using Scale-Invariant Features , 2007, 2007 11th International Conference Information Visualization (IV '07).

[22]  Michael Elad,et al.  Super-Resolution Reconstruction of Image Sequences , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Leila Maria Garcia Fonseca,et al.  Automatic registration and mosaicking system for remotely sensed imagery , 2003, SPIE Remote Sensing.

[24]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.