A Variational Method for Multiple-Image Blending

The main aim of this paper is to develop an algorithm for blending of multiple images in the image-stitching process. Our idea is to propose a variational method containing an energy functional to determine both a stitched image and weighting mask functions of multiple input images for image blending. The existence of the solution of the proposed energy functional is shown. We also present an alternative minimizing algorithm to solve the proposed model numerically and show the convergence of this algorithm. Experimental results show that the proposed model works effectively and efficiently and that the proposed method is competitive with the tested existing methods under noisy conditions.

[1]  Neucimar Jerônimo Leite,et al.  A morphological algorithm for photomosaicking , 1996, 1996 8th European Signal Processing Conference (EUSIPCO 1996).

[2]  David G. Lowe,et al.  Shape indexing using approximate nearest-neighbour search in high-dimensional spaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Harpreet S. Sawhney,et al.  Compact Representations of Videos Through Dominant and Multiple Motion Estimation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Chia Tien Chern,et al.  THE PRACTICE OF AUTOMATIC SATELLITE IMAGE REGISTRATION , 2001 .

[5]  Edmund Y. Lam,et al.  Curvature Domain Image Stitching , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[6]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[7]  B. Mercier,et al.  A dual algorithm for the solution of nonlinear variational problems via finite element approximation , 1976 .

[8]  Wen-Liang Hwang,et al.  Variational calculus approach to multiresolution image mosaic , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[9]  Edmund Y. Lam,et al.  Digital photograph stitching with optimized matching of gradient and curvature , 2006, Electronic Imaging.

[10]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[11]  Richard Szeliski,et al.  Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment , 2000, International Journal of Computer Vision.

[12]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[13]  Lizhuang Ma,et al.  Color transfer in correlated color space , 2006, VRCIA '06.

[14]  Y. Shiren,et al.  TWO-DIMENSIONAL SEAM-POINT SEARCHING IN DIGITAL IMAGE MOSAICKING , 1989 .

[15]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[16]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[17]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  David L. Milgram,et al.  Computer Methods for Creating Photomosaics , 1975, IEEE Transactions on Computers.

[19]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[20]  Shmuel Peleg,et al.  Elimination of seams from photomosaics , 1981, Computer Graphics and Image Processing.

[21]  Shmuel Peleg,et al.  Seamless image stitching by minimizing false edges , 2006, IEEE Transactions on Image Processing.

[22]  Chiou-Ting Hsu,et al.  Multiresolution mosaic , 1996 .

[23]  Allen R. Hanson,et al.  Parallel-perspective stereo mosaics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[24]  Gjlles Aubert,et al.  Mathematical problems in image processing , 2001 .

[25]  Michael K. Ng,et al.  Inexact Alternating Direction Methods for Image Recovery , 2011, SIAM J. Sci. Comput..

[26]  A.C. Kokaram,et al.  N-dimensional probability density function transfer and its application to color transfer , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[27]  Richard Szeliski,et al.  Eliminating ghosting and exposure artifacts in image mosaics , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[28]  Richard Szeliski,et al.  Construction of Panoramic Image Mosaics with Global and Local Alignment , 2001 .

[29]  Wei Xu,et al.  Performance evaluation of color correction approaches for automatic multi-view image and video stitching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Marc Pollefeys,et al.  Robust Radiometric Calibration and Vignetting Correction , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Nicolas D. Georganas,et al.  Fast color correction using principal regions mapping in different color spaces , 2004, Real Time Imaging.

[32]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[33]  M. Ng.  Iterative Methods for Toeplitz Systems , 2004 .

[34]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[35]  Michael K. Ng.  Iterative Methods for Toeplitz Systems (Numerical Mathematics and Scientific Computation) , 2004 .

[36]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[37]  André Kaup,et al.  Histogram-Based Prefiltering for Luminance and Chrominance Compensation of Multiview Video , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[39]  Chi-Keung Tang,et al.  Tensor voting for image correction by global and local intensity alignment , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Wen-Liang Hwang,et al.  Analysis on multiresolution mosaic images , 2004, IEEE Trans. Image Process..

[41]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[42]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[43]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[44]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[45]  S. Hummer-Miller.  A digital mosaicking algorithm allowing for an irregular join line , 1989 .