Shape-optimizing hybrid warping for image stitching

Projective distortion remains an open problem for image stitching. This paper proposed a novel weight-based shape-optimizing warping framework, which combines a projective transformation and a similarity transformation so as to reduce the projective distortion. This method aligned images with the projective transformation, and optimized images' shape under the constraint condition of similarity transformation. By automatically locating the overlapping and non-overlapping regions of input images, the weight of the constraint condition was determined. In addition, to ensure the smoothness of the final stitching result, we specially designed a continuous variation of the weight according to the location information. Since the proposed warping method joints the advantages of both projective transformation and similarity transformation, it can preserve the accuracy of image alignment and alleviate the projective distortion as small as possible. Various experiments demonstrated the effectiveness of our method.

[1]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, ACM Trans. Graph..

[2]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[3]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Dong-Qing Zhang,et al.  Multi-objective content preserving warping for image stitching , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[5]  Yasuyuki Matsushita,et al.  Smoothly varying affine stitching , 2011, CVPR 2011.

[6]  Sharath Pankanti,et al.  Adaptive as-natural-as-possible image stitching , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[8]  Yoichi Sato,et al.  Shape-Preserving Half-Projective Warps for Image Stitching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  P. Perona,et al.  Squaring the circle in panoramas , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[11]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[12]  Masanobu Shimada,et al.  PALSAR Radiometric and Geometric Calibration , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Michael S. Brown,et al.  Constructing image panoramas using dual-homography warping , 2011, CVPR 2011.

[14]  Richard Szeliski,et al.  Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment , 2000, International Journal of Computer Vision.

[15]  Fan Zhang,et al.  Parallax-Tolerant Image Stitching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Gregory Dudek,et al.  Rotation and zooming in image mosaicing , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[17]  Michael S. Brown,et al.  As-Projective-As-Possible Image Stitching with Moving DLT , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Richard Szeliski,et al.  Construction of Panoramic Image Mosaics with Global and Local Alignment , 2001 .

[19]  Yung-Yu Chuang,et al.  Spatially-Varying Image Warps for Scene Alignment , 2014, 2014 22nd International Conference on Pattern Recognition.