Image Stitching Using Smoothly Planar Homography

It is an important but challenging issue to construct a reasonable seamless image mosaic from images with non-ignorable different viewpoints or multiple distinct planes. The main limitations of existing image-stitching approaches lie in two facts: (a) the multiple plane nature of scenes has not been well considered in the image alignment step, which usually results in obvious misalignments; (b) the ignored alignment errors often lead to broken structures in the seam composition step. To overcome these problems, this paper proposed a smoothly planar homography model for image stitching, by considering the multi-plane geometry of natural scene. First, we integrate local warps estimated in each plane to achieve smoothly plane stitching. Then, we introduce a novel alignment-guided seam composition to handle parallax. Experimental results on a series of challenging data demonstrate that our model achieves the state-of-the-art stitching performance.

[1]  Li Li,et al.  Optimal seamline detection for multiple image mosaicking via graph cuts , 2016 .

[2]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[3]  Yinda Zhang,et al.  PanoContext: A Whole-Room 3D Context Model for Panoramic Scene Understanding , 2014, ECCV.

[4]  Sharath Pankanti,et al.  Adaptive as-natural-as-possible image stitching , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Tat-Jun Chin,et al.  The Random Cluster Model for robust geometric fitting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Tianzhu Xiang,et al.  Locally warping-based image stitching by imposing line constraints , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[7]  Michael S. Brown,et al.  Seam-Driven Image Stitching , 2013, Eurographics.

[8]  Julie Delon,et al.  Accurate Junction Detection and Characterization in Natural Images , 2013, International Journal of Computer Vision.

[9]  Yu-Sheng Chen,et al.  Natural Image Stitching with the Global Similarity Prior , 2016, ECCV.

[10]  Minh N. Do,et al.  SEAGULL: Seam-Guided Local Alignment for Parallax-Tolerant Image Stitching , 2016, ECCV.

[11]  Sisi Zlatanova,et al.  An automatic mosaicking method for building facade texture mapping using a monocular close-range image sequence , 2010 .

[12]  Cordelia Schmid,et al.  DeepMatching: Hierarchical Deformable Dense Matching , 2015, International Journal of Computer Vision.

[13]  Fan Zhang,et al.  Parallax-Tolerant Image Stitching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Younghui Kim,et al.  Rich360 , 2016, ACM Trans. Graph..

[15]  Dong-Qing Zhang,et al.  Multi-objective content preserving warping for image stitching , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[16]  Yasuyuki Matsushita,et al.  Smoothly varying affine stitching , 2011, CVPR 2011.

[17]  Gui-Song Xia,et al.  Anisotropic-Scale Junction Detection and Matching for Indoor Images , 2017, IEEE Transactions on Image Processing.

[18]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  C. Lawrence Zitnick,et al.  Fast Edge Detection Using Structured Forests , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Michael S. Brown,et al.  As-Projective-As-Possible Image Stitching with Moving DLT , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Tianzhu Xiang,et al.  Image Stitching by Line-guided Local Warping with Global Similarity Constraint , 2017, Pattern Recognit..

[22]  Theo Gevers,et al.  Image Alignment by Piecewise Planar Region Matching , 2014, IEEE Transactions on Multimedia.

[23]  Tat-Jun Chin,et al.  Correspondence Insertion for As-Projective-As-Possible Image Stitching , 2016, ArXiv.

[24]  Yoichi Sato,et al.  Shape-Preserving Half-Projective Warps for Image Stitching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[26]  Minh N. Do,et al.  Direct Photometric Alignment by Mesh Deformation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Hujun Bao,et al.  Multi-Viewpoint Panorama Construction With Wide-Baseline Images , 2016, IEEE Transactions on Image Processing.

[28]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[29]  Tianzhu Xiang,et al.  Image stitching with perspective-preserving warping , 2016, ArXiv.

[30]  Michael S. Brown,et al.  Constructing image panoramas using dual-homography warping , 2011, CVPR 2011.