Locally warping-based image stitching by imposing line constraints

Warping-based image stitching methods often suffer from perspective variations among multiple images and lead to shape and perspective distortions in stitching results. Moreover, they also quickly lose their efficiency in low-textured images, due to the lack of reliable point correspondences. To solve these problems, this paper presents a locally warping-based image stitching by imposing line constraints. First, a two-stage alignment scheme with line constraints is introduced to achieve accurate alignment. More precisely, line features are adopted as alignment constraints to jointly estimate local homographies with point correspondences, which provides strong correspondences especially in low-textured cases. Then line constraints are also imposed to the content-preserving warping framework to further reduce alignment errors and preserve image structures. Second, in order to preserve shape and perspective information, a global similarity transform is introduced to mitigate projective distortions. Experimental results demonstrate the efficiency of our method, which yields more encouraging image stitching results in contrast with state-of-the-art methods.

[1]  Huanfeng Shen,et al.  A robust mosaicking procedure for high spatial resolution remote sensing images , 2015 .

[2]  Zhanyi Hu,et al.  Robust line matching through line-point invariants , 2012, Pattern Recognit..

[3]  Yinda Zhang,et al.  PanoContext: A Whole-Room 3D Context Model for Panoramic Scene Understanding , 2014, ECCV.

[4]  Sharath Pankanti,et al.  Adaptive as-natural-as-possible image stitching , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[6]  Yasuyuki Matsushita,et al.  Smoothly varying affine stitching , 2011, CVPR 2011.

[7]  Michael S. Brown,et al.  As-Projective-As-Possible Image Stitching with Moving DLT , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Julie Delon,et al.  Accurate Junction Detection and Characterization in Natural Images , 2013, International Journal of Computer Vision.

[9]  Yung-Yu Chuang,et al.  Spatially-Varying Image Warps for Scene Alignment , 2014, 2014 22nd International Conference on Pattern Recognition.

[10]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Michael S. Brown,et al.  Constructing image panoramas using dual-homography warping , 2011, CVPR 2011.

[12]  Yoichi Sato,et al.  Shape-Preserving Half-Projective Warps for Image Stitching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Jun Zhu,et al.  Image Mosaic Method Based on SIFT Features of Line Segment , 2014, Comput. Math. Methods Medicine.

[14]  Tianzhu Xiang,et al.  Image stitching with perspective-preserving warping , 2016, ArXiv.

[15]  Robert J. Woodham,et al.  Combining Line and Point Correspondences for Homography Estimation , 2008, ISVC.

[16]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[17]  Kyungdon Joo,et al.  Line meets as-projective-as-possible image stitching with moving DLT , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[18]  Fan Zhang,et al.  Parallax-Tolerant Image Stitching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Fan Zhang,et al.  Casual stereoscopic panorama stitching , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Jian Sun,et al.  Dual-Feature Warping-Based Motion Model Estimation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[21]  Zuxun Zhang,et al.  SGM-based seamline determination for urban orthophoto mosaicking , 2016 .

[22]  FU Zhonglianga,et al.  AN ALGORITHM OF STRAIGHT LINE FEATURES MATCHING ON AERIAL IMAGERY , 2008 .