Regional Linear Warping for Image Stitching with Dominant Edge Extraction

Image stitching techniques produce an image with a wide field-of-view by aligning multiple images with a narrow field-of-view. While conventional algorithms successfully stitch images with a small parallax, structure misalignment may occur when input images contain a large parallax. This paper presents an image stitching algorithm that aligns images with a large parallax by regional linear warping. To this end, input images are first approximated as multiple planar surfaces, and different linear warping is applied to each planar surface. For approximating input images as multiple planar surfaces, the concept of dominant edges is introduced. Dominant edges are defined as conspicuous edges of lines in input images, and extracted dominant edges identify the boundaries of each planar surface. Dominant edge extraction is conducted by detecting distinct changes of local characteristics around strong edge pixels. Experimental results show that the proposed algorithm successfully stitches images with a large parallax without structure misalignment.

[1]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[2]  Chi-Keung Tang,et al.  Eliminating structure and intensity misalignment in image stitching , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[3]  Ki-Seok Chung,et al.  A Parallelization Technique with Integrated Multi-Threading for Video Decoding on Multi-core Systems , 2013, KSII Trans. Internet Inf. Syst..

[4]  Chi-Keung Tang,et al.  Image Stitching Using Structure Deformation , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[6]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[7]  Richard Szeliski,et al.  Seamless Stitching using Multi-Perspective Plane Sweep , 2004 .

[8]  Richard Szeliski,et al.  Eliminating ghosting and exposure artifacts in image mosaics , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Jeremy R. Cooperstock,et al.  Toward Dynamic Image Mosaic Generation With Robustness to Parallax , 2012, IEEE Transactions on Image Processing.

[10]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[11]  Michael S. Brown,et al.  Constructing image panoramas using dual-homography warping , 2011, CVPR 2011.

[12]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .