Deep Image Stitching with Pixel Similarity Correlation

Image stitching is a task of synthesising images from different views without blur, seams and ghost effects. However, it is hard for existing methods to get all these visual problems solved. In this paper, we propose an image pre-reconstruction network to improve the similarity of images from different views in pixel level, which can eliminate ghost effects and correct some deviations in the image alignment step. Given the overlapping areas by warping two original images, we extract their features and calculate the distance map. According to the distance map, we classify the receptive field and define two kinds of loss functions to achieve different convergence effects. In addition, to obtain a seamless stitched image, we define a gradient loss to smooth the edge of overlapping area by narrowing the gradient between adjacent pixels. At last, we apply this gradient loss to all the image area to get a smooth effect for the whole image. Experiment shows that our method performs better than some existing methods on visual effect in the final composite.

[1]  Huijun Gao,et al.  Master-Slave Synchronous Control of Dual-Drive Gantry Stage With Cogging Force Compensation , 2023, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[2]  Huijun Gao,et al.  Approximation-Free Robust Synchronization Control for Dual-Linear-Motors-Driven Systems With Uncertainties and Disturbances , 2022, IEEE Transactions on Industrial Electronics.

[3]  Weihua Liu,et al.  A Novel Industrial Chip Parameters Identification Method Based on Cascaded Region Segmentation for Surface-Mount Equipment , 2022, IEEE Transactions on Industrial Electronics.

[4]  Xianqiang Yang,et al.  Image alignment using mixture models for discontinuous deformations , 2022, Signal Process..

[5]  Yao Zhao,et al.  Unsupervised Deep Image Stitching: Reconstructing Stitched Features to Images , 2021, IEEE Transactions on Image Processing.

[6]  Elahe Arani,et al.  Perceptual Loss for Robust Unsupervised Homography Estimation , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Wanli Xue,et al.  Ghost Elimination via Multi-Component Collaboration for Unmanned Aerial Vehicle Remote Sensing Image Stitching , 2021, Remote. Sens..

[8]  Haoqiang Fan,et al.  Motion Basis Learning for Unsupervised Deep Homography Estimation with Subspace Projection , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[9]  Huijun Gao,et al.  Hierarchical Multiobjective Heuristic for PCB Assembly Optimization in a Beam-Head Surface Mounter , 2021, IEEE Transactions on Cybernetics.

[10]  Yao Zhao,et al.  Learning Edge-Preserved Image Stitching from Large-Baseline Deep Homography , 2020, ArXiv.

[11]  Stephen Lin,et al.  Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Meiqin Liu,et al.  A view-free image stitching network based on global homography , 2020, J. Vis. Commun. Image Represent..

[13]  Wen Yu,et al.  Multi-scenes Image Stitching Based on Autonomous Driving , 2020, 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC).

[14]  Feng Liu,et al.  Deep Homography Estimation for Dynamic Scenes , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Shuaicheng Liu,et al.  Content-Aware Unsupervised Deep Homography Estimation , 2019, ECCV.

[16]  Qian He,et al.  Medical Image Stitching Using Parallel SIFT Detection and Transformation Fitting by Particle Swarm Optimization , 2017 .

[17]  Vijay Kumar,et al.  Unsupervised Deep Homography: A Fast and Robust Homography Estimation Model , 2017, IEEE Robotics and Automation Letters.

[18]  Minh N. Do,et al.  SEAGULL: Seam-Guided Local Alignment for Parallax-Tolerant Image Stitching , 2016, ECCV.

[19]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Fan Zhang,et al.  Parallax-Tolerant Image Stitching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[23]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[24]  Richard Szeliski,et al.  Eliminating ghosting and exposure artifacts in image mosaics , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[25]  Xianqiang Yang,et al.  Natural Image Stitching With Layered Warping Constraint , 2023, IEEE Transactions on Multimedia.