A Novel Region-Based Image Registration Method for Multisource Remote Sensing Images Via CNN

The comprehensive utilization of images from various satellite sensors can significantly increase the performance of remote sensing applications and has, therefore, attracted extensive research attention. One of the essential challenges that research encounters comes from multisource image registration. This article proposes a novel region-based image registration method for multisource images. The proposed method exploits the region features of input images, which provide more consistent and common information of the multisource data. The image region features are extracted based on image semantic segmentation using the deep convolutional neural network approach. The final registration result is a pixel-level output corresponding to the input images. The proposed registration scheme overcomes the limits of traditional feature extraction methods (e.g., point feature) adopted in previous registration schemes. Results indicate that the proposed method has good performance for the multisource remote sensing image registration and can serve as a building block for the fusion of multisource images.

[1]  Kyung-Tae Kim,et al.  Automatic SAR Image Registration via Tsallis Entropy and Iterative Search Process , 2020, IEEE Sensors Journal.

[2]  Francesca Bovolo,et al.  A Fast and Robust Matching Framework for Multimodal Remote Sensing Image Registration , 2018, ArXiv.

[3]  Feng Wang,et al.  OS-Flow: A Robust Algorithm for Dense Optical and SAR Image Registration , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Frank Nielsen,et al.  Statistical region merging , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Julie Delon,et al.  SAR-SIFT: A SIFT-Like Algorithm for SAR Images , 2015, IEEE Trans. Geosci. Remote. Sens..

[7]  Songde Ma,et al.  Multisource data registration based on NURBS description of contours , 2008 .

[8]  S. Osher,et al.  Geometric Level Set Methods in Imaging, Vision, and Graphics , 2011, Springer New York.

[9]  Jian Yang,et al.  Land Cover Classification for Polarimetric SAR Images Based on Mixture Models , 2014, Remote. Sens..

[10]  Anthony J. Yezzi,et al.  A geometric snake model for segmentation of medical imagery , 1997, IEEE Transactions on Medical Imaging.

[11]  Xiao Xiang Zhu,et al.  Identifying Corresponding Patches in SAR and Optical Images With a Pseudo-Siamese CNN , 2018, IEEE Geoscience and Remote Sensing Letters.

[12]  Kees Joost Batenburg,et al.  Adaptive thresholding of tomograms by projection distance minimization , 2009, Pattern Recognit..

[13]  Loïc Le Folgoc,et al.  Attention U-Net: Learning Where to Look for the Pancreas , 2018, ArXiv.

[14]  Peter Reinartz,et al.  Mutual-Information-Based Registration of TerraSAR-X and Ikonos Imagery in Urban Areas , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Lorenzo Bruzzone,et al.  Earthquake Damage Assessment of Buildings Using VHR Optical and SAR Imagery , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Alireza Kashanipour,et al.  Robust Color Classification Using Fuzzy Rule-Based Particle Swarm Optimization , 2008, 2008 Congress on Image and Signal Processing.

[18]  Zhiming Luo,et al.  Weighted Res-UNet for High-Quality Retina Vessel Segmentation , 2018, 2018 9th International Conference on Information Technology in Medicine and Education (ITME).

[19]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[20]  Heng-Da Cheng,et al.  Fuzzy subfiber and its application to seismic lithology classification , 1994 .

[21]  G. Carbone,et al.  Monitoring agricultural drought for arid and humid regions using multi-sensor remote sensing data , 2010 .

[22]  D. Tralli,et al.  Satellite remote sensing of earthquake, volcano, flood, landslide and coastal inundation hazards , 2005 .

[23]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[24]  Chunhong Pan,et al.  Registration of Optical and SAR Satellite Images by Exploring the Spatial Relationship of the Improved SIFT , 2013, IEEE Geoscience and Remote Sensing Letters.

[25]  Lorenzo Bruzzone,et al.  Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Francesca Bovolo,et al.  A Novel Framework for the Design of Change-Detection Systems for Very-High-Resolution Remote Sensing Images , 2013, Proceedings of the IEEE.

[27]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[28]  Yang Yang,et al.  Multi-Temporal Remote Sensing Image Registration Using Deep Convolutional Features , 2018, IEEE Access.

[29]  B. Dousseta,et al.  Satellite multi-sensor data analysis of urban surface temperatures and landcover , 2003 .

[30]  Gustau Camps-Valls,et al.  Multi-temporal and multi-source remote sensing image classification by nonlinear relative normalization , 2016, ArXiv.

[31]  Devis Tuia,et al.  Geospatial Correspondences for Multimodal Registration , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Anuar Ahmad,et al.  A new approach for surface water change detection: Integration of pixel level image fusion and image classification techniques , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[33]  Mark R. Pickering,et al.  Multi-modal Registration of SAR and Optical Satellite Images , 2009, 2009 Digital Image Computing: Techniques and Applications.

[34]  Ling Wan,et al.  A Post-Classification Comparison Method for SAR and Optical Images Change Detection , 2019, IEEE Geoscience and Remote Sensing Letters.

[35]  Kees Joost Batenburg,et al.  Optimal Threshold Selection for Tomogram Segmentation by Projection Distance Minimization , 2009, IEEE Transactions on Medical Imaging.

[36]  Li Kai,et al.  Review of Research on Registration of SAR and Optical Remote Sensing Image Based on Feature , 2018, 2018 IEEE 3rd International Conference on Signal and Image Processing (ICSIP).

[37]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Mert R. Sabuncu,et al.  VoxelMorph: A Learning Framework for Deformable Medical Image Registration , 2018, IEEE Transactions on Medical Imaging.

[39]  Ling Wan,et al.  OS-PC: Combining Feature Representation and 3-D Phase Correlation for Subpixel Optical and SAR Image Registration , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[40]  W. Walker,et al.  Mapping forest structure for wildlife habitat analysis using multi-sensor (LiDAR, SAR/InSAR, ETM+, Quickbird) synergy , 2006 .

[41]  Yun Zhang,et al.  Understanding image fusion , 2004 .

[42]  Vijayan K. Asari,et al.  Recurrent Residual Convolutional Neural Network based on U-Net (R2U-Net) for Medical Image Segmentation , 2018, ArXiv.

[43]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[44]  Umesh C. Pati,et al.  Automatic optical-to-SAR image registration using a structural descriptor , 2020, IET Image Process..

[45]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Tony Lindeberg,et al.  Segmentation and Classification of Edges Using Minimum Description Length Approximation and Complementary Junction Cues , 1996, Comput. Vis. Image Underst..

[47]  Lauren Barghout,et al.  Visual Taxometric Approach to Image Segmentation Using Fuzzy-Spatial Taxon Cut Yields Contextually Relevant Regions , 2014, IPMU.