CHANGE DETECTION BETWEEN DIGITAL SURFACE MODELS FROM AIRBORNE LASER SCANNING AND DENSE IMAGE MATCHING USING CONVOLUTIONAL NEURAL NETWORKS

Airborne photogrammetry and airborne laser scanning are two commonly used technologies used for topographical data acquisition at the city level. Change detection between airborne laser scanning data and photogrammetric data is challenging since the two point clouds show different characteristics. After comparing the two types of point clouds, this paper proposes a feed-forward Convolutional Neural Network (CNN) to detect building changes between them. The motivation from an application point of view is that the multimodal point clouds might be available for different epochs. Our method contains three steps: First, the point clouds and orthoimages are converted to raster images. Second, square patches are cropped from raster images and then fed into CNN for change detection. Finally, the original change map is post-processed with a simple connected component analysis. Experimental results show that the patch-based recall rate reaches 0.8146 and the precision rate reaches 0.7632. Object-based evaluation shows that 74 out of 86 building changes are correctly detected.

[1]  Bertrand Le Saux,et al.  Beyond RGB: Very High Resolution Urban Remote Sensing With Multimodal Deep Networks , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[2]  Norbert Pfeifer,et al.  Integrated Change Detection and Classification in Urban Areas Based on Airborne Laser Scanning Point Clouds , 2018, Sensors.

[3]  George Vosselman,et al.  Airborne and terrestrial laser scanning , 2011, Int. J. Digit. Earth.

[4]  Fabio Remondino,et al.  ISPRS benchmark for multi - platform photogrammetry , 2015 .

[5]  Menglong Yan,et al.  Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[6]  Michael Ying Yang,et al.  A patch-based method for the evaluation of dense image matching quality , 2018, Int. J. Appl. Earth Obs. Geoinformation.

[7]  Norbert Pfeifer,et al.  Dense Image Matching vs. Airborne Laser Scanning – Comparison of two methods for deriving terrain models , 2016 .

[8]  Michele Volpi,et al.  Deep multi-task learning for a geographically-regularized semantic segmentation of aerial images , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[9]  George Vosselman,et al.  Ground and Multi-Class Classification of Airborne Laser Scanner Point Clouds Using Fully Convolutional Networks , 2018, Remote. Sens..

[10]  J. Chris McGlone,et al.  Manual of photogrammetry , 2004 .

[11]  Liang-Chien Chen,et al.  Detection of building changes from aerial images and light detection and ranging (LIDAR) data , 2010 .

[12]  Fabio Remondino,et al.  State of the art in high density image matching , 2014 .

[13]  Yunsheng Zhang,et al.  Building Change Detection Using Old Aerial Images and New LiDAR Data , 2016, Remote. Sens..

[14]  D. Lu,et al.  Change detection techniques , 2004 .

[15]  George Vosselman,et al.  Change detection for updating medium scale maps using laster altimetry , 2004 .

[16]  Jiaojiao Tian,et al.  3 D change detection – approaches and applications , 2016 .

[17]  Brian Pilemann Olsen,et al.  AUTOMATIC CHANGE DETECTION FOR VALIDATION OF DIGITAL MAP DATABASES , 2004 .

[18]  Xiangyun Hu,et al.  Deep-Learning-Based Classification for DTM Extraction from ALS Point Cloud , 2016, Remote. Sens..

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  R. Goossens,et al.  Airborne photogrammetry and lidar for DSM extraction and 3D change detection over an urban area – a comparative study , 2013 .

[21]  Alexandre Boulch,et al.  Urban Change Detection for Multispectral Earth Observation Using Convolutional Neural Networks , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[22]  Norbert Pfeifer,et al.  IMPROVED TOPOGRAPHIC MODELS VIA CONCURRENT AIRBORNE LIDAR ANDDENSE IMAGE MATCHING , 2017 .

[23]  S. J. Oude Elberink,et al.  Detection and Classification of Changes in Buildings from Airborne Laser Scanning Data , 2013 .

[24]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Jascha Sohl-Dickstein,et al.  Sensitivity and Generalization in Neural Networks: an Empirical Study , 2018, ICLR.

[26]  Fred A. Kruse,et al.  Comparison of lidar and stereo photogrammetric point clouds for change detection , 2014, Defense + Security Symposium.