Landslide Recognition by Deep Convolutional Neural Network and Change Detection

It is a technological challenge to recognize landslides from remotely sensed (RS) images automatically and at high speeds, which is fundamentally important for preventing and controlling natural landslide hazards. Many methods have been developed, but there remains room for improvement for stable, higher accuracy, and high-speed landslide recognition for large areas with complex land cover. In this article, a novel integrated approach combining a deep convolutional neural network (CNN) and change detection is proposed for landslide recognition from RS images. Logically, it comprises the following four parts. First, a CNN for landslide recognition is built based on training data sets from RS images with historical landslides. Second, the object-oriented change detection CNN (CDCNN) with a fully connected conditional random field (CRF) is implemented based on the trained CNN. Third, the preliminary CDCNN is optimized by the proposed postprocessing methods. Finally, the results are further enhanced by a set of information extraction methods, including trail extraction, source point extraction, and attribute extraction. Furthermore, in the implementation of the proposed approach, image block processing and parallel processing strategies are adopted. As a result, the speed has been improved significantly, which is extremely important for RS images covering large areas. The effectiveness of the proposed approach has been examined using two landslide-prone sites, Lantau Island and Sharp Peak, Hong Kong, with a total area of more than 70 km2. Besides its high speed, the proposed approach has an accuracy exceeding 80%, and the experiments demonstrate its high practicability.

[1]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Sudhakar D Pardeshi,et al.  Landslide hazard assessment: recent trends and techniques , 2013, SpringerPlus.

[3]  Florence W. Y. Ko,et al.  From landslide susceptibility to landslide frequency: A territory-wide study in Hong Kong , 2018, Engineering Geology.

[4]  C. J. Westen,et al.  Analyzing the evolution of the Tessina landslide using aerial photographs and digital elevation models , 2003 .

[5]  Lin Yan,et al.  Landslide mapping from aerial photographs using change detection-based Markov random field , 2016 .

[6]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[7]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Daniele Giordan,et al.  Criteria for the optimal selection of remote sensing optical images to map event landslides , 2017 .

[9]  Shuichi Rokugawa,et al.  Detection and Volume Estimation of Large-Scale Landslides Based on Elevation-Change Analysis Using DEMs Extracted From High-Resolution Satellite Stereo Imagery , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[10]  F. Guzzetti,et al.  Landslide inventory maps: New tools for an old problem , 2012 .

[11]  Nikos Komodakis,et al.  Learning to compare image patches via convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  L. Hurni,et al.  Remote sensing of landslides: An analysis of the potential contribution to geo-spatial systems for hazard assessment in mountainous environments , 2005 .

[13]  Xiaojun Yang,et al.  sing multi-temporal remote sensor imagery to detect arthquake-triggered landslides , 2010 .

[14]  C. F. Lee,et al.  Assessment of landslide susceptibility on the natural terrain of Lantau Island, Hong Kong , 2001 .

[15]  F. Guzzetti,et al.  Visual interpretation of stereoscopic NDVI satellite images to map rainfall-induced landslides , 2018, Landslides.

[16]  Xiaoqiang Lu,et al.  A Coarse-to-Fine Semi-Supervised Change Detection for Multispectral Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[18]  Junwei Han,et al.  Automatic landslide detection from remote-sensing imagery using a scene classification method based on BoVW and pLSA , 2013 .

[19]  Li Min Zhang,et al.  Relationships between natural terrain landslide magnitudes and triggering rainfall based on a large landslide inventory in Hong Kong , 2018, Landslides.

[20]  Fausto Guzzetti,et al.  The impact of landslides in the Umbria region, central Italy , 2003 .

[21]  Fausto Guzzetti,et al.  Semi-automatic recognition and mapping of rainfall induced shallow landslides using optical satellite images , 2011 .

[22]  Roberta Pellicani,et al.  Evaluating the quality of landslide inventory maps: comparison between archive and surveyed inventories for the Daunia region (Apulia, Southern Italy) , 2015, Bulletin of Engineering Geology and the Environment.

[23]  Jiann-Yeou Rau,et al.  Semiautomatic Object-Oriented Landslide Recognition Scheme From Multisensor Optical Imagery and DEM , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Kang-Tsung Chang,et al.  Combining Multiple Change Detection Indices for Mapping Landslides Triggered by Typhoons , 2011 .

[25]  Kunlong Yin,et al.  Object-oriented change detection and damage assessment using high-resolution remote sensing images, Tangjiao Landslide, Three Gorges Reservoir, China , 2018, Environmental Earth Sciences.

[26]  Biswajeet Pradhan,et al.  Landslide Detection Using Residual Networks and the Fusion of Spectral and Topographic Information , 2019, IEEE Access.

[27]  Laura Longoni,et al.  Remote Sensing for Landslide Investigations: An Overview of Recent Achievements and Perspectives , 2014, Remote. Sens..

[28]  Xiaoqiang Lu,et al.  The Spectral-Spatial Joint Learning for Change Detection in Multispectral Imagery , 2019, Remote. Sens..

[29]  Ching Y. Suen,et al.  A fast parallel algorithm for thinning digital patterns , 1984, CACM.

[30]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[31]  Chong Xu,et al.  Three (nearly) complete inventories of landslides triggered by the May 12, 2008 Wenchuan Mw 7.9 earthquake of China and their spatial distribution statistical analysis , 2014, Landslides.

[32]  Qingyong Zhang,et al.  Automatic recognition of landslide based on CNN and texture change detection , 2016, 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[33]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[34]  Tao Chen,et al.  Object-Oriented Landslide Mapping Using ZY-3 Satellite Imagery, Random Forest and Mathematical Morphology, for the Three-Gorges Reservoir, China , 2017, Remote. Sens..

[35]  C. J. van Westen,et al.  Object-oriented analysis of multi-temporal panchromatic images for creation of historical landslide inventories , 2012 .

[36]  Liangpei Zhang,et al.  A Hybrid Object-Oriented Conditional Random Field Classification Framework for High Spatial Resolution Remote Sensing Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Kang-Tsung Chang,et al.  Bayesian framework for mapping and classifying shallow landslides exploiting remote sensing and topographic data , 2013 .

[38]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[39]  Paul L. Rosin,et al.  Monitoring landslides from optical remotely sensed imagery: the case history of Tessina landslide, Italy , 2003 .

[40]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[41]  Shuying Li,et al.  Landslide Inventory Mapping From Bitemporal Images Using Deep Convolutional Neural Networks , 2019, IEEE Geoscience and Remote Sensing Letters.

[42]  Birgit Kleinschmit,et al.  Derivation of long-term spatiotemporal landslide activity—A multi-sensor time series approach , 2016 .

[43]  Chong Xu,et al.  Database and spatial distribution of landslides triggered by the Lushan, China Mw 6.6 earthquake of 20 April 2013 , 2015 .

[44]  Thomas Blaschke,et al.  Evaluation of Different Machine Learning Methods and Deep-Learning Convolutional Neural Networks for Landslide Detection , 2019, Remote. Sens..

[45]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[47]  Irasema Alcántara-Ayala,et al.  Satellite stereoscopic pair images of very high resolution: a step forward for the development of landslide inventories , 2015, Landslides.

[48]  Ping Lu,et al.  Object-Oriented Change Detection for Landslide Rapid Mapping , 2011, IEEE Geoscience and Remote Sensing Letters.

[49]  Hong Yu,et al.  A landslide intelligent detection method based on CNN and RSG_R , 2017, 2017 IEEE International Conference on Mechatronics and Automation (ICMA).

[50]  Wenzhong Shi,et al.  Semi-automated landslide inventory mapping from bitemporal aerial photographs using change detection and level set method , 2016 .

[51]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[52]  Murat Ercanoglu,et al.  Landslide identification and classification by object-based image analysis and fuzzy logic: An example from the Azdavay region (Kastamonu, Turkey) , 2012, Comput. Geosci..