Deep change feature analysis network for observing changes of land use or natural environment

Abstract Change detection on surface of earth plays an important role in global-scale pattern of climate and biogeochemistry of the world, which helps to comprehend the connections and associations between human and nature. Remote Sensing and Geographic Information Systems can possibly provide accurate data in regards to land use and land cover changes. However, pixel-based change detection methods are limited in suppressing outliers and noise; they often fail to process remote sensing images with high spatial-/spectral-resolution. To conquer these drawbacks, a superpixel-level change detection and analysis method is proposed in this paper. Superpixels are the atomic regions gathering pixels with similar property, which will be more efficient and robust than pixels. Deep neural network is a powerful feature learning and classification tool, it can represent superpixel abstractly and classify them robustly. The learning progress of deep architectures includes unsupervised sample selection and supervised feature learning, unsupervised progress aims at selecting training samples for deep neural network, supervised progress aims at learning the representation of superpixels and fine-tuning the whole network to finish classification. Experimental results on multi-temporal images have demonstrated that the proposed approach can handle the task of change detection and analysis effectively and accurately.

[1]  John R. Jensen,et al.  Object‐based change detection using correlation image analysis and image segmentation , 2008 .

[2]  Yue Cao,et al.  Transferable Representation Learning with Deep Adaptation Networks , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Subhashini Venugopalan,et al.  Translating Videos to Natural Language Using Deep Recurrent Neural Networks , 2014, NAACL.

[4]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Alexei A. Efros,et al.  Recovering human body configurations: combining segmentation and recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[7]  K. Anusudha,et al.  Geometric image change detection in urban environment , 2017, 2017 Fourth International Conference on Signal Processing, Communication and Networking (ICSCN).

[8]  Francesca Bovolo,et al.  A Theoretical Framework for Unsupervised Change Detection Based on Change Vector Analysis in the Polar Domain , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Lorenzo Bruzzone,et al.  An adaptive semiparametric and context-based approach to unsupervised change detection in multitemporal remote-sensing images , 2002, IEEE Trans. Image Process..

[10]  Francesca Bovolo,et al.  A Framework for Automatic and Unsupervised Detection of Multiple Changes in Multitemporal Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Zhao Wang,et al.  Detecting multiple changes from multi-temporal images by using stacked denosing autoencoder based change vector analysis , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[12]  Rama Chellappa,et al.  Entropy rate superpixel segmentation , 2011, CVPR 2011.

[13]  Amir Hussain,et al.  Applications of Deep Learning and Reinforcement Learning to Biological Data , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Nazzareno Pierdicca,et al.  Satellite radar and optical remote sensing for earthquake damage detection: results from different case studies , 2006 .

[15]  Jianchao Fan,et al.  Classification of PolSAR Images Based on Adaptive Nonlocal Stacked Sparse Autoencoder , 2018, IEEE Geoscience and Remote Sensing Letters.

[16]  Geoffrey J. Hay,et al.  Object-based change detection , 2012 .

[17]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Maoguo Gong,et al.  Feature-Level Change Detection Using Deep Representation and Feature Change Analysis for Multispectral Imagery , 2016, IEEE Geoscience and Remote Sensing Letters.

[19]  Mahesh Jampani,et al.  Multi-functionality and land use dynamics in a peri-urban environment influenced by wastewater irrigation , 2020 .

[20]  Hao Zhou,et al.  Social inequalities in neighborhood visual walkability: Using street view imagery and deep learning technologies to facilitate healthy city planning , 2019, Sustainable Cities and Society.

[21]  G. H. Rosenfield,et al.  A coefficient of agreement as a measure of thematic classification accuracy. , 1986 .

[22]  Volker Walter,et al.  Object-based classification of remote sensing data for change detection , 2004 .

[23]  Josef Kittler,et al.  Minimum error thresholding , 1986, Pattern Recognit..

[24]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[25]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[26]  Jinsong Deng,et al.  PCA‐based land‐use change detection and analysis using multitemporal and multisensor satellite data , 2008 .

[27]  Cordelia Schmid,et al.  Good Practice in Large-Scale Learning for Image Classification , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Lingli Zhao,et al.  The potential of linear discriminative Laplacian eigenmaps dimensionality reduction in polarimetric SAR classification for agricultural areas , 2013 .

[29]  Qian Fan,et al.  SUPERPIXEL-BASED UNSUPERVISED CHANGE DETECTION USING MULTI-DIMENSIONAL CHANGE VECTOR ANALYSIS AND SVM-BASED CLASSIFICATION , 2012 .

[30]  Stefano Soatto,et al.  Quick Shift and Kernel Methods for Mode Seeking , 2008, ECCV.

[31]  Mohammad Rahim Rahnama,et al.  Forecasting land-use changes in Mashhad Metropolitan area using Cellular Automata and Markov chain model for 2016-2030 , 2021 .

[32]  Umar Mohammed,et al.  Superpixel lattices , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Greg Mori,et al.  Guiding model search using segmentation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[34]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[35]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Peijun Du,et al.  Fusion of Difference Images for Change Detection Over Urban Areas , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[39]  Ding Liu,et al.  Nonlinear Generalized Predictive Control of the Crystal Diameter in CZ-Si Crystal Growth Process Based on Stacked Sparse Autoencoder , 2020, IEEE Transactions on Control Systems Technology.

[40]  Yoshua Bengio,et al.  Deep Learning of Representations for Unsupervised and Transfer Learning , 2011, ICML Unsupervised and Transfer Learning.

[41]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[42]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[43]  Bo Du,et al.  Saliency-Guided Unsupervised Feature Learning for Scene Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images based on Image Fusion and Fuzzy Clustering , 2012, IEEE Transactions on Image Processing.

[45]  Stelios Krinidis,et al.  A Robust Fuzzy Local Information C-Means Clustering Algorithm , 2010, IEEE Transactions on Image Processing.

[46]  Maoguo Gong,et al.  Superpixel-Based Difference Representation Learning for Change Detection in Multispectral Remote Sensing Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Ling Shao,et al.  Learning Deep and Wide: A Spectral Method for Learning Deep Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[48]  Xiaojing Huang,et al.  Superpixel-based change detection in high resolution sar images using region covariance features , 2015, 2015 8th International Workshop on the Analysis of Multitemporal Remote Sensing Images (Multi-Temp).

[49]  Ruci Wang,et al.  Geo-simulation of land use/cover scenarios and impacts on land surface temperature in Sapporo, Japan , 2020 .

[50]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[51]  Suli Zhao,et al.  Modeling air quality prediction using a deep learning approach: Method optimization and evaluation , 2020 .

[52]  Cristiano Saltori,et al.  Deep Learning for Classification and Localization of COVID-19 Markers in Point-of-Care Lung Ultrasound , 2020, IEEE Transactions on Medical Imaging.

[53]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[54]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[55]  Allan Aasbjerg Nielsen,et al.  The Regularized Iteratively Reweighted MAD Method for Change Detection in Multi- and Hyperspectral Data , 2007, IEEE Transactions on Image Processing.