A Modeling and Measurement Approach for the Uncertainty of Features Extracted from Remote Sensing Images

The reliability of remote sensing (RS) image classification is crucial for applying RS image classification results. However, it has received minimal attention, especially the uncertainty of features extracted from RS images. The uncertainty of image features constantly accumulates, propagates, and ultimately affects the reliability and accuracy of image classification results. Thus, research on the quantitative modeling and measurement of the feature uncertainty of RS images is very necessary. To make up for the lack of research on quantitative modeling and measurement of uncertainty of image features, this study first investigates and summarizes the appearance characteristics of the feature uncertainty of RS images in geospatial and feature space domains based on the source and formation mechanisms of feature uncertainty. Then, a modeling and measurement approach for the uncertainty of image features is proposed on the basis of these characteristics. In this approach, a new Local Adaptive Multi-Feature Weighting Method based on Information Entropy and the Local Distribution Density of Points is proposed to model and measure the feature uncertainty of an image in the geospatial and feature space domains. In addition, a feature uncertainty index is also constructed to comprehensively describe and quantify the feature uncertainty, which can also be used to refine the classification map to improve its accuracy. Finally, we propose two effectiveness verification schemes in two perspectives, namely, statistical analysis and image classification, to verify the validity of the proposed approach. Experimental results on two real RS images confirm the validity of the proposed approach. Our study on the feature uncertainty of images may contribute to the development of uncertainty control methods or reliable classification schemes for RS images.

[1]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.

[2]  Chih-Jen Lin,et al.  Probability Estimates for Multi-class Classification by Pairwise Coupling , 2003, J. Mach. Learn. Res..

[3]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Jon Atli Benediktsson,et al.  Novel Object-Based Filter for Improving Land-Cover Classification of Aerial Imagery with Very High Spatial Resolution , 2016, Remote. Sens..

[5]  Jungho Im,et al.  Support vector machines in remote sensing: A review , 2011 .

[6]  Caspar A. Mücher,et al.  SegOptim - A new R package for optimizing object-based image analyses of high-spatial resolution remotely-sensed data , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[7]  Dongmei Chen,et al.  Segmentation for Object-Based Image Analysis (OBIA): A review of algorithms and challenges from remote sensing perspective , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  Bor-Chen Kuo,et al.  Feature Mining for Hyperspectral Image Classification , 2013, Proceedings of the IEEE.

[10]  Hans Hagen,et al.  An Uncertainty-Aware Visual System for Image Pre-Processing , 2018, J. Imaging.

[11]  Carlo Gatta,et al.  Unsupervised Deep Feature Extraction for Remote Sensing Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Markus Gerke,et al.  The ISPRS benchmark on urban object classification and 3D building reconstruction , 2012 .

[13]  James Bialas,et al.  Optimal segmentation of high spatial resolution images for the classification of buildings using random forests , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[14]  F. Pukelsheim The Three Sigma Rule , 1994 .

[15]  Qi Zhang,et al.  An Uncertainty Descriptor for Quantitative Measurement of the Uncertainty of Remote Sensing Images , 2019, Remote. Sens..

[16]  Carreño Carreño,et al.  Evaluación de la diversidad taxonómica y funcional de la comunidad microbiana relacionada con el ciclo del nitrógeno en suelos de cultivo de arroz con diferentes manejos del tamo , 2020 .

[17]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Bakhtiar Feizizadeh,et al.  A Novel Approach of Fuzzy Dempster–Shafer Theory for Spatial Uncertainty Analysis and Accuracy Assessment of Object-Based Image Classification , 2018, IEEE Geoscience and Remote Sensing Letters.

[19]  Hurtado Abril,et al.  Generación de un índice espectro-temporal para la identificación de zonas afectadas por deforestación usando imágenes Landsat. , 2020 .

[20]  Jon Atli Benediktsson,et al.  Automatic Object-Oriented, Spectral-Spatial Feature Extraction Driven by Tobler's First Law of Geography for Very High Resolution Aerial Imagery Classification , 2017, Remote. Sens..

[21]  S. Stigler Francis Galton's Account of the Invention of Correlation , 1989 .

[22]  P. V. Raju,et al.  Classification of wheat crop with multi-temporal images: performance of maximum likelihood and artificial neural networks , 2003 .

[23]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .

[24]  Weidong Li,et al.  A Markov Chain Geostatistical Framework for Land-Cover Classification With Uncertainty Assessment Based on Expert-Interpreted Pixels From Remotely Sensed Imagery , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Zhiyong Lv,et al.  Object-Based Spatial Feature for Classification of Very High Resolution Remote Sensing Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[26]  Wenzhong Shi,et al.  Validation of Land Cover Products Using Reliability Evaluation Methods , 2015, Remote. Sens..

[27]  Yohay Carmel,et al.  Controlling data uncertainty via aggregation in remotely sensed data , 2004, IEEE Geoscience and Remote Sensing Letters.

[28]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[29]  Cheng Shi,et al.  Novel Land Cover Change Detection Method Based on k-Means Clustering and Adaptive Majority Voting Using Bitemporal Remote Sensing Images , 2019, IEEE Access.

[30]  W. Tobler A Computer Movie Simulating Urban Growth in the Detroit Region , 1970 .

[31]  David J. Hand,et al.  Measurements and their Uncertainties: A Practical Guide to Modern Error Analysis by Ifan G. Hughes, Thomas P. A. Hase , 2011 .

[32]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[33]  Silvia Scarpetta,et al.  Uncertainty Analysis for the Classification of Multispectral Satellite Images Using SVMs and SOMs , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[35]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Roland Wilson,et al.  The Uncertainty Principle in Image Processing , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Jon Atli Benediktsson,et al.  Refining Land Cover Classification Maps Based on Dual-Adaptive Majority Voting Strategy for Very High Resolution Remote Sensing Images , 2018, Remote. Sens..

[38]  Bing Liu,et al.  Supervised Deep Feature Extraction for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Jing Li,et al.  An adaptive image Euclidean distance , 2009, Pattern Recognit..

[40]  Hans Hagen,et al.  Hierarchical Image Semantics Using Probabilistic Path Propagations for Biomedical Research , 2019, IEEE Computer Graphics and Applications.

[41]  Peijun Du,et al.  Hyperspectral Remote Sensing Image Classification Based on Rotation Forest , 2014, IEEE Geoscience and Remote Sensing Letters.

[42]  Antonio J. Plaza,et al.  New Postprocessing Methods for Remote Sensing Image Classification: A Systematic Study , 2014, IEEE Transactions on Geoscience and Remote Sensing.