Integrating Unsupervised Machine Intelligence and Anomaly Detection for Spatio-Temporal Dynamic Mapping Using Remote Sensing Image Series

The synergistic use of remote sensing and unsupervised machine learning has emerged as a potential tool for addressing a variety of environmental monitoring applications, such as detecting disaster-affected areas and deforestation. This paper proposes a new machine-intelligent approach to detecting and characterizing spatio-temporal changes on the Earth’s surface by using remote sensing data and unsupervised learning. Our framework was designed to be fully automatic by integrating unsupervised anomaly detection models, remote sensing image series, and open data extracted from the Google Earth Engine platform. The methodology was evaluated by taking both simulated and real-world environmental data acquired from several imaging sensors, including Landsat-8 OLI, Sentinel-2 MSI, and Terra MODIS. The experimental results were measured with the kappa and F1-score metrics, and they indicated an assertiveness level of 0.85 for the change detection task, demonstrating the accuracy and robustness of the proposed approach when addressing distinct environmental monitoring applications, including the detection of disaster-affected areas and deforestation mapping.

[1]  Wallace Casaca,et al.  A Fully Unsupervised Machine Learning Framework for Algal Bloom Forecasting in Inland Waters Using MODIS Time Series and Climatic Products , 2022, Remote. Sens..

[2]  Esra Tunc Gormus,et al.  Multi-sensor spectral synergies for crop stress detection and monitoring in the optical domain: A review , 2022, Remote sensing of environment.

[3]  Xiangfeng Wang,et al.  Unsupervised and semi-supervised learning: the next frontier in machine learning for plant systems biology. , 2022, The Plant journal : for cell and molecular biology.

[4]  K. Massi,et al.  Mapping Fire Susceptibility in the Brazilian Amazon Forests Using Multitemporal Remote Sensing and Time-Varying Unsupervised Anomaly Detection , 2022, Remote. Sens..

[5]  X. Wang,et al.  Evaluating the Effectiveness of Machine Learning and Deep Learning Models Combined Time-Series Satellite Data for Multiple Crop Types Classification over a Large-Scale Region , 2022, Remote. Sens..

[6]  Xiangyun Hu,et al.  A Survey on Deep Learning-Based Change Detection from High-Resolution Remote Sensing Images , 2022, Remote. Sens..

[7]  S. Kouchaki,et al.  An Unsupervised Data-Driven Anomaly Detection Approach for Adverse Health Conditions in People Living With Dementia: Cohort Study , 2022, JMIR aging.

[8]  R. Kaur,et al.  A review on spectral indices for built-up area extraction using remote sensing technology , 2022, Arabian Journal of Geosciences.

[9]  Ileana Pătru-Stupariu,et al.  Impacts of the European Landscape Convention on interdisciplinary and transdisciplinary research , 2022, Landscape Ecology.

[10]  Tao Zhou,et al.  Improving the drought monitoring capability of VHI at the global scale via ensemble indices for various vegetation types from 2001 to 2018 , 2022, Weather and Climate Extremes.

[11]  Felix Rembold,et al.  A review of satellite-based global agricultural monitoring systems available for Africa , 2021 .

[12]  Andrija Krtalić,et al.  Systematic Review of Anomaly Detection in Hyperspectral Remote Sensing Applications , 2021, Applied Sciences.

[13]  Rogério Galante Negri,et al.  Anomalous behaviour detection using one-class support vector machine and remote sensing images: a case study of algal bloom occurrence in inland waters , 2021, Int. J. Digit. Earth.

[14]  L. Aragão,et al.  The Brazilian Amazon deforestation rate in 2020 is the greatest of the decade , 2020, Nature Ecology & Evolution.

[15]  Maria Antonia Brovelli,et al.  Monitoring Forest Change in the Amazon Using Multi-Temporal Remote Sensing Data and Machine Learning Classification on Google Earth Engine , 2020, ISPRS Int. J. Geo Inf..

[16]  Carlos Roberto de Souza Filho,et al.  The 2019 Brumadinho tailings dam collapse: Possible cause and impacts of the worst human and environmental disaster in Brazil , 2020, Int. J. Appl. Earth Obs. Geoinformation.

[17]  R. Betts,et al.  El Niño Driven Changes in Global Fire 2015/16 , 2020, Frontiers in Earth Science.

[18]  Eliakim Hamunyela,et al.  Space-time detection of deforestation, forest degradation and regeneration in montane forests of Eastern Tanzania , 2020, Int. J. Appl. Earth Obs. Geoinformation.

[19]  Maitiniyazi Maimaitijiang,et al.  Monitoring inland water quality using remote sensing: potential and limitations of spectral indices, bio-optical simulations, machine learning, and cloud computing , 2020 .

[20]  A. Frery,et al.  Spectral–Spatial-Aware Unsupervised Change Detection With Stochastic Distances and Support Vector Machines , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Shutao Li,et al.  Hyperspectral Anomaly Detection With Kernel Isolation Forest , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[22]  J. Marengo,et al.  The role of ENSO flavours and TNA on recent droughts over Amazon forests and the Northeast Brazil region , 2019, International Journal of Climatology.

[23]  Rogério Galante Negri,et al.  An Incongruence-Based Anomaly Detection Strategy for Analyzing Water Pollution in Images from Remote Sensing , 2019, Remote. Sens..

[24]  Francisco Gomariz-Castillo,et al.  Isolation Forests to Evaluate Class Separability and the Representativeness of Training and Validation Areas in Land Cover Classification , 2019, Remote. Sens..

[25]  André C. P. L. F. de Carvalho,et al.  TerraBrasilis: A Spatial Data Analytics Infrastructure for Large-Scale Thematic Mapping , 2019, ISPRS Int. J. Geo Inf..

[26]  Jie Gu,et al.  A novel approach to intrusion detection using SVM ensemble with feature augmentation , 2019, Comput. Secur..

[27]  Taís Rizzo Moreira,et al.  Relation of El Niño and La Niña phenomena to precipitation, evapotranspiration and temperature in the Amazon basin. , 2019, The Science of the total environment.

[28]  Kerrie L. Mengersen,et al.  Statistical Machine Learning Methods and Remote Sensing for Sustainable Development Goals: A Review , 2018, Remote. Sens..

[29]  Xiaolin Zhu,et al.  Spatiotemporal Fusion of Multisource Remote Sensing Data: Literature Survey, Taxonomy, Principles, Applications, and Future Directions , 2018, Remote. Sens..

[30]  Peijun Du,et al.  Object-Based Change Detection in Urban Areas from High Spatial Resolution Images Based on Multiple Features and Ensemble Learning , 2018, Remote. Sens..

[31]  Michael Dixon,et al.  Google Earth Engine: Planetary-scale geospatial analysis for everyone , 2017 .

[32]  D. Rybski,et al.  A Systematic Study of Sustainable Development Goal (SDG) Interactions , 2017 .

[33]  Flávio Fonseca do Carmo,et al.  Fundão tailings dam failures: the environment tragedy of the largest technological disaster of Brazilian mining in global context , 2017 .

[34]  Amory B. Lovins,et al.  Natural Capitalism: The Next Industrial Revolution , 2017 .

[35]  Baofeng Su,et al.  Significant Remote Sensing Vegetation Indices: A Review of Developments and Applications , 2017, J. Sensors.

[36]  Ruiliang Pu,et al.  Anomaly Detection from Hyperspectral Remote Sensing Imagery , 2016 .

[37]  Jon Atli Benediktsson,et al.  Big Data for Remote Sensing: Challenges and Opportunities , 2016, Proceedings of the IEEE.

[38]  Kerstin Paech,et al.  Anomaly detection for machine learning redshifts applied to SDSS galaxies , 2015, 1503.08214.

[39]  W. Steffen,et al.  The trajectory of the Anthropocene: The Great Acceleration , 2015 .

[40]  Danai Koutra,et al.  Graph based anomaly detection and description: a survey , 2014, Data Mining and Knowledge Discovery.

[41]  C. Justice,et al.  High-Resolution Global Maps of 21st-Century Forest Cover Change , 2013, Science.

[42]  Rasmus Fensholt,et al.  Estimation of Herbaceous Fuel Moisture Content Using Vegetation Indices and Land Surface Temperature from MODIS Data , 2013, Remote. Sens..

[43]  Clement Atzberger,et al.  Using Low Resolution Satellite Imagery for Yield Prediction and Yield Anomaly Detection , 2013, Remote. Sens..

[44]  Yi Hu,et al.  Fault Detection and Identification Based on the Neighborhood Standardized Local Outlier Factor Method , 2013, Industrial & Engineering Chemistry Research.

[45]  Alexander Barth,et al.  Outlier detection in satellite data using spatial coherence , 2012 .

[46]  Andrew R. Webb,et al.  Statistical Pattern Recognition: Webb/Statistical Pattern Recognition , 2011 .

[47]  Thomas G. Dietterich,et al.  Spatiotemporal Models for Data-Anomaly Detection in Dynamic Environmental Monitoring Campaigns , 2011, TOSN.

[48]  Gaël Varoquaux,et al.  The NumPy Array: A Structure for Efficient Numerical Computation , 2011, Computing in Science & Engineering.

[49]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[50]  A. Huete,et al.  Vegetation Index Methods for Estimating Evapotranspiration by Remote Sensing , 2010 .

[51]  Jingxiong Zhang,et al.  Anomaly detection in MODIS land products via time series analysis , 2007 .

[52]  S. Tarantola,et al.  Designing a spectral index to estimate vegetation water content from remote sensing data: Part 1 - Theoretical approach , 2002 .

[53]  Dimitris G. Manolakis,et al.  Detection algorithms for hyperspectral imaging applications , 2002, IEEE Signal Process. Mag..

[54]  Russell Congalton,et al.  Assessing the Accuracy of Remotely Sensed Data: Principles and Practices, Second Edition , 1998 .

[55]  B. Gao NDWI—A normalized difference water index for remote sensing of vegetation liquid water from space , 1996 .

[56]  Jean-Yves Tourneret,et al.  Generalized isolation forest for anomaly detection , 2021, Pattern Recognit. Lett..

[57]  Amir Hossein Alavi,et al.  Machine learning in geosciences and remote sensing , 2016 .

[58]  Nasser M. Nasrabadi,et al.  Hyperspectral Target Detection : An Overview of Current and Future Challenges , 2014, IEEE Signal Processing Magazine.

[59]  J. A. Schell,et al.  Monitoring vegetation systems in the great plains with ERTS , 1973 .