Real-time prediction of spatial raster time series: a context-aware autonomous learning model

Real-time prediction of spatial raster time series, such as those derived from satellite remote sensing imagery, is important for making emergency decisions on various geo-spatial processes/events. However, because of the scalability issue and large training time requirement, the neural network (NN)-based models often fail to perform real-time prediction, in spite of their tremendous potential. In this paper, we propose ContRast, a variant of recurrent NN-based context-aware raster time series prediction model that attempts to resolve these issues by: (1) eliminating the need for offline adjustment of network structure by employing self-evolving autonomous learning of recurrent neural network, (2) saving training time by adopting single-pass parameter learning mechanism, and (3) reducing redundant learning by skipping sub-regional data associated with similar spatio-temporal context and reusing already learned parameters to predict for the same. Experimental evaluations with respect to predicting normalized difference vegetation index (NDVI)-raster derived from MODIS Terra satellite remote sensing imagery show that ContRast is highly effective for real-time prediction of spatial raster time series, and it significantly outperforms the existing models. In addition, the theoretical analyses of model complexity and computational cost further justify our empirical observations.

[1]  Frank S. Marzano,et al.  Rainfall Nowcasting From Multisatellite Passive-Sensor Images Using a Recurrent Neural Network , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Online Prediction of Derived Remote Sensing Image Time Series: An Autonomous Machine Learning Approach , 2020, IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium.

[3]  Lei Han,et al.  A Machine Learning Nowcasting Method based on Real-time Reanalysis Data , 2016, ArXiv.

[4]  Abdelhak Belhi,et al.  Investigating low-delay deep learning-based cultural image reconstruction , 2020, Journal of Real-Time Image Processing.

[5]  Sang Michael Xie,et al.  Combining satellite imagery and machine learning to predict poverty , 2016, Science.

[6]  Victor S. Sheng,et al.  A real-time typhoon eye detection method based on deep learning for meteorological information forensics , 2019, Journal of Real-Time Image Processing.

[7]  Ahmed Eldawy,et al.  Large Scale Analytics of Vector+Raster Big Spatial Data , 2017, SIGSPATIAL/GIS.

[8]  Monidipa Das,et al.  Space-time Prediction of High Resolution Raster Data: An Approach based on Spatio-temporal Bayesian Network (STBN) , 2019, COMAD/CODS.

[9]  Xinying Xu,et al.  Optimized highway deep learning network for fast single image super-resolution reconstruction , 2020, Journal of Real-Time Image Processing.

[10]  Albert Y. Zomaya,et al.  pipsCloud: High performance cloud computing for remote sensing big data management and processing , 2018, Future Gener. Comput. Syst..

[11]  Shuicheng Yan,et al.  Dual Path Networks , 2017, NIPS.

[12]  Bin Chen,et al.  Spatially and Temporally Weighted Regression: A Novel Method to Produce Continuous Cloud-Free Landsat Imagery , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Mahardhika Pratama,et al.  SARDINE: A Self-Adaptive Recurrent Deep Incremental Network Model for Spatio-Temporal Prediction of Remote Sensing Data , 2020, ACM Trans. Spatial Algorithms Syst..

[15]  Ryosuke Shibasaki,et al.  Estimating crop yields with deep learning and remotely sensed data , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[16]  SARDINE , 2020, ACM Transactions on Spatial Algorithms and Systems.

[17]  Mohamed Elhoseny,et al.  Deep learning model for real-time image compression in Internet of Underwater Things (IoUT) , 2020, Journal of Real-Time Image Processing.

[18]  C. Ji,et al.  Haze reduction from the visible bands of LANDSAT TM and ETM+ images over a shallow water reef environment , 2008 .

[19]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[20]  Monidipa Das,et al.  Deep-STEP: A Deep Learning Approach for Spatiotemporal Prediction of Remote Sensing Data , 2016, IEEE Geoscience and Remote Sensing Letters.

[21]  Marta E. Zorrilla,et al.  A new image prediction model based on spatio-temporal techniques , 2007, The Visual Computer.

[22]  Junyu Dong,et al.  Prediction of Sea Surface Temperature Using Long Short-Term Memory , 2017, IEEE Geoscience and Remote Sensing Letters.

[23]  Monidipa Das,et al.  Spatio-temporal Autocorrelation Analysis for Regional Land-cover Change Detection from Remote Sensing Data , 2017, CODS.

[24]  Junyu Dong,et al.  A CFCC-LSTM Model for Sea Surface Temperature Prediction , 2018, IEEE Geoscience and Remote Sensing Letters.

[25]  Lianru Gao,et al.  Special issue on advances in real-time image processing for remote sensing , 2018, Journal of Real-Time Image Processing.

[26]  Pieter Kempeneers,et al.  A Kalman Filter-Based Method to Generate Continuous Time Series of Medium-Resolution NDVI Images , 2014, Remote. Sens..

[27]  Liangpei Zhang,et al.  Cloud removal for remotely sensed images by similar pixel replacement guided with a spatio-temporal MRF model , 2014 .

[28]  Monidipa Das,et al.  A Deep-Learning-Based Forecasting Ensemble to Predict Missing Data for Remote Sensing Analysis , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Ricardo Baeza-Yates,et al.  Quality-efficiency trade-offs in machine learning for text processing , 2017, 2017 IEEE International Conference on Big Data (Big Data).