DeepOcean: A General Deep Learning Framework for Spatio-Temporal Ocean Sensing Data Prediction

The emerging Internet of Underwater Things (IoUT) and deep learning technologies are combined to provide a novel, intelligent, and efficient data processing and analyzing schema, which facilitates the sensing and computing abilities for the smart ocean. The underwater acoustic (UWA) communication network is an essential part of IoUT. The thermocline, in which temperature and density change drastically, affects the connectivity and communication performance between IoUT nodes, as well as the network topologies. In this paper, we propose DeepOcean, a deep learning framework for spatio-temporal ocean sensing data prediction, which consists of a generative module and a prediction module. We implement the generative module with a multi-layer perceptron (MLP) to capture the spatial dependencies and construct high-resolution data based on sparse observations. The prediction module is implemented with our proposed Multivariate Convolutional LSTM (MVC-LSTM) neural network, which captures both the spatio-temporal dependencies and the interactions of different oceanographic features for prediction. We evaluate the effectiveness of DeepOcean with Argo data, where the proposed framework outperforms fifteen state-of-art baselines in terms of accuracy.

[1]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[2]  Dong Yu,et al.  Deep Learning and Its Applications to Signal and Information Processing [Exploratory DSP] , 2011, IEEE Signal Processing Magazine.

[3]  Davide Bacciu,et al.  A Gentle Introduction to Deep Learning for Graphs , 2019, Neural Networks.

[4]  Alaa El. Sagheer,et al.  Time series forecasting of petroleum production using deep LSTM recurrent networks , 2019, Neurocomputing.

[5]  Shaohan Hu,et al.  DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing , 2016, WWW.

[6]  Peter C. Y. Chen,et al.  LSTM network: a deep learning approach for short-term traffic forecast , 2017 .

[7]  Milica Stojanovic,et al.  Underwater acoustic communication channels: Propagation models and statistical characterization , 2009, IEEE Communications Magazine.

[8]  Shereen A. Taie,et al.  H-Ahead Multivariate microclimate Forecasting System Based on Deep Learning , 2019, 2019 International Conference on Innovative Trends in Computer Engineering (ITCE).

[9]  Milica Stojanovic,et al.  Underwater Acoustic Communications and Networking: Recent Advances and Future Challenges , 2008 .

[10]  El-Sayed M. El-Alfy,et al.  Stock Market Forecast Using Multivariate Analysis with Bidirectional and Stacked (LSTM, GRU) , 2018, 2018 21st Saudi Computer Society National Computer Conference (NCC).

[11]  Junyu Dong,et al.  A CFCC-LSTM Model for Sea Surface Temperature Prediction , 2018, IEEE Geoscience and Remote Sensing Letters.

[12]  Junyu Dong,et al.  Prediction of Sea Surface Temperature Using Long Short-Term Memory , 2017, IEEE Geoscience and Remote Sensing Letters.

[13]  Kun Zhang,et al.  Prediction of 3-D Ocean Temperature by Multilayer Convolutional LSTM , 2020, IEEE Geoscience and Remote Sensing Letters.

[14]  Q. Zheng,et al.  A study of response of thermocline in the South China Sea to ENSO events , 2018, Journal of Oceanology and Limnology.

[15]  Wei Zhou,et al.  Development of a global gridded Argo data set with Barnes successive corrections: A NEW GLOBAL GRIDDED ARGO DATA SET , 2017 .

[16]  Dario Pompili,et al.  Underwater acoustic sensor networks: research challenges , 2005, Ad Hoc Networks.

[17]  Dong Yu,et al.  Deep Learning and Its Applications to Signal and Information Processing , 2011 .

[18]  Lyudmila Mihaylova,et al.  Structural Recurrent Neural Network for Traffic Speed Prediction , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[20]  Nitish Srivastava,et al.  Unsupervised Learning of Video Representations using LSTMs , 2015, ICML.

[21]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[22]  Yu Jiang,et al.  High-resolution temperature and salinity model analysis using support vector regression , 2018, Journal of Ambient Intelligence and Humanized Computing.

[23]  Tianrui Li,et al.  Predicting Citywide Crowd Flows Using Deep Spatio-Temporal Residual Networks , 2017, Artif. Intell..

[24]  Borhan Molazem Sanandaji,et al.  Deep Forecast: Deep Learning-based Spatio-Temporal Forecasting , 2017, ArXiv.

[25]  G. Mellor Introduction to physical oceanography , 1996 .

[26]  Yong Wang,et al.  Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction , 2017, Sensors.

[27]  Jianhui Wang,et al.  Spatio-Temporal Graph Deep Neural Network for Short-Term Wind Speed Forecasting , 2019, IEEE Transactions on Sustainable Energy.

[28]  Liang Yan,et al.  A shadow zone aware routing protocol for acoustic underwater sensor networks , 2009, IEEE Communications Letters.

[29]  Yu Gou,et al.  KNN regression model-based refinement of thermohaline data , 2018, WUWNet.

[30]  Chi-Yin Chow,et al.  STCNN: A Spatio-Temporal Convolutional Neural Network for Long-Term Traffic Prediction , 2019, 2019 20th IEEE International Conference on Mobile Data Management (MDM).

[31]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[32]  Zhang Xu,et al.  THE GENERAL DISTRIBUTION CHARACTERISTICS OF THERMOCLINE OF CHINA SEA , 2006 .