Physics-Guided Generative Adversarial Networks for Sea Subsurface Temperature Prediction

Sea subsurface temperature, an essential component of aquatic wildlife, underwater dynamics, and heat transfer with the sea surface, is affected by global warming in climate change. Existing research is commonly based on either physics-based numerical models or data-based models. Physical modeling and machine learning are traditionally considered as two unrelated fields for the sea subsurface temperature prediction task, with very different scientific paradigms (physics-driven and data-driven). However, we believe that both methods are complementary to each other. Physical modeling methods can offer the potential for extrapolation beyond observational conditions, while data-driven methods are flexible in adapting to data and are capable of detecting unexpected patterns. The combination of both approaches is very attractive and offers potential performance improvement. In this article, we propose a novel framework based on a generative adversarial network (GAN) combined with a numerical model to predict sea subsurface temperature. First, a GAN-based model is used to learn the simplified physics between the surface temperature and the target subsurface temperature in the numerical model. Then, observation data are used to calibrate the GAN-based model parameters to obtain a better prediction. We evaluate the proposed framework by predicting daily sea subsurface temperature in the South China Sea. Extensive experiments demonstrate the effectiveness of the proposed framework compared to existing state-of-the-art methods.

[1]  Hua Su,et al.  Subsurface temperature estimation from remote sensing data using a clustering-neural network method , 2019, Remote Sensing of Environment.

[2]  Jun Liu,et al.  Variational-Based Mixed Noise Removal With CNN Deep Learning Regularization , 2018, IEEE Transactions on Image Processing.

[3]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[4]  M. Deo,et al.  Basin-Scale Prediction of Sea Surface Temperature with Artificial Neural Networks , 2018, 2018 OCEANS - MTS/IEEE Kobe Techno-Oceans (OTO).

[5]  Yuan Feng,et al.  A Convolutional Neural Network Using Surface Data to Predict Subsurface Temperatures in the Pacific Ocean , 2019, IEEE Access.

[6]  M. C. Deo,et al.  Prediction of daily sea surface temperature using efficient neural networks , 2017, Ocean Dynamics.

[7]  Sheng Chen,et al.  Grey-box radial basis function modelling , 2011, Neurocomputing.

[8]  Anuj Karpatne,et al.  Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modeling , 2017, ArXiv.

[9]  Koh Hosoda,et al.  Temporal Scale of Sea Surface Temperature Fronts Revealed by Microwave Observations , 2012, IEEE Geoscience and Remote Sensing Letters.

[10]  W. Timothy Liu,et al.  Estimation of Subsurface Temperature Anomaly in the North Atlantic Using a Self-Organizing Map Neural Network , 2012 .

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  Chao Zeng,et al.  Missing Data Reconstruction in Remote Sensing Image With a Unified Spatial–Temporal–Spectral Deep Convolutional Neural Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Xiangtao Zheng,et al.  Spectral–Spatial Attention Network for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Biao Hou,et al.  CNN-Based Polarimetric Decomposition Feature Selection for PolSAR Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Antonio J. Busalacchi,et al.  The Tropical Ocean‐Global Atmosphere observing system: A decade of progress , 1998 .

[16]  Renguang Wu,et al.  Surface Wind Speed-SST Relationship During the Passage of Typhoons Over the South China Sea , 2012, IEEE Geoscience and Remote Sensing Letters.

[17]  Seyed Majid Azimi,et al.  Road Segmentation in SAR Satellite Images With Deep Fully Convolutional Neural Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[18]  Tie-Yan Liu,et al.  LightRNN: Memory and Computation-Efficient Recurrent Neural Networks , 2016, NIPS.

[19]  Junyu Dong,et al.  Prediction of Sea Surface Temperature Using Long Short-Term Memory , 2017, IEEE Geoscience and Remote Sensing Letters.

[20]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[21]  Liu Yang,et al.  Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations , 2018, SIAM J. Sci. Comput..

[22]  James Glass,et al.  Deep Learning for Database Mapping and Asking Clarification Questions in Dialogue Systems , 2019, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[23]  Liangfu Chen,et al.  Deep Learning Architecture for Estimating Hourly Ground-Level PM2.5 Using Satellite Remote Sensing , 2019, IEEE Geoscience and Remote Sensing Letters.

[24]  Lei Guo,et al.  When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Wei Zhao,et al.  Evaluation of Sea Surface Temperature From the HY-2 Scanning Microwave Radiometer , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Li Wei,et al.  Prediction of Sea Surface Temperature in the South China Sea by Artificial Neural Networks , 2020, IEEE Geoscience and Remote Sensing Letters.

[27]  Qiang Zheng,et al.  Physics-informed semantic inpainting: Application to geostatistical modeling , 2020, J. Comput. Phys..

[28]  Junyu Dong,et al.  A CFCC-LSTM Model for Sea Surface Temperature Prediction , 2018, IEEE Geoscience and Remote Sensing Letters.

[29]  Qian Du,et al.  GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[30]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[31]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Geoffrey E. Hinton,et al.  Application of Deep Belief Networks for Natural Language Understanding , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[34]  Remy Baraille,et al.  The HYCOM (HYbrid Coordinate Ocean Model) data assimilative system , 2007 .

[35]  Xiao Xiang Zhu,et al.  Deep Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Mehmet Ogut,et al.  A Deep Learning Approach for Microwave and Millimeter-Wave Radiometer Calibration , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Xiangchen Meng,et al.  Estimating Land and Sea Surface Temperature From Cross-Calibrated Chinese Gaofen-5 Thermal Infrared Data Using Split-Window Algorithm , 2020, IEEE Geoscience and Remote Sensing Letters.

[38]  Vishal M. Patel,et al.  Learning Deep Features for One-Class Classification , 2018, IEEE Transactions on Image Processing.

[39]  Yang Wang,et al.  Reconstructing the Subsurface Temperature Field by Using Sea Surface Data Through Self-Organizing Map Method , 2018, IEEE Geoscience and Remote Sensing Letters.

[40]  Keith Haines,et al.  Data assimilation in ocean models , 1996 .

[41]  Kun Zhang,et al.  Prediction of 3-D Ocean Temperature by Multilayer Convolutional LSTM , 2020, IEEE Geoscience and Remote Sensing Letters.

[42]  Jean Tournadre,et al.  A Multivariate Regression Approach to Adjust AATSR Sea Surface Temperature to In Situ Measurements , 2009, IEEE Geoscience and Remote Sensing Letters.

[43]  Qingshan Liu,et al.  Learning Multiscale Deep Features for High-Resolution Satellite Image Scene Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Richard F. Gunst,et al.  Applied Regression Analysis , 1999, Technometrics.

[45]  H. Burchard,et al.  A generic length-scale equation for geophysical turbulence models , 2003 .

[46]  Xuelong Li,et al.  Scene Classification With Recurrent Attention of VHR Remote Sensing Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Anuj Karpatne,et al.  Physics Guided RNNs for Modeling Dynamical Systems: A Case Study in Simulating Lake Temperature Profiles , 2018, SDM.

[48]  Xia Hong,et al.  A New RBF Neural Network With Boundary Value Constraints , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[49]  J. O'Brien,et al.  Variational data assimilation and parameter estimation in an equatorial Pacific ocean model , 1991 .

[50]  Andrew J. Davison,et al.  End-To-End Multi-Task Learning With Attention , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Changsheng Chen,et al.  An Unstructured Grid, Finite-Volume Coastal Ocean Model (FVCOM) System , 2006 .

[52]  Jian-Huang Lai,et al.  Deep Ranking for Person Re-Identification via Joint Representation Learning , 2015, IEEE Transactions on Image Processing.