Neural network emulations for complex multidimensional geophysical mappings: Applications of neural network techniques to atmospheric and oceanic satellite retrievals and numerical modeling

A group of geophysical applications, which from the mathematical point of view, can be formulated as complex, multidimensional, nonlinear mappings and which in terms of the neural network (NN) technique, utilize a particular type of NN, the multilayer perceptron (MLP), is reviewed in this paper. This type of NN application covers the majority of NN applications developed in geosciences like satellite remote sensing, meteorology, oceanography, numerical weather prediction, and climate studies. The major properties of the mappings and MLP NNs are formulated and discussed. Three particular groups of NN applications are presented in this paper as illustrations: atmospheric and oceanic satellite remote sensing applications, NN emulations of model physics for developing atmospheric and oceanic hybrid numerical models, and NN emulations of the dependencies between model variables for application in data assimilation systems.

[1]  Jia-Yu Yang,et al.  Optimal linear combination of neural networks to model thermally induced error of machine tools , 2009, Int. J. Model. Identif. Control..

[2]  Lei Meng,et al.  Neural network retrieval of ocean surface parameters from SSM/I data , 2007 .

[3]  Vladimir M. Krasnopolsky,et al.  Ensemble of Neural Network Emulations for Climate Model Physics: The Impact on Climate Simulations , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[4]  Vladimir M. Krasnopolsky.  Reducing Uncertainties in Neural Network Jacobians and Improving Accuracy of Neural Network Emulations with NN Ensemble Approaches , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[5]  Dimitri P. Solomatine.  Data‐Driven Modeling and Computational Intelligence Methods in Hydrology , 2006 .

[6]  V. Vapnik.  Estimation of Dependences Based on Empirical Data , 2006 .

[7]  Julio J. Valdés,et al.  Time dependent neural network models for detecting changes of state in complex processes: Applications in earth sciences and astronomy , 2006, Neural Networks.

[8]  Sylvie Thiria,et al.  Use of a neuro-variational inversion for retrieving oceanic and atmospheric constituents from satellite ocean colour sensor: Application to absorbing aerosols , 2006, Neural Networks.

[9]  Vladimir M. Krasnopolsky,et al.  Complex hybrid models combining deterministic and machine learning components for numerical climate modeling and weather prediction , 2006, Neural Networks.

[10]  William W. Hsieh,et al.  Neural network forecasts of the tropical Pacific sea surface temperatures , 2006, Neural Networks.

[11]  A. Pasini,et al.  Neural network modelling for the analysis of forcings/temperatures relationships at different scales in the climate system , 2006 .

[12]  Vladimir M. Krasnopolsky,et al.  A new synergetic paradigm in environmental numerical modeling: Hybrid models combining deterministic and machine learning components , 2006 .

[13]  V. Krasnopolsky,et al.  Robustness of the NN Approach to emulating atmospheric long wave radiation in complex climate models , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[14]  Paulin Coulibaly,et al.  Temporal neural networks for downscaling climate variability and extremes , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[15]  Dimitri P. Solomatine,et al.  Machine learning in soil classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[16]  F. Chevallier.  Comments on “New Approach to Calculation of Atmospheric Model Physics: Accurate and Fast Neural Network Emulation of Longwave Radiation in a Climate Model” , 2005 .

[17]  Caren Marzban,et al.  Improving Tropical Cyclogenesis Statistical Model Forecasts through the Application of a Neural Network Classifier , 2005 .

[18]  William W. Hsieh,et al.  Hybrid coupled modeling of the tropical Pacific using neural networks , 2005 .

[19]  D. Chalikov,et al.  New Approach to Calculation of Atmospheric Model Physics: Accurate and Fast Neural Network Emulation of Longwave Radiation in a Climate Model , 2005 .

[20]  Vladimir M. Krasnopolsky,et al.  Neural network approximations for nonlinear interactions in wind wave spectra: direct mapping for wind seas in deep water , 2005 .

[21]  Roland K. Price,et al.  Data-driven modelling in the context of sediment transport , 2005 .

[22]  Filipe Aires,et al.  Neural Network Uncertainty Assessment Using Bayesian Statistics: A Remote Sensing Application , 2004, Neural Computation.

[23]  Filipe Aires,et al.  Neural network uncertainty assessment using Bayesian statistics with application to remote sensing: 3. Network Jacobians , 2004 .

[24]  Gilles Larnicol,et al.  Combining Argo and remote-sensing data to estimate the ocean three-dimensional temperature fields—a first approach based on simulated observations , 2004 .

[25]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[26]  William W. Hsieh,et al.  Nonlinear multivariate and time series analysis by neural network methods , 2004 .

[27]  Eric P. Chassignet,et al.  North Atlantic Simulations with the Hybrid Coordinate Ocean Model (HYCOM): Impact of the Vertical Coordinate Choice, Reference Pressure, and Thermobaricity , 2003 .

[28]  John P. Burrows,et al.  Ozone profile retrieval from Global Ozone Monitoring Experiment (GOME) data using a neural network approach (Neural Network Ozone Retrieval System (NNORSY)) , 2003 .

[29]  Vladimir M. Krasnopolsky,et al.  Some neural network applications in environmental sciences. Part II: advancing computational efficiency of environmental numerical models , 2003, Neural Networks.

[30]  Helmut Schiller,et al.  Some neural network applications in environmental sciences. Part I: forward and inverse problems in geophysical remote measurements , 2003, Neural Networks.

[31]  William W. Hsieh,et al.  ENSO simulation and prediction in a hybrid coupled model with data assimilation , 2003 .

[32]  David P. Edwards,et al.  An updated parameterization for infrared emission and absorption by water vapor in the National Center for Atmospheric Research Community Atmosphere Model , 2002 .

[33]  Filipe Aires,et al.  Remote sensing from the infrared atmospheric sounding interferometer instrument 2. Simultaneous retrieval of temperature, water vapor, and ozone atmospheric profiles , 2002 .

[34]  Vladimir M. Krasnopolsky,et al.  A neural network technique to improve computational efficiency of numerical oceanic models , 2002 .

[35]  Ian T. Nabney,et al.  Netlab: Algorithms for Pattern Recognition , 2002 .

[36]  Rainer Bleck,et al.  An oceanic general circulation model framed in hybrid isopycnic-Cartesian coordinates , 2002 .

[37]  William D. Collins,et al.  Parameterization of Generalized Cloud Overlap for Radiative Calculations in General Circulation Models , 2001 .

[38]  I. Nabney,et al.  Improved neural network scatterometer forward models , 2001 .

[39]  Jean-François Mahfouf,et al.  Evaluation of the Jacobians of Infrared Radiation Models for Variational Data Assimilation , 2001 .

[40]  Vladimir M. Krasnopolsky,et al.  Domain check for input to NN emulating an inverse model , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[41]  Xin-Zhong Liang,et al.  A Thermal Infrared Radiation Parameterization for Atmospheric Studies , 2001 .

[42]  Leszek Plaskota,et al.  Complexity of Neural Network Approximation with Limited Information: A Worst Case Approach , 2001, J. Complex..

[43]  William W. Hsieh,et al.  Nonlinear principal component analysis by neural networks , 2001 .

[44]  Vladimir M. Krasnopolsky,et al.  A Neural Network Multiparameter Algorithm for SSM/I Ocean Retrievals , 2000 .

[45]  P. Cilliers.  What Can We Learn From a Theory of Complexity , 2000 .

[46]  Vladimir M. Krasnopolsky.  Application of neural networks for efficient calculation of sea water density or salinity from the UNESCO equation of state , 2000 .

[47]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[48]  Frédéric Chevallier,et al.  Use of a neural‐network‐based long‐wave radiative‐transfer scheme in the ECMWF atmospheric model , 2000 .

[49]  John Derber,et al.  The use of TOVS level‐1b radiances in the NCEP SSI analysis system , 2000 .

[50]  P. Mielke,et al.  Statistical Mining and Data Visualization in Atmospheric Sciences , 2000, Springer US.

[51]  V. M. Krasnopolsky,et al.  A multi-parameter empirical ocean algorithm for SSM/I retrievals , 1999 .

[52]  Noëlle A. Scott,et al.  The "weight smoothing" regularization of MLP for Jacobian stabilization , 1999, IEEE Trans. Neural Networks.

[53]  Yoram Reich,et al.  Ensemble modelling or selecting the best model: Many could be better than one , 1999, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[54]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[55]  P. Cilliers,et al.  Complexity and post-modernism: understanding complex systems , 1999 .

[56]  D. Obradovic,et al.  Combining Artificial Neural Nets , 1999, Perspectives in Neural Computing.

[57]  Roland Doerffer,et al.  Neural network for emulation of an inverse model: operational derivation of Case II water properties from MERIS data , 1999 .

[58]  Yoram Reich,et al.  Ensemble Modeling or Selecting the Best Model: Many Could Be Better than One , 1999 .

[59]  Alain Chedin,et al.  A Neural Network Approach for a Fast and Accurate Computation of a Longwave Radiative Budget , 1998 .

[60]  William W. Hsieh,et al.  Applying Neural Network Models to Prediction and Data Analysis in Meteorology and Oceanography. , 1998 .

[61]  John Derber,et al.  The Use of TOVS Cloud-Cleared Radiances in the NCEP SSI Analysis System , 1998 .

[62]  M. W Gardner,et al.  Artificial neural networks (the multilayer perceptron)—a review of applications in the atmospheric sciences , 1998 .

[63]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[64]  R. DeVore,et al.  Nonlinear approximation , 1998, Acta Numerica.

[65]  A. Strahler,et al.  Forward and inverse modelling of canopy directional reflectance using a neural network , 1998 .

[66]  Paul Cilliers,et al.  Complexity and Postmodernism , 1998 .

[67]  Thomas Ruppert,et al.  A new PMD cloud-recognition algorithm for GOME , 1998 .

[68]  Vladimir Cherkassky,et al.  The Nature Of Statistical Learning Theory , 1997, IEEE Trans. Neural Networks.

[69]  Gilles Pagès,et al.  Approximations of Functions by a Multilayer Perceptron: a New Approach , 1997, Neural Networks.

[70]  Sherif Hashem,et al.  Optimal Linear Combinations of Neural Networks , 1997, Neural Networks.

[71]  L. Phalippou,et al.  Variational Inversion of the SSM/I Observations during the ASTEX Campaign , 1997 .

[72]  F. Wentz.  A well‐calibrated ocean algorithm for special sensor microwave / imager , 1997 .

[73]  David L. T. Anderson,et al.  Scatterometer data interpretation: Estimation and validation of the transfer function CMOD4 , 1997 .

[74]  P. Atkinson,et al.  Introduction Neural networks in remote sensing , 1997 .

[75]  Jun-Ho Oh,et al.  Hybrid Learning of Mapping and its Jacobian in Multilayer Neural Networks , 1996, Neural Computation.

[76]  Nathan Intrator,et al.  Optimal ensemble averaging of neural networks , 1997 .

[77]  F. Waismann.  The Logical Calculus , 1997 .

[78]  Seth Lloyd,et al.  Information measures, effective complexity, and total information , 1996, Complex..

[79]  Caren Marzban,et al.  A Neural Network for Tornado Prediction Based on Doppler Radar-Derived Attributes , 1996 .

[80]  L. Phalippou,et al.  Variational retrieval of humidity profile, wind speed and cloud liquid‐water path with the SSM/I: Potential for numerical weather prediction , 1996 .

[81]  David H. Staelin,et al.  Passive microwave relative humidity retrievals using feedforward neural networks , 1995, IEEE Trans. Geosci. Remote. Sens..

[82]  Jenq-Neng Hwang,et al.  Solving inverse problems by Bayesian iterative inversion of a forward model with applications to parameter mapping using SMMR remote sensing data , 1995, IEEE Trans. Geosci. Remote. Sens..

[83]  Jude W. Shavlik,et al.  Combining the Predictions of Multiple Classifiers: Using Competitive Learning to Initialize Neural Networks , 1995, IJCAI.

[84]  Hong Chen,et al.  Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems , 1995, IEEE Trans. Neural Networks.

[85]  V. Krasnopolsky,et al.  A neural network as a nonlinear transfer function model for retrieving surface wind speeds from the special sensor microwave imager , 1995 .

[86]  Hong Chen,et al.  Approximation capability to functions of several variables, nonlinear functionals, and operators by radial basis function neural networks , 1993, IEEE Trans. Neural Networks.

[87]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[88]  Geoffrey E. Hinton,et al.  Bayesian Learning for Neural Networks , 1995 .

[89]  F. Weng,et al.  Retrieval of cloud liquid water using the special sensor microwave imager (SSM/I) , 1994 .

[90]  Grant W. Petty,et al.  The response of the SSM/I to the marine environment. Part 2: A parameterization of the effect of the sea surface slope distribution on emission and reflection , 1994 .

[91]  Andreas S. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past , 1994 .

[92]  R. Parker.  Geophysical Inverse Theory , 1994 .

[93]  D. M. Titterington,et al.  Neural Networks: A Review from a Statistical Perspective , 1994 .

[94]  C. T. Butler,et al.  Ocean surface wind retrievals from special sensor microwave imager data with neural networks , 1994 .

[95]  S. Thiria,et al.  A neural network approach for modeling nonlinear transfer functions: Application for wind retrieval from spaceborne scatterometer data , 1993 .

[96]  James A. Smith,et al.  LAI inversion using a back-propagation neural network trained with a multiple scattering model , 1993, IEEE Trans. Geosci. Remote. Sens..

[97]  Andreas S. Weigend,et al.  The Future of Time Series: Learning and Understanding , 1993 .

[98]  Andrew R. Barron,et al.  Universal approximation bounds for superpositions of a sigmoidal function , 1993, IEEE Trans. Inf. Theory.

[99]  A. Mcnally,et al.  Direct use of satellite sounding radiances in numerical weather prediction , 1993 .

[100]  Kurt Hornik,et al.  Some new results on neural network approximation , 1993, Neural Networks.

[101]  Grant W. Petty,et al.  The response of the SSM/I to the marine environment. I - An analytic model for the atmospheric component of observed brightness temperatures , 1992 .

[102]  Etienne Barnard,et al.  Avoiding false local minima by proper initialization of connections , 1992, IEEE Trans. Neural Networks.

[103]  Mark A. Goodberlet,et al.  Improved retrievals from the DMSP wind speed algorithm under adverse weather conditions , 1992, IEEE Trans. Geosci. Remote. Sens..

[104]  John Derber,et al.  The National Meteorological Center's spectral-statistical interpolation analysis system , 1992 .

[105]  Kamal Sarabandi,et al.  Application of an Artificial Neural Network in Canopy Scattering Inversion , 1992, [Proceedings] IGARSS '92 International Geoscience and Remote Sensing Symposium.

[106]  David J. C. MacKay,et al.  A Practical Bayesian Framework for Backpropagation Networks , 1992, Neural Computation.

[107]  Pierre Cardaliaguet,et al.  Approximation of a function and its derivative with a neural network , 1992, Neural Networks.

[108]  Anastasios A. Tsonis,et al.  Nonlinear Prediction, Chaos, and Noise. , 1992 .

[109]  Robert J. Marks,et al.  Inversion Of Snow Parameters From Passive Microwave Remote Sensing Measurements By A Neural Network Trained With A Multiple Scattering Model , 1991, [Proceedings] IGARSS'91 Remote Sensing: Global Monitoring for Earth Management.

[110]  George L. Mellor,et al.  A Gulf Stream model and an altimetry assimilation scheme , 1991 .

[111]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[112]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[113]  Kurt Hornik,et al.  Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks , 1990, Neural Networks.

[114]  S. A. Snyder,et al.  Determination of oceanic total precipitable water from the SSM/I , 1990 .

[115]  Bernard Widrow,et al.  Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[116]  Thomas Jackson,et al.  Neural Computing - An Introduction , 1990 .

[117]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[118]  R. Lippmann.  Pattern classification using neural networks , 1989, IEEE Communications Magazine.

[119]  M. A. Goodberlet,et al.  Remote sensing of ocean surface winds with the special sensor microwave/imager , 1989 .

[120]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[121]  O. G. Selfridge,et al.  Pandemonium: a paradigm for learning , 1988 .

[122]  I. Jolliffe.  Principal Component Analysis , 2005 .

[123]  Andrew C. Lorenc,et al.  Analysis methods for numerical weather prediction , 1986 .

[124]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[125]  K. Hasselmann,et al.  Computations and Parameterizations of the Nonlinear Energy Transfer in a Gravity-Wave Specturm. Part II: Parameterizations of the Nonlinear Energy Transfer for Application in Wave Models , 1985 .

[126]  S. Hasselmann,et al.  Computations and Parameterizations of the Nonlinear Energy Transfer in a Gravity-Wave Spectrum. Part I: A New Method for Efficient Computations of the Exact Nonlinear Transfer Integral , 1985 .

[127]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[128]  T. Kohonen.  Self-organized formation of topographically correct feature maps , 1982 .

[129]  V. Kukulin,et al.  A stochastic variational method for few-body systems , 1977 .

[130]  Julius Chang,et al.  General circulation models of the atmosphere , 1977 .

[131]  David L. Williamson,et al.  A Description of the NCAR Global Circulation Models , 1977 .

[132]  Nils J. Nilsson,et al.  Learning Machines: Foundations of Trainable Pattern-Classifying Systems , 1965 .

[133]  C.,et al.  Analysis methods for numerical weather prediction , 2022 .