Deep Gaussian processes for biogeophysical parameter retrieval and model inversion

Parameter retrieval and model inversion are key problems in remote sensing and Earth observation. Currently, different approximations exist: a direct, yet costly, inversion of radiative transfer models (RTMs); the statistical inversion with in situ data that often results in problems with extrapolation outside the study area; and the most widely adopted hybrid modeling by which statistical models, mostly nonlinear and non-parametric machine learning algorithms, are applied to invert RTM simulations. We will focus on the latter. Among the different existing algorithms, in the last decade kernel based methods, and Gaussian Processes (GPs) in particular, have provided useful and informative solutions to such RTM inversion problems. This is in large part due to the confidence intervals they provide, and their predictive accuracy. However, RTMs are very complex, highly nonlinear, and typically hierarchical models, so that very often a single (shallow) GP model cannot capture complex feature relations for inversion. This motivates the use of deeper hierarchical architectures, while still preserving the desirable properties of GPs. This paper introduces the use of deep Gaussian Processes (DGPs) for bio-geo-physical model inversion. Unlike shallow GP models, DGPs account for complicated (modular, hierarchical) processes, provide an efficient solution that scales well to big datasets, and improve prediction accuracy over their single layer counterpart. In the experimental section, we provide empirical evidence of performance for the estimation of surface temperature and dew point temperature from infrared sounding data, as well as for the prediction of chlorophyll content, inorganic suspended matter, and coloured dissolved matter from multispectral data acquired by the Sentinel-3 OLCI sensor. The presented methodology allows for more expressive forms of GPs in big remote sensing model inversion problems.

[1]  Rafael Molina,et al.  Remote Sensing Image Classification With Large-Scale Gaussian Processes , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[2]  David M. Blei,et al.  Variational Inference: A Review for Statisticians , 2016, ArXiv.

[3]  Gustavo Camps-Valls,et al.  Gaussian processes uncertainty estimates in experimental Sentinel-2 LAI and leaf chlorophyll content retrieval , 2013 .

[4]  William L. Smith,et al.  Vertical Resolution and Accuracy of Atmospheric Infrared Sounding Spectrometers. , 1992 .

[5]  Peter Regner,et al.  Ocean Colour Remote Sensing of Extreme Case-2 Waters , 2016 .

[6]  R. Bukata,et al.  Optical Properties and Remote Sensing of Inland and Coastal Waters , 1995 .

[7]  Neil D. Lawrence,et al.  Gaussian Processes for Big Data , 2013, UAI.

[8]  Jan G. P. W. Clevers,et al.  Experimental Sentinel-2 LAI estimation using parametric, non-parametric and physical retrieval methods - A comparison , 2015 .

[9]  Markus Reichstein,et al.  Predicting carbon dioxide and energy fluxes across global FLUXNET sites with regression algorithms , 2016 .

[10]  Filipe Aires,et al.  A Regularized Neural Net Approach for Retrieval of Atmospheric and Surface Temperatures with the Iasi Instrument , 2013 .

[11]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[12]  Mohammad Emtiyaz Khan,et al.  Scalable Training of Inference Networks for Gaussian-Process Models , 2019, ICML.

[13]  Richard J. Murphy,et al.  Evaluating the performance of a new classifier – the GP-OAD: A comparison with existing methods for classifying rock type and mineralogy from hyperspectral imagery , 2014 .

[14]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[15]  Zoubin Ghahramani,et al.  Sparse Gaussian Processes using Pseudo-inputs , 2005, NIPS.

[16]  Luis Alonso,et al.  Retrieval of Vegetation Biophysical Parameters Using Gaussian Process Techniques , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Clive D Rodgers,et al.  Inverse Methods for Atmospheric Sounding: Theory and Practice , 2000 .

[18]  Luis Guanter,et al.  Nonlinear Statistical Retrieval of Atmospheric Profiles From MetOp-IASI and MTG-IRS Infrared Sounding Data , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[19]  R. Doerffer,et al.  The OLCI Neural Network Swarm (ONNS): A Bio-Geo-Optical Algorithm for Open Ocean and Coastal Waters , 2017, Front. Mar. Sci..

[20]  William J. Blackwell,et al.  A neural-network technique for the retrieval of atmospheric temperature and moisture profiles from high spectral resolution sounding data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Philip B. Holden,et al.  Spatial probabilistic calibration of a high-resolution Amundsen Sea Embayment ice sheet model with satellite altimeter data , 2020 .

[22]  D. Siméoni,et al.  Infrared atmospheric sounding interferometer , 1997 .

[23]  L. Prieur,et al.  Analysis of variations in ocean color1 , 1977 .

[24]  Luca Martino,et al.  Physics-aware Gaussian processes in remote sensing , 2018, Appl. Soft Comput..

[25]  R. Doerffer,et al.  The MERIS Case 2 water algorithm , 2007 .

[26]  José Luis Rojo-Álvarez,et al.  Digital Signal Processing with Kernel Methods , 2018 .

[27]  Neil D. Lawrence,et al.  Bayesian Gaussian Process Latent Variable Model , 2010, AISTATS.

[28]  Kari Kallio,et al.  Optical properties of Finnish lakes estimated with simple bio-optical models and water quality monitoring data , 2006 .

[29]  Andreas C. Damianou,et al.  Deep Gaussian processes and variational propagation of uncertainty , 2015 .

[30]  José F. Moreno,et al.  Spectral band selection for vegetation properties retrieval using Gaussian processes regression , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[31]  Atul K. Jain,et al.  Compensatory water effects link yearly global land CO2 sink changes to temperature , 2017, Nature.

[32]  Valero Laparra,et al.  Statistical retrieval of atmospheric profiles with deep convolutional neural networks , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[33]  Valero Laparra,et al.  Dimensionality Reduction via Regression in Hyperspectral Imagery , 2015, IEEE Journal of Selected Topics in Signal Processing.

[34]  Shunlin Liang,et al.  Advances in Land Remote Sensing : System, Modeling, Inversion and Application , 2019 .

[35]  Gustau Camps-Valls,et al.  Hyperspectral dimensionality reduction for biophysical variable statistical retrieval , 2017 .