Active Learning with Convolutional Gaussian Neural Processes for Environmental Sensor Placement

Deploying environmental measurement stations can be a costly and time-consuming procedure, especially in remote regions that are difficult to access, such as Antarctica. Therefore, it is crucial that sensors are placed as efficiently as possible, maximising the informativeness of their measurements. This can be tackled by fitting a probabilistic model to existing data and identifying placements that would maximally reduce the model’s uncertainty. The models most widely used for this purpose are Gaussian processes (GPs; Williams and Rasmussen, 2006). However, designing a GP covariance which captures the complex behaviour of non-stationary spatiotemporal data is a difficult task. Further, the computational cost of GPs makes them challenging to scale to large environmental datasets. In this work, we explore using a convolutional Gaussian neural process (ConvGNP; Bruinsma et al., 2021; Markou et al., 2022) to address these issues. A ConvGNP is a meta-learning model that uses neural networks to parameterise a GP predictive. Our model is data-driven, flexible, efficient, and permits multiple input predictors of gridded or scattered modalities. Using simulated surface air temperature fields over Antarctica as ground truth, we show that a ConvGNP significantly outperforms a non-stationary GP baseline in terms of predictive performance. We then use the ConvGNP in an Antarctic sensor placement toy experiment, yielding promising results.

[1]  G. Carmichael,et al.  The future of Earth system prediction: Advances in model-data fusion , 2022, Science advances.

[2]  Richard E. Turner,et al.  Practical Conditional Neural Processes Via Tractable Dependent Predictions , 2022, ICLR.

[3]  Richard E. Turner,et al.  Convolutional conditional neural processes for local climate downscaling , 2021, Geoscientific Model Development.

[4]  Gordon S. Blair,et al.  Digital twins of the natural environment , 2021, Patterns.

[5]  Richard E. Turner,et al.  Efficient Gaussian Neural Processes for Regression , 2021, ArXiv.

[6]  Richard E. Turner,et al.  The Gaussian Neural Process , 2021, ArXiv.

[7]  Richard E. Turner,et al.  Meta-Learning Stationary Stochastic Process Prediction with Convolutional Neural Processes , 2020, NeurIPS.

[8]  J. Thepaut,et al.  The ERA5 global reanalysis , 2020, Quarterly Journal of the Royal Meteorological Society.

[9]  Richard E. Turner,et al.  Convolutional Conditional Neural Processes , 2019, ICLR.

[10]  Ralph C. Smith,et al.  Sequential optimal positioning of mobile sensors using mutual information , 2019, Stat. Anal. Data Min..

[11]  Yee Whye Teh,et al.  Neural Processes , 2018, ArXiv.

[12]  Yee Whye Teh,et al.  Conditional Neural Processes , 2018, ICML.

[13]  Vincent Dumoulin,et al.  Deconvolution and Checkerboard Artifacts , 2016 .

[14]  L. Vogt Statistics For Spatial Data , 2016 .

[15]  Nando de Freitas,et al.  Taking the Human Out of the Loop: A Review of Bayesian Optimization , 2016, Proceedings of the IEEE.

[16]  Andreas Krause,et al.  Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies , 2008, J. Mach. Learn. Res..

[17]  David J. C. MacKay,et al.  Information-Based Objective Functions for Active Data Selection , 1992, Neural Computation.

[18]  D. Lindley On a Measure of the Information Provided by an Experiment , 1956 .