The Rational SPDE Approach for Gaussian Random Fields With General Smoothness

Abstract A popular approach for modeling and inference in spatial statistics is to represent Gaussian random fields as solutions to stochastic partial differential equations (SPDEs) of the form , where is Gaussian white noise, L is a second-order differential operator, and is a parameter that determines the smoothness of u. However, this approach has been limited to the case , which excludes several important models and makes it necessary to keep β fixed during inference. We propose a new method, the rational SPDE approach, which in spatial dimension is applicable for any , and thus remedies the mentioned limitation. The presented scheme combines a finite element discretization with a rational approximation of the function to approximate u. For the resulting approximation, an explicit rate of convergence to u in mean-square sense is derived. Furthermore, we show that our method has the same computational benefits as in the restricted case . Several numerical experiments and a statistical application are used to illustrate the accuracy of the method, and to show that it facilitates likelihood-based inference for all model parameters including β. Supplementary materials for this article are available online.

[1]  Ricardo H. Nochetto,et al.  A PDE Approach to Fractional Diffusion in General Domains: A Priori Error Analysis , 2013, Found. Comput. Math..

[2]  J. P. Roop Computational aspects of FEM approximation of fractional advection dispersion equations on bounded domains in R 2 , 2006 .

[3]  Dorit Hammerling,et al.  A Case Study Competition Among Methods for Analyzing Large Spatial Data , 2017, Journal of Agricultural, Biological and Environmental Statistics.

[4]  Jianhua Z. Huang,et al.  Covariance approximation for large multivariate spatial data sets with an application to multiple climate model errors , 2011, 1203.0133.

[5]  Haavard Rue,et al.  Does non-stationary spatial data always require non-stationary random fields? , 2014 .

[6]  José Carlos Goulart de Siqueira,et al.  Differential Equations , 1919, Nature.

[7]  Ivan P. Gavrilyuk,et al.  Hierarchical Tensor-Product Approximation to the Inverse and Related Operators for High-Dimensional Elliptic Problems , 2004, Computing.

[8]  Hao Zhang Inconsistent Estimation and Asymptotically Equal Interpolations in Model-Based Geostatistics , 2004 .

[9]  Leonhard Held,et al.  Gaussian Markov Random Fields: Theory and Applications , 2005 .

[10]  L. Caffarelli,et al.  An Extension Problem Related to the Fractional Laplacian , 2006, math/0608640.

[11]  David Bolin,et al.  Numerical solution of fractional elliptic stochastic PDEs with spatial white noise , 2017, IMA Journal of Numerical Analysis.

[12]  H. Rue,et al.  An explicit link between Gaussian fields and Gaussian Markov random fields: the stochastic partial differential equation approach , 2011 .

[13]  D. Bolin,et al.  Geostatistical Modelling Using Non‐Gaussian Matérn Fields , 2015 .

[14]  Harish Sankaranarayanan,et al.  Higher order Grünwald approximations of fractional derivatives and fractional powers of operators , 2014 .

[15]  Ju A Rozanov MARKOV RANDOM FIELDS AND STOCHASTIC PARTIAL DIFFERENTIAL EQUATIONS , 1977 .

[16]  H. Rue,et al.  In order to make spatial statistics computationally feasible, we need to forget about the covariance function , 2012 .

[17]  Finn Lindgren,et al.  Bayesian Spatial Modelling with R-INLA , 2015 .

[18]  P. Grisvard Elliptic Problems in Nonsmooth Domains , 1985 .

[19]  David Bolin,et al.  A comparison between Markov approximations and other methods for large spatial data sets , 2013, Comput. Stat. Data Anal..

[20]  Simo Sarkka,et al.  ST ] 8 O ct 2 01 4 Sparse approximations of fractional Matérn fields October 9 , 2014 , 2014 .

[21]  Joseph E. Pasciak,et al.  The approximation of parabolic equations involving fractional powers of elliptic operators , 2016, J. Comput. Appl. Math..

[22]  Peter Congdon,et al.  Gaussian Markov Random Fields: Theory and Applications , 2007 .

[23]  Michael L. Stein,et al.  Interpolation of spatial data , 1999 .

[24]  J. M. Lilly,et al.  Fractional Brownian motion, the Matern process, and stochastic modeling of turbulent dispersion , 2016 .

[25]  Sudipto Banerjee,et al.  Hierarchical Nearest-Neighbor Gaussian Process Models for Large Geostatistical Datasets , 2014, Journal of the American Statistical Association.

[26]  A. Gelfand,et al.  Gaussian predictive process models for large spatial data sets , 2008, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[27]  E. Davies,et al.  Spectral Theory and Differential Operators: Index , 1995 .

[28]  N. Cressie,et al.  Fixed rank kriging for very large spatial data sets , 2008 .

[29]  Jianhua Z. Huang,et al.  A full scale approximation of covariance functions for large spatial data sets , 2012 .

[30]  G. Strang,et al.  An Analysis of the Finite Element Method , 1974 .

[31]  Marc G. Genton,et al.  Cross-Covariance Functions for Multivariate Geostatistics , 2015, 1507.08017.

[32]  D. Nychka,et al.  A Multiresolution Gaussian Process Model for the Analysis of Large Spatial Datasets , 2015 .

[33]  Haavard Rue,et al.  An approximate fractional Gaussian noise model with computational cost , 2017 .

[34]  Richard G. Jones,et al.  A Regional Climate Change Assessment Program for North America , 2009 .

[35]  Joseph E. Pasciak,et al.  Numerical approximation of fractional powers of elliptic operators , 2013, Math. Comput..

[36]  Haavard Rue,et al.  Spatial modelling with R-INLA: A review , 2018, 1802.06350.

[37]  William Rundell,et al.  Variational formulation of problems involving fractional order differential operators , 2013, Math. Comput..

[38]  H. Rue,et al.  Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations , 2009 .

[39]  Andrew M. Stuart,et al.  Inverse problems: A Bayesian perspective , 2010, Acta Numerica.

[40]  S. Martino Approximate Bayesian Inference for Latent Gaussian Models , 2007 .

[41]  Yavor Vutov,et al.  Optimal solvers for linear systems with fractional powers of sparse SPD matrices , 2016, Numer. Linear Algebra Appl..

[42]  Anthony N. Pettitt,et al.  Comment on the paper: ‘Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations’ by Rue, H. Martino, S. and Chopin, N. , 2009 .

[43]  Ivan P. Gavrilyuk An algorithmic representation of fractional powers of positive operators , 1996 .

[44]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[45]  D. Bolin Spatial Matérn Fields Driven by Non‐Gaussian Noise , 2014 .

[46]  F. Lindgren,et al.  Exploring a New Class of Non-stationary Spatial Gaussian Random Fields with Varying Local Anisotropy , 2013, 1304.6949.

[47]  Márcia Helena Barbian,et al.  Spatial subsemble estimator for large geostatistical data , 2017 .

[48]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[49]  F. Lindgren,et al.  Spatial models generated by nested stochastic partial differential equations, with an application to global ozone mapping , 2011, 1104.3436.

[50]  F. Lutscher Spatial Variation , 2019, Interdisciplinary Applied Mathematics.

[51]  David E. Edmunds,et al.  Spectral Theory and Differential Operators , 1987, Oxford Scholarship Online.

[52]  David Bolin,et al.  Weak convergence of Galerkin approximations for fractional elliptic stochastic PDEs with spatial white noise , 2017, BIT Numerical Mathematics.

[53]  B. Matérn Spatial variation : Stochastic models and their application to some problems in forest surveys and other sampling investigations , 1960 .

[54]  Hyunjoong Kim,et al.  Functional Analysis I , 2017 .

[55]  Douglas W. Nychka,et al.  Methods for Analyzing Large Spatial Data: A Review and Comparison , 2017 .

[56]  D. Higdon Space and Space-Time Modeling using Process Convolutions , 2002 .

[57]  Haavard Rue,et al.  Non-stationary Gaussian models with physical barriers , 2016, Spatial Statistics.

[58]  Roger Woodard,et al.  Interpolation of Spatial Data: Some Theory for Kriging , 1999, Technometrics.

[59]  Ivan P. Gavrilyuk,et al.  Data-sparse approximation to the operator-valued functions of elliptic operator , 2003, Math. Comput..

[60]  Matthias Katzfuss,et al.  A Multi-Resolution Approximation for Massive Spatial Datasets , 2015, 1507.04789.

[61]  Herbert Stahl,et al.  Best uniform rational approximation ofxα on [0, 1] , 2003 .

[62]  D. Nychka,et al.  Covariance Tapering for Interpolation of Large Spatial Datasets , 2006 .