Efficient Computation of Gaussian Likelihoods for Stationary Markov Random Field Models

We introduce methods for efficiently computing the Gaussian likelihood for stationary Markov random field models, when the data locations fall on a possibly incomplete regular grid. The calculations rely on the availability of the covariances, which we show can be computed to any user-specified accuracy with fast Fourier transform algorithms. Several methods are presented, covering models with and without additive error terms and situations where either conserving memory or reducing computation time are favored, and some of the algorithms are easily parallelized. The examples presented highlight frequentist inference, but access to the likelihood allows for Bayesian inference as well. We demonstrate our results in simulation and timing studies and with an application to gridded satellite data, where we use the likelihood both for parameter estimation and likelihood ratio model comparison. In the data analysis, stochastic partial differential equation approximations are outperformed by an independent block approximation.

[1]  S. R. Searle,et al.  The estimation of environmental and genetic trends from records subject to culling. , 1959 .

[2]  X. Guyon Parameter estimation for a stationary process on a d-dimensional lattice , 1982 .

[3]  A. V. Vecchia Estimation and model identification for continuous spatial processes , 1988 .

[4]  A. Wood,et al.  Simulation of Stationary Gaussian Processes in [0, 1] d , 1994 .

[5]  J. Besag,et al.  On conditional and intrinsic autoregressions , 1995 .

[6]  J. Besag,et al.  Bayesian analysis of agricultural field experiments , 1999 .

[7]  J. Chilès,et al.  Geostatistics: Modeling Spatial Uncertainty , 1999 .

[8]  H. Rue,et al.  On Block Updating in Markov Random Field Models for Disease Mapping , 2002 .

[9]  H. Rue,et al.  Fitting Gaussian Markov Random Fields to Gaussian Fields , 2002 .

[10]  Sw. Banerjee,et al.  Hierarchical Modeling and Analysis for Spatial Data , 2003 .

[11]  Zhiyi Chi,et al.  Approximating likelihoods for large spatial data sets , 2004 .

[12]  D. Lieberman,et al.  Fourier analysis , 2004, Journal of cataract and refractive surgery.

[13]  Leonhard Held,et al.  Gaussian Markov Random Fields: Theory and Applications , 2005 .

[14]  Christopher J Paciorek,et al.  Bayesian Smoothing with Gaussian Processes Using Fourier Basis Functions in the spectralGP Package. , 2007, Journal of statistical software.

[15]  H. Rue,et al.  Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations , 2009 .

[16]  Roummel F. Marcia,et al.  Limited-memory BFGS Systems with Diagonal Updates , 2011, 1112.6060.

[17]  H. Rue,et al.  An explicit link between Gaussian fields and Gaussian Markov random fields: the stochastic partial differential equation approach , 2011 .

[18]  Daniela di Serafino,et al.  Efficient Preconditioner Updates for Shifted Linear Systems , 2011, SIAM J. Sci. Comput..

[19]  Dorit Hammerling,et al.  Explorer A Multi-resolution Gaussian process model for the analysis of large spatial data sets , 2012 .

[20]  Ying Sun,et al.  Geostatistics for Large Datasets , 2012 .

[21]  Andrew V. Knyazev,et al.  Absolute Value Preconditioning for Symmetric Indefinite Linear Systems , 2011, SIAM J. Sci. Comput..

[22]  Fei Xue,et al.  Krylov Subspace Recycling for Sequences of Shifted Linear Systems , 2013, ArXiv.

[23]  Finn Lindgren,et al.  Bayesian computing with INLA: New features , 2012, Comput. Stat. Data Anal..

[24]  Michael L. Stein,et al.  Bayesian and Maximum Likelihood Estimation for Gaussian Processes on an Incomplete Lattice , 2014, 1402.4281.

[25]  Michael L. Stein,et al.  Limitations on low rank approximations for covariance matrices of spatial data , 2014 .

[26]  Lei Du,et al.  IDR(s) for solving shifted nonsymmetric linear systems , 2015, J. Comput. Appl. Math..

[27]  D. Mondal,et al.  An h‐likelihood method for spatial mixed linear models based on intrinsic auto‐regressions , 2015 .

[28]  M. Fuentes,et al.  Circulant Embedding of Approximate Covariances for Inference From Gaussian Data on Large Lattices , 2017 .