Approximate Bayesian inference for hierarchical Gaussian Markov random field models

HÅvard Rue*, Sara Martino

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

140 Scopus citations

Abstract

Many commonly used models in statistics can be formulated as (Bayesian) hierarchical Gaussian Markov random field (GMRF) models. These are characterised by assuming a (often large) GMRF as the second stage in the hierarchical structure and a few hyperparameters at the third stage. Markov chain Monte Carlo (MCMC) is the common approach for Bayesian inference in such models. The variance of the Monte Carlo estimates is Op (M- 1 / 2) where M is the number of samples in the chain so, in order to obtain precise estimates of marginal densities, say, we need M to be very large. Inspired by the fact that often one-block and independence samplers can be constructed for hierarchical GMRF-models, we will in this work investigate whether MCMC is really needed to estimate marginal densities, which often is the goal of the analysis. By making use of GMRF-approximations, we show by typical examples that marginal densities can indeed be very precisely estimated by deterministic schemes. The methodological and practical consequence of these findings are indeed positive. We conjecture that for many hierarchical GMRF-models there is really no need for MCMC based inference to estimate marginal densities. Further, by making use of numerical methods for sparse matrices the computational costs of these deterministic schemes are nearly instant compared to the MCMC alternative. In particular, we discuss in detail the issue of computing marginal variances for GMRFs.

Original languageEnglish (US)
Pages (from-to)3177-3192
Number of pages16
JournalJournal of Statistical Planning and Inference
Volume137
Issue number10
DOIs
StatePublished - Oct 1 2007
Externally publishedYes

Keywords

  • Approximate Bayesian inference
  • Cholesky triangle
  • Conditional auto-regressions
  • Gaussian Markov random fields
  • Hierarchical GMRF-models
  • Laplace-approximation
  • Marginal variances for GMRFs
  • Numerical methods for sparse matrices

ASJC Scopus subject areas

  • Applied Mathematics
  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Fingerprint

Dive into the research topics of 'Approximate Bayesian inference for hierarchical Gaussian Markov random field models'. Together they form a unique fingerprint.

Cite this