Approximate posterior distributions for convolutional two-level hidden Markov models

A convolutional two-level hidden Markov model is defined and evaluated. The bottom level contains an unobserved categorical Markov chain, and given the variables in this level the middle level contains unobserved conditionally independent Gaussian variables. The top level contains observable variables that are a convolution of the variables in the middle level plus additive Gaussian errors. The objective is to assess the categorical variables in the bottom level given the convolved observations in the top level. The inversion is cast in a Bayesian setting with a Markov chain prior model and convolved Gaussian likelihood model. The associated posterior model cannot be assessed since the normalizing constant is too computer demanding to calculate for realistic problems. Three approximate posterior models based on approximations of the likelihood model on generalized factorial form are defined. These approximations can be exactly assessed by the forward-backward algorithm. Both a synthetic case and a real seismic inversion case are used in an empirical evaluation. It is concluded that reliable and computationally efficient approximate posterior models for convolutional two-level hidden Markov models can be defined.

[1]  H. Omre,et al.  Hierarchical Bayesian lithology/fluid prediction: A North Sea case study , 2012 .

[2]  A. Buland,et al.  Bayesian linearized AVO inversion , 2003 .

[3]  H. Omre,et al.  Impact of rock-physics depth trends and Markov random fields on hierarchical Bayesian lithology/fluid prediction , 2010 .

[4]  Eric Moulines,et al.  Inference in hidden Markov models , 2010, Springer series in statistics.

[5]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.

[6]  Hugo Hammer,et al.  Approximate forward-backward algorithm for a switching linear Gaussian model , 2011, Comput. Stat. Data Anal..

[7]  Anthony N. Pettitt,et al.  Efficient recursions for general factorisable models , 2004 .

[8]  Sylvia Frühwirth-Schnatter,et al.  Finite Mixture and Markov Switching Models , 2006 .

[9]  A. Doucet,et al.  Efficient Bayesian Inference for Switching State-Space Models using Discrete Particle Markov Chain Monte Carlo Methods , 2010, 1011.2437.

[10]  Paul G. Richards,et al.  Quantitative Seismology: Theory and Methods , 1980 .

[11]  Carlos M. Carvalho,et al.  Simulation-based sequential analysis of Markov switching stochastic volatility models , 2007, Comput. Stat. Data Anal..

[12]  A. Doucet,et al.  Monte Carlo Smoothing for Nonlinear Time Series , 2004, Journal of the American Statistical Association.

[13]  Geoffrey E. Hinton,et al.  Variational Learning for Switching State-Space Models , 2000, Neural Computation.

[14]  R. Kohn,et al.  A Unified Approach to Nonlinearity, Structural Change, and Outliers , 2005 .

[15]  Henning Omre,et al.  Improved resolution in Bayesian lithology/fluid inversion from prestack seismic data and well observations: Part 1 — Methodology , 2010 .

[16]  Andrew J. Viterbi,et al.  A J Viterbi Error Bounds For Convolutional Codes And An Asymptotically Optimal Decoding Algorithm , 2015 .

[17]  P. Fearnhead,et al.  On‐line inference for hidden Markov models via particle filters , 2003 .

[18]  Jun S. Liu,et al.  Mixture Kalman filters , 2000 .

[19]  S. L. Scott Bayesian Methods for Hidden Markov Models , 2002 .

[20]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[21]  T. Mukerji,et al.  Quantitative Seismic Interpretation: Applying Rock Physics Tools to Reduce Interpretation Risk , 2005 .

[22]  Eric Moulines,et al.  On Approximate Maximum-Likelihood Methods for Blind Identification: How to Cope With the Curse of Dimensionality , 2009, IEEE Transactions on Signal Processing.

[23]  Arild Buland,et al.  Bayesian lithology/fluid prediction and simulation on the basis of a Markov-chain prior model , 2006 .

[24]  Hugo Lewi Hammer,et al.  Bayesian lithology/fluid inversion—comparison of two algorithms , 2010 .

[25]  Chang‐Jin Kim,et al.  Dynamic linear models with Markov-switching , 1994 .

[26]  James M. Rehg,et al.  Learning and Inferring Motion Patterns using Parametric Segmental Switching Linear Dynamic Systems , 2008, International Journal of Computer Vision.