Akaike and Bayesian Information Criteria for Hidden Markov Models

We propose the Bayesian information criterion (BIC) and the Akaike information criterion (AIC) for model selection in hidden Markov models (HMM) when the number of states is unknown. The exact solutions exploit the properties of HMM that allow tractable forms of both criteria to be obtained while transgressing the common assumption in AIC and BIC model selection approaches on the independence of data. The proposed algorithm is presented and evaluated in application to blind channel estimation and symbol detection when the channel length is assumed unknown.

[1]  Adrian E. Raftery,et al.  Determining the Number of Colors or Gray Levels in an Image Using Approximate Bayes Factors: The Pseudolikelihood Information Criterion (PLIC) , 2001 .

[2]  C. Ji,et al.  A consistent model selection procedure for Markov random fields based on penalized pseudolikelihood , 1996 .

[3]  Florence Forbes,et al.  Hidden Markov Random Field Model Selection Criteria Based on Mean Field-Like Approximations , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[5]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[6]  John Cocke,et al.  Optimal decoding of linear codes for minimizing symbol error rate (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[7]  Ghassan Kawas Kaleh,et al.  Joint parameter estimation and symbol detection for linear or nonlinear unknown channels , 1994, IEEE Trans. Commun..

[8]  Luca De Angelis,et al.  Model selection in hidden Markov models: a simulation study , 2010 .

[9]  H. Akaike A new look at the statistical model identification , 1974 .

[10]  Yves Delignon,et al.  One-dimensional barcode reading: an information theoretic approach. , 2008, Applied optics.

[11]  José A. R. Fonollosa,et al.  Blind channel estimation and data detection using hidden Markov models , 1997, IEEE Trans. Signal Process..

[12]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[13]  E. Gassiat Likelihood ratio inequalities with applications to various mixtures , 2002 .