Asymptotical statistics of misspecified hidden Markov models

This paper deals with the problem of modeling data generated by an ergodic stochastic process as the output of a hidden Markov model (HMM). More specifically, we consider the problem of fitting a parametric family of HMM with continuous output to an ergodic stochastic process with continuous values, which does not necessarily belong to the family. In this context, we derive the main asymptotic results: almost sure consistency of the maximum likelihood estimator, asymptotic normality of the estimation error and the exact rates of almost sure convergence.

[1]  L. Mevel,et al.  Fault detection in hidden Markov models : a local asymptotic approach , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[2]  L. Baum,et al.  Statistical Inference for Probabilistic Functions of Finite State Markov Chains , 1966 .

[3]  F. LeGland,et al.  Recursive estimation in hidden Markov models , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[4]  Anton A. Stoorvogel,et al.  Approximation problems with the divergence criterion for Gaussian variables and Gaussian processes , 1998 .

[5]  A. Shwartz,et al.  On the Poisson Equation for Countable Markov Chains: Existence of Solutions and Parameter Dependence by Probabilistic Methods , 1994 .

[6]  P. Hall,et al.  Martingale Limit Theory and its Application. , 1984 .

[7]  Pierre Priouret,et al.  Adaptive Algorithms and Stochastic Approximations , 1990, Applications of Mathematics.

[8]  E. Hannan,et al.  The statistical theory of linear systems , 1989 .

[9]  L. Mevel,et al.  Asymptotics of the Bayesian estimator of hidden Markov models , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[10]  Laurent Mevel,et al.  Exponential forgetting and geometric ergodicity in HMM's , 1997 .

[11]  Laurent Mevel,et al.  Basic Properties of the Projective Product with Application to Products of Column-Allowable Nonnegative Matrices , 2000, Math. Control. Signals Syst..

[12]  R. Nishii.  Maximum likelihood principle and model selection when the true model is unspecified , 1988 .

[13]  L. Mével,et al.  Statistique asymptotique pour les modeles de markov caches , 1997 .

[14]  B. Leroux.  Maximum-likelihood estimation for hidden Markov models , 1992 .

[15]  Laurent Mevel,et al.  Exponential Forgetting and Geometric Ergodicity in Hidden Markov Models , 2000, Math. Control. Signals Syst..

[16]  H. White.  Maximum Likelihood Estimation of Misspecified Models , 1982 .

[17]  L. Mevel,et al.  Convergence rates of the maximum likelihood estimator of hidden Markov models , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[18]  P. Bickel,et al.  Asymptotic normality of the maximum-likelihood estimator for general hidden Markov models , 1998 .