On the Formal Analysis of HMM Using Theorem Proving

Hidden Markov Models (HMMs) have been widely utilized for modeling time series data in various engineering and biological systems. The analyses of these models are usually conducted using computer simulations and paper-and-pencil proof methods and, more recently, using probabilistic model-checking. However, all these methods either do not guarantee accurate analysis or are not scalable (for instance, they can hardly handle the computation when some parameters become very huge). As an alternative, we propose to use higher-order logic theorem proving to reason about properties of discrete HMMs by applying automated verification techniques. This paper presents some foundational formalizations in this regard, namely an extended-real numbers based formalization of finite-state Discrete-Time Markov chains and HMMs along with the verification of some of their fundamental properties. The distinguishing feature of our work is that it facilitates automatic verification of systems involving HMMs. For illustration purposes, we utilize our results for the formal analysis of a DNA sequence.

[1]  Sofiène Tahar,et al.  On the Formalization of the Lebesgue Integration Theory in HOL , 2010, ITP.

[2]  Lijun Zhang,et al.  Logic and Model Checking for Hidden Markov Models , 2005, FORTE.

[3]  D. Vere-Jones Markov Chains , 1972, Nature.

[4]  Padhraic Smyth,et al.  Downscaling of Daily Rainfall Occurrence over Northeast Brazil Using a Hidden Markov Model , 2004, Journal of Climate.

[5]  Manabu Hagiwara,et al.  Formalization of Shannon's Theorems in SSReflect-Coq , 2012, ITP.

[6]  Mahesh Viswanathan,et al.  VESTA: A statistical model-checker and analyzer for probabilistic systems , 2005, Second International Conference on the Quantitative Evaluation of Systems (QEST'05).

[7]  Johannes Hölzl,et al.  Three Chapters of Measure Theory in Isabelle/HOL , 2011, ITP.

[8]  I. G. MacKenzie,et al.  Stochastic Processes with Applications , 1992 .

[9]  Michael J. C. Gordon,et al.  Mechanizing programming logics in higher order logic , 1989 .

[10]  Jan J. M. M. Rutten,et al.  Mathematical techniques for analyzing concurrent and probabilistic systems , 2004, CRM monograph series.

[11]  Zoubin Ghahramani,et al.  An Introduction to Hidden Markov Models and Bayesian Networks , 2001, Int. J. Pattern Recognit. Artif. Intell..

[12]  Sofiène Tahar,et al.  Formalization of Finite-State Discrete-Time Markov Chains in HOL , 2011, ATVA.

[13]  Kai Lai Chung,et al.  Markov Chains with Stationary Transition Probabilities , 1961 .

[14]  Kai Lai Chung,et al.  Markov Chains with Stationary Transition Probabilities , 1961 .

[15]  Christel Baier,et al.  Principles of model checking , 2008 .

[16]  Mauro Delorenzi,et al.  MAMOT: hidden Markov modeling tool , 2008, Bioinform..

[17]  Lain L. MacDonald,et al.  Hidden Markov and Other Models for Discrete- valued Time Series , 1997 .