Using hidden non-Markovian Models to reconstruct system behavior in partially-observable systems

Many complex technical systems today have some basic protocol capability, which is used for example to monitor the quality of production output or to keep track of oil pressure in a modern car. The recorded protocols are usually used to detect deviations from some predefined standards and issue warnings. However, the information in such a protocol is not sufficient to determine the source or cause of the problem, since only part of the system is being observed. In this paper we present an approach to reconstruct missing information in only partially-observable stochastic systems based only on recorded system output. The approach uses Hidden non-Markovian Models to model the partially-observable system and Proxel-based simulation to analyze the recorded system output. Experiments were conducted using a production line example. The result of the analysis is a set of possible system behaviors that could have caused the recorded protocol, including their probabilities. We will show that our approach is able to reconstruct the relevant information to determine the source of non-standard system behavior. The combination of Hidden non-Markovian Models and Proxel-based simulation holds the potential to reconstruct unobserved information from partial or even noisy output protocols of a system. It adds value to the information already recorded in many production systems today and opens new possibilities in the analysis of inherently only partially-observable systems.

[1]  Graham Horton,et al.  The Effect of Rare Events on the Evaluation and Decoding of Hidden non-Markovian Models , 2008 .

[2]  Gernot A. Fink,et al.  Markov Models for Pattern Recognition: From Theory to Applications , 2007 .

[3]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[4]  Gunter Bolch,et al.  Queueing Networks and Markov Chains - Modeling and Performance Evaluation with Computer Science Applications, Second Edition , 1998 .

[5]  Reinhard German,et al.  Transient analysis of deterministic and stochastic Petri nets by the method of supplementary variables , 1995, MASCOTS '95. Proceedings of the Third International Workshop on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems.

[6]  Kishor S. Trivedi,et al.  Recent Developments in Non-Markovian Stochastic Petri Nets , 1998, J. Circuits Syst. Comput..

[7]  Edmundo de Souza e Silva,et al.  State space exploration in Markov models , 1992, SIGMETRICS '92/PERFORMANCE '92.

[8]  C. Krull,et al.  HIDDEN NON-MARKOVIAN MODELS : FORMALIZATION AND SOLUTION APPROACHES , 2022 .

[9]  Boudewijn R. Haverkort.  In Search of Probability Mass: Probabilistic Evaluation of High-Level Specified Markov Models , 1995, Comput. J..

[10]  Sanja Lazarova-Molnar.  The proxel-based method , 2005 .

[11]  A. Borshchev,et al.  From System Dynamics and Discrete Event to Practical Agent Based Modeling : Reasons , Techniques , Tools , 2004 .

[12]  de Souza e SilvaEdmundo,et al.  State space exploration in Markov models , 1992 .

[13]  Graham Horton.  A NEW PARADIGM FOR THE NUMERICAL SIMULATION OF STOCHASTIC PETRI NETS WITH GENERAL FIRING TIMES , 2002 .

[14]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.