Temporal and Hierarchical HMM for Activity Recognition Applied in Visual Medical Monitoring using a Multi-Camera System

We address in this paper an improved medical monitoring system through an automatic recognition of human activity in Intensive Care Units (ICUs). A multi camera vision system approach is proposed to collect video sequence for automatic analysis and interpretation of the scene. The latter is performed using Hidden Markov Model (HMM) with explicit state duration combine at the management of the hierarchical structure of the scenario. Significant experiments are carried out on the proposed monitoring system in a hospital's cardiology section in order to prove the need for computer-aided patient supervision to help clinicians in the decision making process. Temporal and hierarchical HMM handles explicitly the state duration and then provides a suitable solution for the automatic recognition of temporal events. Finally, the use of Temporal HMM (THMM) based approach improves the scenario recognition performance compared to the result of standard HMM models.

[1]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[2]  Catherine Garbay,et al.  Multi‐level temporal abstraction for medical scenario construction , 2005 .

[3]  G. West,et al.  Duration Abnormality Detection in Sequences of Human Activity , 2004 .

[4]  Yoram Singer,et al.  The Hierarchical Hidden Markov Model: Analysis and Applications , 1998, Machine Learning.

[5]  Mokhtar Sellami,et al.  HMMs with Explicit State Duration Applied to Handwritten Arabic Word Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[6]  Svetha Venkatesh,et al.  Explicit State Duration HMM for Abnormality Detection in Sequences of Human Activity , 2004, PRICAI.

[7]  Stephen E. Levinson,et al.  Continuously variable duration hidden Markov models for automatic speech recognition , 1986 .

[8]  Cina Motamed,et al.  Motion detection and tracking using belief indicators for an automatic visual-surveillance system , 2006, Image Vis. Comput..

[9]  Yoshua Bengio,et al.  Input-output HMMs for sequence processing , 1996, IEEE Trans. Neural Networks.

[10]  Svetha Venkatesh,et al.  Activity recognition and abnormality detection with the switching hidden semi-Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Pierre Gouton,et al.  An Approach to Correcting Image Distortion by Self Calibration Stereoscopic Scene from Multiple Views , 2012, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems.

[12]  J. Edworthy,et al.  Are there too many alarms in the intensive care unit? An overview of the problems. , 1995, Journal of advanced nursing.

[13]  Rick L. Edgeman,et al.  The Inverse Gaussian Distribution: A Case Study in Exponential Families , 1996 .

[14]  Svetha Venkatesh,et al.  Efficient duration and hierarchical modeling for human activity recognition , 2009, Artif. Intell..

[15]  Pedro Pereira Rodrigues,et al.  The Importance of System Integration in Intensive Care Units - A Review , 2011, HEALTHINF.

[16]  Arnaud Ahouandjinou,et al.  Reconnaissance de scénario par les Modèles de Markov Cachés Crédibilistes : Application à l'interprétation automatique de séquences vidéos médicales. (Scenario recognition by evidentials hidden Markov models : Application for the automatic interpretation of medical video sequences) , 2014 .

[17]  M Dojat,et al.  Knowledge-based systems for automatic ventilatory management. , 2001, Respiratory care clinics of North America.

[18]  Carolyn McGregor,et al.  Temporal abstraction in intelligent clinical data analysis: A survey , 2007, Artif. Intell. Medicine.

[19]  Insup Lee,et al.  Smart alarms: multivariate medical alarm integration for post CABG surgery patients , 2012, IHI '12.

[20]  Svetha Venkatesh,et al.  Learning Hierarchical Hidden Markov Models with General State Hierarchy , 2004, AAAI.