A Systematic Review of Hidden Markov Models and Their Applications

The hidden Markov models are statistical models used in many real-world applications and communities. The use of hidden Markov models has become predominant in the last decades, as evidenced by a large number of published papers. In this survey, 146 papers (101 from Journals and 45 from Conferences/Workshops) from 93 Journals and 44 Conferences/Workshops are considered. The authors evaluate the literature based on hidden Markov model variants that have been applied to various application fields. The paper represents a short but comprehensive description of research on hidden Markov model and its variants for various applications. The paper shows the significant trends in the research on hidden Markov model variants and their applications.

[1]  Yiannis Demiris,et al.  A reservoir-driven non-stationary hidden Markov model , 2012, Pattern Recognit..

[2]  Rogemar Mamon,et al.  A self-updating model driven by a higher-order hidden Markov chain for temperature dynamics , 2016, J. Comput. Sci..

[3]  S. Squartini,et al.  Non-intrusive load monitoring by using active and reactive power in additive Factorial Hidden Markov Models , 2017 .

[4]  Margaret A. Johns,et al.  Corrigendum: The OncoPPi network of cancer-focused protein–protein interactions to inform biological insights and therapeutic strategies , 2017, Nature Communications.

[5]  Florian Hönig,et al.  Smart Annotation of Cyclic Data Using Hierarchical Hidden Markov Models , 2017, Sensors.

[6]  Enhong Chen,et al.  Towards context-aware search by learning a very large variable length hidden markov model from search logs , 2009, WWW '09.

[7]  Eric Horvitz,et al.  Layered representations for human activity recognition , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[8]  Jin H. Kim,et al.  Nonstationary hidden Markov model , 1995, Signal Process..

[9]  Yi‐Hui Zhou,et al.  A Two-Stage Hidden Markov Model Design for Biomarker Detection, with Application to Microbiome Research , 2018, Statistics in biosciences.

[10]  Ming Dong,et al.  Hidden semi-Markov model-based reputation management system for online to offline (O2O) e-commerce markets , 2015, Decis. Support Syst..

[11]  Xiaokang Yang,et al.  Cross-Layered Hidden Markov Modeling for Surveillance Event Recognition , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[12]  Guofeng Zhao,et al.  A novel model for user clicks identification based on hidden semi-Markov , 2013, J. Netw. Comput. Appl..

[13]  Hsin-Piao Lin,et al.  Modelling fading properties for mobile satellite link channels using non-stationary hidden Markov model , 2009 .

[14]  Xiaosong Zhang,et al.  Website Fingerprinting Attack on Anonymity Networks Based on Profile Hidden Markov Model , 2017, IEEE Transactions on Information Forensics and Security.

[15]  Ning Li,et al.  Hidden semi-Markov model-based method for tool wear estimation in milling process , 2017 .

[16]  Nacer Hamzaoui,et al.  Semi-automated diagnosis of bearing faults based on a hidden Markov model of the vibration signals , 2018, Measurement.

[17]  Shixuan Wang,et al.  Decoding Chinese Stock Market Returns: Three-State Hidden Semi-Markov Model , 2017 .

[18]  L. R. Rabiner,et al.  On the application of vector quantization and hidden Markov models to speaker-independent, isolated word recognition , 1983, The Bell System Technical Journal.

[19]  Wei Zhang,et al.  A Unified Framework for Street-View Panorama Stitching , 2016, Sensors.

[20]  Jenny Benois-Pineau,et al.  Hierarchical Hidden Markov Model in detecting activities of daily living in wearable videos for studies of dementia , 2011, Multimedia Tools and Applications.

[21]  Yoram Singer,et al.  The Hierarchical Hidden Markov Model: Analysis and Applications , 1998, Machine Learning.

[22]  J. Sadri,et al.  A new approach of training Hidden Markov Model by PSO algorithm for gene Sequence Modeling , 2013, 2013 First Iranian Conference on Pattern Recognition and Image Analysis (PRIA).

[23]  Tommi S. Jaakkola,et al.  Approximate Inference in Additive Factorial HMMs with Application to Energy Disaggregation , 2012, AISTATS.

[24]  Quanjun Yin,et al.  A Logical Hierarchical Hidden Semi-Markov Model for Team Intention Recognition , 2015 .

[25]  Matti Pastell,et al.  A Hidden Markov Model to Estimate the Time Dairy Cows Spend in Feeder Based on Indoor Positioning Data , 2018, bioRxiv.

[26]  Samy Bengio,et al.  Modeling individual and group actions in meetings with layered HMMs , 2006, IEEE Transactions on Multimedia.

[27]  José Martínez-Aroza,et al.  Semi-hidden Markov models for generation and analysis of sequences , 2015, Math. Comput. Simul..

[28]  Hsiao-Wuen Hon,et al.  Speaker-independent phone recognition using hidden Markov models , 1989, IEEE Trans. Acoust. Speech Signal Process..

[29]  Eric Horvitz,et al.  Layered representations for learning and inferring office activity from multiple sensory channels , 2004, Comput. Vis. Image Underst..

[30]  Sung-Bae Cho,et al.  Layered hidden Markov models to recognize activity with built-in sensors on Android smartphone , 2016, Pattern Analysis and Applications.

[31]  Joseph Bockhorst,et al.  Auto-Regressive HMM Inference with Incomplete Data for Short-Horizon Wind Forecasting , 2010, NIPS.

[32]  Chao Deng,et al.  Optimal Bayesian early fault detection for CNC equipment using hidden semi-Markov process , 2019, Mechanical Systems and Signal Processing.

[33]  Lin Yao,et al.  V2X Routing in a VANET Based on the Hidden Markov Model , 2018, IEEE Transactions on Intelligent Transportation Systems.

[34]  Parag Chordia,et al.  Modeling Melodic Improvisation in Turkish Folk Music Using Variable-Length Markov Models , 2011, ISMIR.

[35]  Hsiao-Chuan Wang,et al.  Hidden Markov model for Mandarin lexical tone recognition , 1988, IEEE Trans. Acoust. Speech Signal Process..

[36]  Darwin G. Caldwell,et al.  Encoding the time and space constraints of a task in explicit-duration Hidden Markov Model , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Haitao Wang,et al.  The Nerve Growth Factor Signaling and Its Potential as Therapeutic Target for Glaucoma , 2014, BioMed research international.

[38]  Fulei Chu,et al.  Fault recognition method for speed-up and speed-down process of rotating machinery based on independent component analysis and Factorial Hidden Markov Model , 2006 .

[39]  Sertan Sentürk,et al.  COMPUTATIONAL MODELING OF IMPROVISATION IN TURKISH FOLK MUSIC USING VARIABLE-LENGTH MARKOV MODELS , 2011 .

[40]  Jaime Valls Miró,et al.  Learning object, grasping and manipulation activities using hierarchical HMMs , 2014, Auton. Robots.

[41]  Chafic Mokbel,et al.  Variable length and context-dependent HMM letter form models for Arabic handwritten word recognition , 2012, Electronic Imaging.

[42]  Michelle Karg,et al.  Clinical Gait Analysis: Comparing Explicit State Duration HMMs Using a Reference-Based Index , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  B.-H. Juang,et al.  On the hidden Markov model and dynamic time warping for speech recognition — A unified view , 1984, AT&T Bell Laboratories Technical Journal.

[44]  Eita Nakamura,et al.  Autoregressive Hidden Semi-Markov Model of Symbolic Music Performance for Score Following , 2015, ISMIR.

[45]  N. Limnios,et al.  Application of hidden semi-Markov models for the seismic hazard assessment of the North and South Aegean Sea, Greece , 2017 .

[46]  Yi Xie,et al.  A Forward-Backward Algorithm for Nested Hidden semi-Markov Model and Application to Network Traffic , 2013, Comput. J..

[47]  Masataka Goto,et al.  An auto-regressive, non-stationary excited signal parameter estimation method and an evaluation of a singing-voice recognition , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[48]  Wenyuan Lv,et al.  A novel method using adaptive hidden semi-Markov model for multi-sensor monitoring equipment health prognosis , 2015 .

[49]  A. B. Poritz,et al.  Linear predictive hidden Markov models and the speech signal , 1982, ICASSP.

[50]  Ayse Basar Bener,et al.  On the Use of Hidden Markov Model to Predict the Time to Fix Bugs , 2018, IEEE Transactions on Software Engineering.

[51]  Dongmin Shin,et al.  An adaptive approach for determining batch sizes using the hidden Markov model , 2019, J. Intell. Manuf..

[52]  N. Limnios,et al.  Hidden Semi-Markov Modeling for the Estimation of Earthquake Occurrence Rates , 2014 .

[53]  Jindong Tan,et al.  Layered hidden Markov models for real-time daily activity monitoring using body sensor networks , 2008, 2008 5th International Summer School and Symposium on Medical Devices and Biosensors.

[54]  Jerry L. Prince,et al.  Incompressible Deformation Estimation Algorithm (IDEA) From Tagged MR Images , 2012, IEEE Transactions on Medical Imaging.

[55]  Jean-Marc Odobez,et al.  Sports Event Recognition Using Layered HMMS , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[56]  Jun Cai,et al.  Analyzing Network Protocols of Application Layer Using Hidden Semi-Markov Model , 2016 .

[57]  Tae Hyun Kim,et al.  Deacetylation Followed by Fractionation of Yellow Poplar Sawdust for the Production of Toxicity-Reduced Hemicellulosic Sugar for Ethanol Fermentation , 2018 .

[58]  Hisham Othman,et al.  A simplified second-order HMM with application to face recognition , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[59]  Mohammad Reza Daliri,et al.  Recognition of amyotrophic lateral sclerosis disease using factorial hidden Markov model , 2016, Biomedizinische Technik. Biomedical engineering.

[60]  Hiroyuki Kasai,et al.  State duration and interval modeling in hidden semi-Markov model for sequential data analysis , 2016, Annals of Mathematics and Artificial Intelligence.

[61]  Lei Zhang,et al.  A High-Order Hidden Markov Model and Its Applications for Dynamic Car Ownership Analysis , 2018, Transp. Sci..

[62]  Koichi Shinoda,et al.  Robust Speech Recognition Using Factorial HMMs for Home Environments , 2007, EURASIP J. Adv. Signal Process..

[63]  Miguel Altuve,et al.  Online apnea–bradycardia detection based on hidden semi-Markov models , 2014, Medical & Biological Engineering & Computing.

[64]  Prashant Doshi,et al.  A layered HMM for predicting motion of a leader in multi-robot settings , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[65]  G.G. Cano,et al.  An approach to cardiac arrhythmia analysis using hidden Markov models , 1990, IEEE Transactions on Biomedical Engineering.

[66]  Xiao-fei Wang,et al.  Driving Risk Affected Areas and Distribution Function of Sharp Horizontal Curves of Expressway , 2015 .

[67]  Louis Ranjard,et al.  A hidden Markov model approach to indicate Bryde’s whale acoustics , 2018 .

[68]  Santanu Chaudhury,et al.  Learning effective connectivity from fMRI using autoregressive hidden Markov model with missing data , 2017, Journal of Neuroscience Methods.

[69]  Yan Wang,et al.  Real-time FDM machine condition monitoring and diagnosis based on acoustic emission and hidden semi-Markov model , 2017 .

[70]  Chun Yip Yau,et al.  A hidden Markov model for earthquake prediction , 2018, Stochastic Environmental Research and Risk Assessment.

[71]  Ajay Kumar Tanwani,et al.  Learning Robot Manipulation Tasks With Task-Parameterized Semitied Hidden Semi-Markov Model , 2016, IEEE Robotics and Automation Letters.

[72]  Yang Li,et al.  A Novel Approach to ECG Classification Based upon Two-Layered HMMs in Body Sensor Networks , 2014, Sensors.

[73]  Robert C. Qiu,et al.  Prediction of channel state for cognitive radio using higher-order hidden Markov model , 2010, Proceedings of the IEEE SoutheastCon 2010 (SoutheastCon).

[74]  Michael I. Jordan,et al.  Factorial Hidden Markov Models , 1995, Machine Learning.

[75]  Min Chen,et al.  Dynamic Fault Prediction of Power Transformers Based on Hidden Markov Model of Dissolved Gases Analysis , 2019, IEEE Transactions on Power Delivery.

[76]  Wei-xing Su,et al.  Online Outlier Detection for Time-varying Time Series on Improved ARHMM in Geological Mineral Grade Analysis Process , 2017 .

[77]  Abdelaziz Kriouile,et al.  Automatic word recognition based on second-order hidden Markov models , 1994, IEEE Trans. Speech Audio Process..

[78]  Takeo Kanade,et al.  A Semi-Markov Model for Mitosis Segmentation in Time-Lapse Phase Contrast Microscopy Image Sequences of Stem Cell Populations , 2012, IEEE Transactions on Medical Imaging.

[79]  Sergios Theodoridis,et al.  Classification of musical patterns using variable duration hidden Markov models , 2004, IEEE Transactions on Audio, Speech, and Language Processing.

[80]  Richard Rose,et al.  A hidden Markov model based keyword recognition system , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[81]  Thierry Dumont,et al.  Context Tree Estimation in Variable Length Hidden Markov Models , 2011, IEEE Transactions on Information Theory.

[82]  Tom Heskes,et al.  Molecular Machines in the Synapse: Overlapping Protein Sets Control Distinct Steps in Neurosecretion , 2012, PLoS Comput. Biol..

[83]  Ryosuke Shibasaki,et al.  A mixed autoregressive hidden-markov-chain model applied to people's movements , 2012, SIGSPATIAL/GIS.

[84]  Robert X. Gao,et al.  Occupancy estimation for smart buildings by an auto-regressive hidden Markov model , 2014, 2014 American Control Conference.

[85]  Xianglong Liu,et al.  An improved noise-robust voice activity detector based on hidden semi-Markov models , 2011, Pattern Recognit. Lett..

[86]  Jean-François Mari,et al.  A second-order HMM for high performance word and phoneme-based continuous speech recognition , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[87]  Maurice Charbit,et al.  Factorial Scaled Hidden Markov Model for polyphonic audio representation and source separation , 2009, 2009 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics.

[88]  Liangcai Zeng,et al.  Diagnosis and Prognosis of Degradation Process via Hidden Semi-Markov Model , 2018, IEEE/ASME Transactions on Mechatronics.

[89]  S. Srihari,et al.  Variable duration hidden markov model and morphological segmentation for handwritten word recognition , 1995, IEEE Transactions on Image Processing.

[90]  Ke Xu,et al.  High-order Hidden Markov Model for trend prediction in financial time series , 2019, Physica A: Statistical Mechanics and its Applications.

[91]  Dirk Husmeier,et al.  Discriminating between rate heterogeneity and interspecific recombination in DNA sequence alignments with phylogenetic factorial hidden Markov models , 2005, ECCB/JBI.

[92]  Addisson Salazar,et al.  Optimum Detection of Ultrasonic Echoes Applied to the Analysis of the First Layer of a Restored Dome , 2007, EURASIP J. Adv. Signal Process..

[93]  Perry R. Cook,et al.  Data-Driven Recomposition using the Hierarchical Dirichlet Process Hidden Markov Model , 2009, ICMC.

[94]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[95]  Danica Kragic,et al.  Layered HMM for Motion Intention Recognition , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[96]  Erik L. L. Sonnhammer,et al.  A Hidden Markov Model for Predicting Transmembrane Helices in Protein Sequences , 1998, ISMB.

[97]  Nancy Samaan,et al.  Cloud Resource Scaling for Big Data Streaming Applications Using a Layered Multi-dimensional Hidden Markov Model , 2017, 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID).

[98]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[99]  Tillman Weyde,et al.  Explicit Duration Hidden Markov Models for Multiple-Instrument Polyphonic Music Transcription , 2013, ISMIR.

[100]  Mokhtar Sellami,et al.  Semi-continuous HMMs with explicit state duration for unconstrained Arabic word modeling and recognition , 2008, Pattern Recognit. Lett..

[101]  Sunil Bajpai,et al.  Anthracobunids from the Middle Eocene of India and Pakistan Are Stem Perissodactyls , 2014, PloS one.

[102]  Peter Ingels,et al.  Connected Text Recognition Using Layered HMMs and Token Passing , 1996, ArXiv.

[103]  Carl Quillen,et al.  Autoregressive HMM speech synthesis , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[104]  Changqin Quan,et al.  Weighted high-order hidden Markov models for compound emotions recognition in text , 2016, Inf. Sci..

[105]  Keshav Thapa,et al.  Log-Viterbi algorithm applied on second-order hidden Markov model for human activity recognition , 2018, Int. J. Distributed Sens. Networks.

[106]  K. Wimmers,et al.  biomvRhsmm: Genomic Segmentation with Hidden Semi-Markov Model , 2014, BioMed research international.

[107]  Michael Seifert,et al.  Autoregressive Higher-Order Hidden Markov Models: Exploiting Local Chromosomal Dependencies in the Analysis of Tumor Expression Profiles , 2014, PloS one.

[108]  Parag Chordia,et al.  Predictive Tabla Modelling Using Variable-length Markov and Hidden Markov Models , 2011 .

[109]  Roger K. Moore,et al.  Hidden Markov model decomposition of speech and noise , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[110]  Y.S. Wong,et al.  HMM with explicit state duration for prognostics in face milling , 2010, 2010 IEEE Conference on Robotics, Automation and Mechatronics.

[111]  Anders Krogh.  Hidden Markov models for labeled sequences , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[112]  Lalit R. Bahl,et al.  Maximum mutual information estimation of hidden Markov model parameters for speech recognition , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[113]  Weng-Keen Wong,et al.  Efficient Multi-Instance Learning for Activity Recognition from Time Series Data Using an Auto-Regressive Hidden Markov Model , 2016, ICML.

[114]  Günther Palm,et al.  Recognizing Human Activities Using a Layered Markov Architecture , 2012, ICANN.

[115]  Richard M. Schwartz,et al.  Improved hidden Markov modeling of phonemes for continuous speech recognition , 1984, ICASSP.

[116]  Yvonne Freer,et al.  Autoregressive Hidden Markov Models for the Early Detection of Neonatal Sepsis , 2014, IEEE Journal of Biomedical and Health Informatics.

[117]  Jean-Philippe Thiran,et al.  Source/Filter Factorial Hidden Markov Model, With Application to Pitch and Formant Tracking , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[118]  Friedhelm Schwenker,et al.  Incorporating uncertainty in a layered HMM architecture for human activity recognition , 2011, J-HGBU '11.

[119]  June-ho Bang,et al.  Anomaly detection of network-initiated LTE signaling traffic in wireless sensor and actuator networks based on a Hidden semi-Markov Model , 2017, Comput. Secur..

[120]  Stephen E. Levinson,et al.  Speaker independent isolated digit recognition using hidden Markov models , 1982, ICASSP.

[121]  Mary P. Harper,et al.  A Second-Order Hidden Markov Model for Part-of-Speech Tagging , 1999, ACL.

[122]  Kunpeng Zhu,et al.  Online Tool Wear Monitoring Via Hidden Semi-Markov Model With Dependent Durations , 2018, IEEE Transactions on Industrial Informatics.

[123]  Stephen E. Levinson,et al.  Autoregressive Hidden Markov Model and the Speech Signal , 2015, Complex Adaptive Systems.

[124]  Do-Hyeun Kim,et al.  A Prediction Mechanism of Energy Consumption in Residential Buildings Using Hidden Markov Model , 2018 .

[125]  Ming Dong,et al.  Equipment PHM using non-stationary segmental hidden semi-Markov model , 2011 .

[126]  Yi Ding,et al.  A Weekly Load Data Mining Approach Based on Hidden Markov Model , 2019, IEEE Access.

[127]  Ching-Hsien Hsu,et al.  Machine Learning Based Big Data Processing Framework for Cancer Diagnosis Using Hidden Markov Model and GM Clustering , 2017, Wireless Personal Communications.

[128]  Christian Antfolk,et al.  Vector Autoregressive Hierarchical Hidden Markov Models for Extracting Finger Movements Using Multichannel Surface EMG Signals , 2018, Complex..

[129]  Sheng-Wen Shih,et al.  Learning Atomic Human Actions Using Variable-Length Markov Models , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[130]  Xianfu Chen,et al.  Predicting Spectrum Occupancies Using a Non-Stationary Hidden Markov Model , 2014, IEEE Wireless Communications Letters.

[131]  Stephen J. Maybank,et al.  Activity recognition using a supervised non-parametric hierarchical HMM , 2016, Neurocomputing.

[132]  Xiao Jinghui,et al.  Principles of non-stationary hidden markov model and its applications to sequence labeling task , 2005 .

[133]  Gary A. Churchill,et al.  Hidden Markov Chains and the Analysis of Genome Structure , 1992, Comput. Chem..

[134]  Michael Seifert,et al.  Parsimonious Higher-Order Hidden Markov Models for Improved Array-CGH Analysis with Applications to Arabidopsis thaliana , 2012, PLoS Comput. Biol..

[135]  Shujuan Zhou,et al.  Online machine health prognostics based on modified duration-dependent hidden semi-Markov model and high-order particle filtering , 2018 .

[136]  Ming Dong,et al.  A novel approach to equipment health management based on auto-regressive hidden semi-Markov model (AR-HSMM) , 2008, Science in China Series F: Information Sciences.

[137]  Hengliang Tang,et al.  Detection of malicious domain names based on an improved hidden Markov model , 2019, Int. J. Wirel. Mob. Comput..

[138]  Suh-Yin Lee,et al.  Human action recognition based on layered-HMM , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[139]  Manolis Kellis,et al.  Multi-scale chromatin state annotation using a hierarchical hidden Markov model , 2017, Nature Communications.

[140]  Aly Chkeir,et al.  A Hidden Markov Model for Indoor Trajectory Tracking of Elderly People , 2019, 2019 IEEE Sensors Applications Symposium (SAS).

[141]  Lee-Min Lee,et al.  High-order hidden Markov model for piecewise linear processes and applications to speech recognition. , 2016, The Journal of the Acoustical Society of America.

[142]  Karen M. Feigh,et al.  Predicting Task Intent From Surface Electromyography Using Layered Hidden Markov Models , 2017, IEEE Robotics and Automation Letters.

[143]  Haihong Hu,et al.  Factorial HMM and Parallel HMM for Gait Recognition , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[144]  Scott A. McKinley,et al.  Hidden semi-Markov models reveal multiphasic movement of the endangered Florida panther. , 2015, The Journal of animal ecology.

[145]  Biing-Hwang Juang,et al.  Hidden Markov Models for Speech Recognition , 1991 .

[146]  Xin Li,et al.  Optimal Bayesian control policy for gear shaft fault detection using hidden semi-Markov model , 2018, Comput. Ind. Eng..

[147]  M. Humayun Kabir,et al.  Two-Layer Hidden Markov Model for Human Activity Recognition in Home Environments , 2016, Int. J. Distributed Sens. Networks.

[148]  Rubayyi Alghamdi,et al.  Hidden Markov Models (HMMs) and Security Applications , 2016 .

[149]  Anna K. Yanchenko.  Classical Music Composition Using Hidden Markov Models , 2017 .

[150]  Yang Chen,et al.  Analyzing Single-Molecule Protein Transportation Experiments via Hierarchical Hidden Markov Models , 2016, Journal of the American Statistical Association.

[151]  Andrey V. Dmitriev,et al.  Complexity of a Microblogging Social Network in the Framework of Modern Nonlinear Science , 2018, Complex..

[152]  Ajay Srinivasamurthy,et al.  Chord Recognition Using Duration-explicit Hidden Markov Models , 2012, ISMIR.

[153]  Tak Kuen Siu,et al.  Discrete-time optimal asset allocation under Higher-Order Hidden Markov Model , 2017 .

[154]  Mary L. Cummings,et al.  Predictive models of human supervisory control behavioral patterns using hidden semi-Markov models , 2011, Eng. Appl. Artif. Intell..

[155]  Juha Hyyppä,et al.  Reciprocal Estimation of Pedestrian Location and Motion State toward a Smartphone Geo-Context Computing Solution , 2015, Micromachines.

[156]  Alan Smaill,et al.  Learning musical pitch structures with hierarchical hidden Markov models , 2005 .