Variational Beta Process Hidden Markov Models with Shared Hidden States for Trajectory Recognition

Hidden Markov model (HMM) is a vital model for trajectory recognition. As the number of hidden states in HMM is important and hard to be determined, many nonparametric methods like hierarchical Dirichlet process HMMs and Beta process HMMs (BP-HMMs) have been proposed to determine it automatically. Among these methods, the sampled BP-HMM models the shared information among different classes, which has been proved to be effective in several trajectory recognition scenes. However, the existing BP-HMM maintains a state transition probability matrix for each trajectory, which is inconvenient for classification. Furthermore, the approximate inference of the BP-HMM is based on sampling methods, which usually takes a long time to converge. To develop an efficient nonparametric sequential model that can capture cross-class shared information for trajectory recognition, we propose a novel variational BP-HMM model, in which the hidden states can be shared among different classes and each class chooses its own hidden states and maintains a unified transition probability matrix. In addition, we derive a variational inference method for the proposed model, which is more efficient than sampling-based methods. Experimental results on a synthetic dataset and two real-world datasets show that compared with the sampled BP-HMM and other related models, the variational BP-HMM has better performance in trajectory recognition.

[1]  Qing-Bin Gao,et al.  Trajectory-based human activity recognition using Hidden Conditional Random Fields , 2012, 2012 International Conference on Machine Learning and Cybernetics.

[2]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[3]  Yan Yan,et al.  Hierarchical HMM for Eye Movement Classification , 2020, ECCV Workshops.

[4]  Michael I. Jordan,et al.  Hierarchical Beta Processes and the Indian Buffet Process , 2007, AISTATS.

[5]  M. Cheriet,et al.  Handwritten characters recognition based on SKCS-polyline and hidden Markov model (HMM) , 2004, First International Symposium on Control, Communications and Signal Processing, 2004..

[6]  Dirk Söffker,et al.  Improved Driving Behaviors Prediction Based on Fuzzy Logic-Hidden Markov Model (FL-HMM) , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[7]  Lawrence Carin,et al.  Variational Inference for Stick-Breaking Beta Process Priors , 2011, ICML.

[8]  Ammar Belatreche,et al.  Adaptive Hidden Markov Model With Anomaly States for Price Manipulation Detection , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Yee Whye Teh,et al.  Stick-breaking Construction for the Indian Buffet Process , 2007, AISTATS.

[10]  Carlos Alberto Ochoa Ortíz Zezzatti,et al.  Mobile Device Application to Detect Dangerous Movements in Industrial Processes Through Intelligence Trough Ergonomic Analysis Using Virtual Reality , 2021, AICV.

[11]  Albert Langkamp,et al.  A Sequence-Based Damage Identification Method for Composite Rotors by Applying the Kullback–Leibler Divergence, a Two-Sample Kolmogorov–Smirnov Test and a Statistical Hidden Markov Model , 2019, Entropy.

[12]  R. J. Alcock.  Time-Series Similarity Queries Employing a Feature-Based Approach , 1999 .

[13]  Emily B. Fox,et al.  Effective Split-Merge Monte Carlo Methods for Nonparametric Models of Sequential Data , 2012, NIPS.

[14]  Thomas L. Griffiths,et al.  Infinite latent feature models and the Indian buffet process , 2005, NIPS.

[15]  Michael I. Jordan,et al.  JOINT MODELING OF MULTIPLE TIME SERIES VIA THE BETA PROCESS WITH APPLICATION TO MOTION CAPTURE SEGMENTATION , 2013, 1308.4747.

[16]  Yee Whye Teh,et al.  Sharing Clusters among Related Groups: Hierarchical Dirichlet Processes , 2004, NIPS.

[17]  Sinisa Todorovic,et al.  Action Shuffle Alternating Learning for Unsupervised Action Segmentation , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Lawrence Carin,et al.  A Stick-Breaking Construction of the Beta Process , 2010, ICML.

[19]  Robert Bergevin,et al.  Semantic human activity recognition: A literature review , 2015, Pattern Recognit..

[20]  Guilherme A. Barreto,et al.  Short-term memory mechanisms in neural network learning of robot navigation tasks: A case study , 2009, 2009 6th Latin American Robotics Symposium (LARS 2009).

[21]  T. Ferguson.  A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[22]  Mário A. T. Figueiredo,et al.  Trajectory Classification Using Switched Dynamical Hidden Markov Models , 2010, IEEE Transactions on Image Processing.

[23]  Hermann Ney,et al.  The Rwth Asr System for Ted-Lium Release 2: Improving Hybrid Hmm With Specaugment , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Shiliang Sun,et al.  Modeling and recognizing human trajectories with beta process hidden Markov models , 2015, Pattern Recognit..

[25]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[26]  Francesco Villecco,et al.  Multi-Scale Permutation Entropy Based on Improved LMD and HMM for Rolling Bearing Diagnosis , 2017, Entropy.

[27]  Arash Pourtaherian,et al.  Infant Facial Expression Analysis: Towards a Real-Time Video Monitoring System Using R-CNN and HMM , 2020, IEEE Journal of Biomedical and Health Informatics.

[28]  N. Hjort.  Nonparametric Bayes Estimators Based on Beta Processes in Models for Life History Data , 1990 .

[29]  Shiliang Sun,et al.  Trajectory-based human activity recognition with hierarchical dirichlet process hidden Markov models , 2013, 2013 IEEE China Summit and International Conference on Signal and Information Processing.

[30]  Miroslav Svitek,et al.  Industry 4.0 as a part of smart cities , 2016, 2016 Smart Cities Symposium Prague (SCSP).

[31]  Stefanos Zafeiriou,et al.  Infinite Hidden Conditional Random Fields for Human Behavior Analysis , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Michael I. Jordan,et al.  Sharing Features among Dynamical Systems with Beta Processes , 2009, NIPS.

[33]  Pedro M. Crespo,et al.  Combining the Burrows-Wheeler Transform and RCM-LDGM Codes for the Transmission of Sources with Memory at High Spectral Efficiencies , 2019, Entropy.

[34]  Amr Talaat Abdel-Hamid,et al.  On Detecting IoT Power Signature Anomalies using Hidden Markov Model (HMM) , 2019, 2019 31st International Conference on Microelectronics (ICM).

[35]  Qing-Bin Gao,et al.  Human activity recognition with beta process hidden Markov models , 2013, 2013 International Conference on Machine Learning and Cybernetics.