Modified student's t-hidden Markov model for pattern recognition and classification

The Gaussian hidden Markov model has been successfully used in pattern recognition and classification applications; however, recently the Student's t-mixture model is regarded as an alternative to Gaussian mixture models, as it is more robust for outliers. The model using Student's t-mixture distribution as its hidden state is the Student's t-hidden Markov model (SHMM). The authors propose a novel Student's t-hidden Markov model, which considers the relationship among Markov states, latent components and observations by introducing a regularising scalar exponent in the component densities of the model's emission densities. Moreover, the standard SHMM can be considered as a special case of the modified SHMM with the selection of proper parameter values. Finally, the authors adopt the gradient method to estimate optimal weight parameters. Simultaneously, the expectation–maximisation algorithm is used to fit the modified SHMM. Thus, our model is simple and easy to implement. The experimental results using synthetic and real data demonstrate the improved robustness of the proposed approach.

[1]  Biing-Hwang Juang,et al.  Discriminative learning for minimum error classification [pattern recognition] , 1992, IEEE Trans. Signal Process..

[2]  Hsiao-Wuen Hon,et al.  Speaker-independent phone recognition using hidden Markov models , 1989, IEEE Trans. Acoust. Speech Signal Process..

[3]  Florence Forbes,et al.  Hidden Markov Random Field Model Selection Criteria Based on Mean Field-Like Approximations , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Chih-Pin Liao,et al.  Maximum Confidence Hidden Markov Modeling for Face Recognition , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Q. M. Jonathan Wu,et al.  An Extension of the Standard Mixture Model for Image Segmentation , 2010, IEEE Transactions on Neural Networks.

[6]  Sotirios Chatzis,et al.  Factor Analysis Latent Subspace Modeling and Robust Fuzzy Clustering Using $t$-Distributions , 2009, IEEE Transactions on Fuzzy Systems.

[7]  Gilles Celeux,et al.  EM procedures using mean field-like approximations for Markov model-based image segmentation , 2003, Pattern Recognit..

[8]  Sotirios Chatzis,et al.  Robust Sequential Data Modeling Using an Outlier Tolerant Hidden Markov Model , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[11]  Lawrence Carin,et al.  Variational Bayes for continuous hidden Markov models and its application to active learning , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[13]  Geoffrey J. McLachlan,et al.  Robust mixture modelling using the t distribution , 2000, Stat. Comput..

[14]  T. Martin McGinnity,et al.  A least angle regression method for fMRI activation detection in phase-encoded experimental designs , 2010, NeuroImage.

[15]  Sotirios Chatzis,et al.  Robust fuzzy clustering using mixtures of Student's-t distributions , 2008, Pattern Recognit. Lett..

[16]  Nikolas P. Galatsanos,et al.  Edge preserving spatially varying mixtures for image segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Sotirios Chatzis,et al.  Signal Modeling and Classification Using a Robust Latent Space Model Based on $t$ Distributions , 2008, IEEE Transactions on Signal Processing.

[18]  Soo-Young Lee,et al.  Noise-Robust Speech Recognition Using Top-Down Selective Attention With an HMM Classifier , 2007, IEEE Signal Processing Letters.

[19]  Wojciech Pieczynski,et al.  Pairwise Markov Chains , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Florence Tupin,et al.  Unsupervised classification of radar images using hidden Markov chains and hidden Markov random fields , 2003, IEEE Trans. Geosci. Remote. Sens..

[21]  Tom M. Mitchell,et al.  Learning to Decode Cognitive States from Brain Images , 2004, Machine Learning.

[22]  John H. L. Hansen,et al.  Selective training for hidden Markov models with applications to speech classification , 1999, IEEE Trans. Speech Audio Process..