Hidden Markov Model-Based Weighted Likelihood Discriminant for 2-D Shape Classification

The goal of this paper is to present a weighted likelihood discriminant for minimum error shape classification. Different from traditional maximum likelihood (ML) methods, in which classification is based on probabilities from independent individual class models as is the case for general hidden Markov model (HMM) methods, proposed method utilizes information from all classes to minimize classification error. The proposed approach uses a HMM for shape curvature as its 2-D shape descriptor. We introduce a weighted likelihood discriminant function and present a minimum classification error strategy based on generalized probabilistic descent method. We show comparative results obtained with our approach and classic ML classification with various HMM topologies alongside Fourier descriptor and Zernike moments-based support vector machine classification for a variety of shapes.

[1]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[2]  Amlan Kundu,et al.  An integrated hybrid neural network and hidden Markov model classifier for sonar signals , 1997, IEEE Trans. Signal Process..

[3]  David Rendall Jane's Aircraft Recognition Guide , 1996 .

[4]  Fatos T. Yarman-Vural,et al.  BAS: a perceptual shape descriptor based on the beam angle statistics , 2003, Pattern Recognit. Lett..

[5]  Ninad Thakoor,et al.  Automatic video object shape extraction and its classification with camera in motion , 2005, IEEE International Conference on Image Processing 2005.

[6]  Douglas A. Reynolds,et al.  Robust text-independent speaker identification using Gaussian mixture speaker models , 1995, IEEE Trans. Speech Audio Process..

[7]  Hervé Bourlard,et al.  New entropy based combination rules in HMM/ANN multi-stream ASR , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[8]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[9]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[10]  Lawrence R. Rabiner,et al.  A tutorial on Hidden Markov Models , 1986 .

[11]  Lalit R. Bahl,et al.  Maximum mutual information estimation of hidden Markov model parameters for speech recognition , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  Fatos T. Yarman-Vural,et al.  A shape descriptor based on circular hidden Markov model , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[13]  Euripides G. M. Petrakis,et al.  Matching and Retrieval of Distorted and Occluded Shapes Using Dynamic Programming , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Yang He,et al.  2-D Shape Classification Using Hidden Markov Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Jinhai Cai,et al.  Hidden Markov Models with Spectral Features for 2D Shape Recognition , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Antonio M. Peinado,et al.  Discriminative feature weighting for HMM-based continuous speech recognizers , 2002, Speech Commun..

[17]  Gerhard Rigoll,et al.  Hidden Markov model based continuous online gesture recognition , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[18]  Ulrich Eckhardt,et al.  Shape descriptors for non-rigid shapes with a single closed contour , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[19]  Shigeru Katagiri,et al.  Handbook of Neural Networks for Speech Processing , 2000 .

[20]  Longin Jan Latecki,et al.  Shape Similarity Measure Based on Correspondence of Visual Parts , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Biing-Hwang Juang,et al.  Pattern recognition using a family of design algorithms based upon the generalized probabilistic descent method , 1998, Proc. IEEE.

[22]  Mahmood R. Azimi-Sadjadi,et al.  Multi-aspect target discrimination using hidden Markov models and neural networks , 2005, IEEE Transactions on Neural Networks.

[23]  Ana L. N. Fred,et al.  Hidden Markov models vs. syntactic modeling in object recognition , 1997, Proceedings of International Conference on Image Processing.

[24]  Frederick Jelinek,et al.  Continuous speech recognition , 1977, SGAR.

[25]  Luciano da Fontoura Costa,et al.  Shape Analysis and Classification: Theory and Practice , 2000 .

[26]  Piero Cosi Hybrid HMM-NN architectures for connected digit recognition , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[27]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[28]  Daphna Weinshall,et al.  Flexible Syntactic Matching of Curves and Its Application to Automatic Hierarchical Classification of Silhouettes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Roberto Gemello,et al.  CSELT hybrid HMM/neural networks technology for continuous speech recognition , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[30]  Noel E. O'Connor,et al.  A multiscale representation method for nonrigid shapes with a single closed contour , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Mário A. T. Figueiredo,et al.  Similarity-based classification of sequences using hidden Markov models , 2004, Pattern Recognit..

[32]  Avinash C. Kak,et al.  Interactive color image segmentation editor driven by active contour model , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[33]  Ninad Thakoor,et al.  Hidden Markov Model Based Weighted Likelihood Discriminant for Minimum Error Shape Classification , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[34]  Guojun Lu,et al.  Review of shape representation and description techniques , 2004, Pattern Recognit..

[35]  Yik-Cheung Tam,et al.  Discriminative auditory-based features for robust speech recognition , 2004, IEEE Transactions on Speech and Audio Processing.

[36]  Ninad Thakoor,et al.  Shape classifier based on generalized probabilistic descent method with hidden Markov descriptor , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[37]  Manuele Bicego,et al.  Investigating hidden Markov models' capabilities in 2D shape classification , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Jianying Hu,et al.  HMM Based On-Line Handwriting Recognition , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  H. Bourlard,et al.  Links Between Markov Models and Multilayer Perceptrons , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Li Deng,et al.  Speech trajectory discrimination using the minimum classification error learning , 1998, IEEE Trans. Speech Audio Process..

[41]  Euripides G. M. Petrakis,et al.  Shape retrieval based on dynamic programming , 2000, IEEE Trans. Image Process..