A genetic classification error method for speech recognition

In this paper, we present a genetic approach for training hidden Markov models using minimum classification error (MCE) as the reestimation criteria. This approach is discriminative and proved to be better than other non-discriminative approach such as the maximum likelihood (ML) method. The major problem of using the MCE is to formulate the error rate estimate as a smooth continuous loss function such that the gradient search techniques can be applied to search for the solutions. A genetic approach for this particular classification error method aimed at finding the global solution or better optimal solutions is proposed. Comparing our approach with the ML and MCE approaches, the experimental results showed that it is superior to both the MCE and ML methods.

[1]  Jim Smith,et al.  Self adaptation of mutation rates in a steady state genetic algorithm , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[2]  Lawrence R. Rabiner,et al.  A minimum discrimination information approach for hidden Markov modeling , 1989, IEEE Trans. Inf. Theory.

[3]  Terence C. Fogarty,et al.  Varying the Probability of Mutation in the Genetic Algorithm , 1989, ICGA.

[4]  Kim-Fung Man,et al.  Optimisation of HMM topology and its model parameters by genetic algorithms , 2001, Pattern Recognit..

[5]  Rajeev Kumar,et al.  Multiobjective genetic algorithm partitioning for hierarchical learning of high-dimensional pattern spaces: a learning-follows-decomposition strategy , 1998, IEEE Trans. Neural Networks.

[6]  Biing-Hwang Juang,et al.  New discriminative training algorithms based on the generalized probabilistic descent method , 1991, Neural Networks for Signal Processing Proceedings of the 1991 IEEE Workshop.

[7]  Vittorio Maniezzo,et al.  Genetic evolution of the topology and weight distribution of neural networks , 1994, IEEE Trans. Neural Networks.

[8]  Lalit M. Patnaik,et al.  Adaptive probabilities of crossover and mutation in genetic algorithms , 1994, IEEE Trans. Syst. Man Cybern..

[9]  Mari Ostendorf,et al.  From HMM's to segment models: a unified view of stochastic modeling for speech recognition , 1996, IEEE Trans. Speech Audio Process..

[10]  Sam Kwong,et al.  Minimum classification error rate method using genetic algorithms , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[11]  Sam Kwong,et al.  Genetic algorithms: concepts and applications [in engineering design] , 1996, IEEE Trans. Ind. Electron..

[12]  Zbigniew Michalewicz,et al.  Parameter control in evolutionary algorithms , 1999, IEEE Trans. Evol. Comput..

[13]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[14]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[15]  Harvey F. Silverman,et al.  Efficient training algorithms for HMMs using incremental estimation , 1998, IEEE Trans. Speech Audio Process..

[16]  Lalit R. Bahl,et al.  Maximum mutual information estimation of hidden Markov model parameters for speech recognition , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[17]  Biing-Hwang Juang,et al.  A Minimum Error Rate Pattern Recognition Approach to Speech Recognition , 1994, Int. J. Pattern Recognit. Artif. Intell..

[18]  Rathinavelu Chengalvarayan,et al.  Improved speech modelling and recognition using a new training algorithm based on outlier-emphasis for non-stationary state HMM , 1998, Speech Commun..

[19]  J. David Schaffer,et al.  Proceedings of the third international conference on Genetic algorithms , 1989 .

[20]  Fang Sun,et al.  Speech recognition based on genetic algorithm for training HMM , 1998 .

[21]  Nostrand Reinhold,et al.  the utility of using the genetic algorithm approach on the problem of Davis, L. (1991), Handbook of Genetic Algorithms. Van Nostrand Reinhold, New York. , 1991 .

[22]  Sam Kwong,et al.  Optimization of HMM by a genetic algorithm , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[23]  G. Syswerda,et al.  Schedule Optimization Using Genetic Algorithms , 1991 .

[24]  Robert E. Dorsey,et al.  Genetic algorithms for estimation problems with multiple optima , 1995 .

[25]  Michael Picheny,et al.  On a model-robust training method for speech recognition , 1988, IEEE Trans. Acoust. Speech Signal Process..

[26]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[27]  Athanasios Kehagias,et al.  A hybrid neural-genetic multimodel parameter estimation algorithm , 1998, IEEE Trans. Neural Networks.

[28]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[29]  Biing-Hwang Juang,et al.  The segmental K-means algorithm for estimating parameters of hidden Markov models , 1990, IEEE Trans. Acoust. Speech Signal Process..

[30]  Peter J. Fleming,et al.  An Overview of Evolutionary Algorithms in Multiobjective Optimization , 1995, Evolutionary Computation.

[31]  Biing-Hwang Juang,et al.  Minimum classification error rate methods for speech recognition , 1997, IEEE Trans. Speech Audio Process..

[32]  Sam Kwong,et al.  A maximum model distance approach for HMM-based speech recognition , 1998, Pattern Recognit..

[33]  Patrick Haffner,et al.  Connectionist speech recognition with a global MMI algorithm , 1993, EUROSPEECH.

[34]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.