Acoustic modeling using deep belief network for Bangla speech recognition

Most of the Speech Recognition (SR) systems use Hidden Markov Model (HMM) for acoustic modeling and Gaussian Mixture Model (GMM) for state modeling. Artificial Neural Network (ANN) based methods are also found as a good replacement of GMMs in SR system development. This paper presents a method for Bangla SR using Deep Belief Network (DBN) which is probabilistic generative ANN composed by multiple layers of restricted Boltzmann machine along with HMM. At first Mel Frequency Cepstral Coefficients is used extract features from the speech data. Then DBN is trained with these feature vectors to calculate each of the phoneme states. After that Viterbi decoder is used to determine the resulting hidden state sequence that generates the word. The training of DBN is performed in two steps. At first generative pre-training is used to train the network layer by layer. In the second step, enhanced gradient is used to slightly adjust the model parameters to make it more accurate. Total 840 utterances (20 utterances for each of 42 speakers) of the words are used in this study. The proposed method is shown satisfactory recognition accuracy and outperformed other prominent existing methods.

[1]  Chin-Hui Lee,et al.  Speech Recognition and Production by Machines , 2015 .

[2]  Mouldi Bedda,et al.  Isolated Words Recognition System Based on Hybrid Approach DTW/GHMM , 2006, Informatica.

[3]  Sabyasachi Patra,et al.  Silence Removal and Endpoint Detection of Speech Signal for Text Independent Speaker Identification , 2014 .

[4]  Geoffrey E. Hinton,et al.  Phone Recognition with the Mean-Covariance Restricted Boltzmann Machine , 2010, NIPS.

[5]  James R. Glass,et al.  Developments and directions in speech recognition and understanding, Part 1 [DSP Education] , 2009, IEEE Signal Processing Magazine.

[6]  Kai Feng,et al.  The subspace Gaussian mixture model - A structured model for speech recognition , 2011, Comput. Speech Lang..

[7]  Yoshua Bengio,et al.  An empirical evaluation of deep architectures on problems with many factors of variation , 2007, ICML '07.

[8]  Xiaodong Cui,et al.  Stereo hidden Markov modeling for noise robust speech recognition , 2013, Comput. Speech Lang..

[9]  Gonzalo Joya,et al.  Hopfield neural networks for optimization: study of the different dynamics , 2002 .

[10]  Alexander J. Smola,et al.  Efficient mini-batch training for stochastic optimization , 2014, KDD.

[11]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[12]  J. S. Devi,et al.  Speaker Emotion Recognition based on Speech Features and Classification Techniques , 2014 .

[13]  Mohammad Nuruzzaman Bhuiyan,et al.  Automatic Speech Recognition Technique for Bangla Words , 2013 .

[14]  Ghulam Muhammad,et al.  Automatic speech recognition for Bangla digits , 2009, 2009 12th International Conference on Computers and Information Technology.

[15]  Md. Mijanur Rahman,et al.  Implementation Of Back-Propagation Neural Network For Isolated Bangla Speech Recognition , 2013, ArXiv.

[16]  Saloni,et al.  Classification of High Blood Pressure Persons Vs Normal Blood Pressure Persons Using Voice Analysis , 2013 .

[17]  Kuldip K. Paliwal,et al.  Scalable distributed speech recognition using Gaussian mixture model-based block quantisation , 2006, Speech Commun..

[18]  Steve Young,et al.  A review of large-vocabulary continuous-speech , 1996, IEEE Signal Process. Mag..

[19]  Ruben Grigoryan,et al.  Acoustic Modeling with Deep Belief Networks for Russian Speech Recognition , 2013, SPECOM.

[20]  Hossein Sameti,et al.  A novel approach to HMM-based speech recognition system using particle swarm optimization , 2009, 2009 Fourth International on Conference on Bio-Inspired Computing.

[21]  Geoffrey E. Hinton,et al.  Acoustic Modeling Using Deep Belief Networks , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[22]  Geoffrey E. Hinton.  Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[23]  Say Wei Foo,et al.  Speech emotion recognition using hidden Markov models , 2003, Speech Commun..