Voice Activity Detection Scheme by Combining DNN Model with GMM Model

Due to the superior modeling ability of deep neural network (DNN), it is widely used in voice activity detection (VAD). However, the performance may degrade if no sufficient data especially for practical data could be used for training, thus, leading to inferior ability of adaption to environment. Moreover, large model structure could not always be used in practical, especially for low cost devices where restricted hardware is used. This is on the contrary for Gaussian mixture model (GMM) where model parameters can be updated in real-time, but, with low modeling ability. In this paper, deeply integrated scheme combining these two models are proposed to improve adaptability and modeling ability. This is done by directly combining the results of models and feeding it back, together with the result of the DNN model, to update the GMM model. Besides, a control scheme is elaborately designed to detect the endpoints of speech. The superior performance by employing this scheme is validated through experiments in practical, which give an insight into the advantage of combining supervised learning and unsupervised learning.

[1]  Jing Yang,et al.  3-D Convolutional Recurrent Neural Networks With Attention Model for Speech Emotion Recognition , 2018, IEEE Signal Processing Letters.

[2]  Werner Verhelst,et al.  On Noise Robust Voice Activity Detection , 2011, INTERSPEECH.

[3]  Bmsce,et al.  Real Time Communication using WebRTC , 2018 .

[4]  Xiaoling Yang,et al.  Comparative Study on Voice Activity Detection Algorithm , 2010, 2010 International Conference on Electrical and Control Engineering.

[5]  J. Takahashi,et al.  Phonetically adaptive cepstrum mean normalization for acoustic mismatch compensation , 1997, 1997 IEEE Workshop on Automatic Speech Recognition and Understanding Proceedings.

[6]  Deepti Singh,et al.  Voice activity detection , 2007, CROS.

[7]  Jianwu Dang,et al.  Voice Activity Detection Based on an Unsupervised Learning Framework , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[8]  Haytham Ali Real-time Communication Using WebRTC , 2018 .