Speaker recognition based on short utterance compensation method of generative adversarial networks

On the basis of gaussian mixture model–universal background model (GMM–UBM) in the speaker recognition system, the paper proposes a short utterance sample compensation method based on the generative adversarial network (GAN) to solve the problem of the inadequate corpus data caused by short utterance, which has led to a serious reduction of recognition rate. The presented method compensates the short utterance samples into the speech samples with sufficient speaker identity information by completing the antagonistic training of generator network and discriminator network. In order to avoid the model crash and gradient instability in the process of GAN training, this paper adopts the condition information in the conditional GAN to guide the compensation process of the generator network, and proposes the generator compensation performance measurement training task and the feature tag training task of the discriminator to stabilize training process. Finally, the proposed short utterance compensation method is evaluated on the speaker recognition system based on GMM–UBM. The experimental results indicate that the presented method can effectively reduce the equal error rate of the speaker recognition system in short utterance environment.

[1]  Jr. J.P. Campbell,et al.  Speaker recognition: a tutorial , 1997, Proc. IEEE.

[2]  Hsin-Min Wang,et al.  Improving GMM-UBM speaker verification using discriminative feedback adaptation , 2009, Comput. Speech Lang..

[3]  Héctor M. Pérez Meana,et al.  Speaker recognition using Mel frequency Cepstral Coefficients (MFCC) and Vector quantization (VQ) techniques , 2012, CONIELECOMP 2012, 22nd International Conference on Electrical Communications and Computers.

[4]  John H. L. Hansen,et al.  Speaker Recognition by Machines and Humans: A tutorial review , 2015, IEEE Signal Processing Magazine.

[5]  Jie Yuan,et al.  A twice face recognition algorithm , 2016, Soft Comput..

[6]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[7]  Thomas Fang Zheng,et al.  Improving Short Utterance Speaker Recognition by Modeling Speech Unit Classes , 2016, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[8]  Hisashi Kawai,et al.  Conditional Generative Adversarial Nets Classifier for Spoken Language Identification , 2017, INTERSPEECH.

[9]  Niko Brümmer,et al.  Tied Variational Autoencoder Backends for i-Vector Speaker Recognition , 2017, INTERSPEECH.

[10]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Ghosheh Abed Hodtani,et al.  Where Does Minimum Error Entropy Outperform Minimum Mean Square Error? A New and Closer Look , 2018, IEEE Access.

[12]  Abeer Alwan,et al.  Deep neural network based i-vector mapping for speaker verification using short utterances , 2018, Speech Commun..

[13]  Tong Li,et al.  GMM and CNN Hybrid Method for Short Utterance Speaker Recognition , 2018, IEEE Transactions on Industrial Informatics.

[14]  J. Sueur Mel-Frequency Cepstral and Linear Predictive Coefficients , 2018 .

[15]  Mondher Frikha,et al.  New approach for short utterance speaker identification , 2018, IET Signal Process..