Voice morphing based on spectral features and prosodic modification

This paper is aimed at morphing the speech uttered by a source speaker in a manner that it seems to be spoken by another target speaker - a new identity is given while preserving the original content. The proposed method transforms the vocal tract parameters and glottal excitation of the source speaker into target speaker's acoustic characteristics. It relates to the development of appropriate vocal tract models that can capture information specific to the speaker and estimate the model parameters that closely relate to the model of the target speaker. It detects the pitch, separates the glottal excitation and vocal tract spectral features. The glottal excitation of the source is taken, voice/un-voice decision is made, the prosody information is found, PSOLA (Pitch Synchronous OverLap Add) is used to modify the pitch, the spectral features are found, and finally speech is modified using target spectral features and prosody. The subjective experiment shows that the proposed method improves the quality of conversion and contains the original vocal and glottal characteristics of the target speaker.

[1]  Jia Liu,et al.  An improved method for voice conversion based on Gaussian mixture model , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[2]  Kimihito TANAKA,et al.  A new fundamental frequency modification algorithm with transformation of spectrum envelope according to F/sub 0/ , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Aman Chadha,et al.  Analysis of a Modern Voice Morphing Approach using Gaussian Mixture Models for Laryngectomees , 2012, ArXiv.

[4]  Namrata Dave,et al.  Feature Extraction Methods LPC, PLP and MFCC In Speech Recognition , 2013 .

[5]  Mukesh A. Zaveri,et al.  Complex Cepstrum Based Voice Conversion Using Radial Basis Function , 2014 .

[6]  Allam Mousa,et al.  Voice Conversion Using Pitch Shifting Algorithm by Time Stretching with PSOLA and Re-Sampling , 2010 .

[7]  Gang Xu,et al.  STRAIGHT model for voice conversion based on acoustical universal structure , 2012, 2012 International Conference on Audio, Language and Image Processing.

[8]  Levent M. Arslan,et al.  Speaker Transformation Algorithm using Segmental Codebooks (STASC) , 1999, Speech Commun..

[9]  Jianwu Dang,et al.  An investigation of dependencies between frequency components and speaker characteristics for text-independent speaker identification , 2008, Speech Commun..

[10]  Mukesh Zaveri,et al.  Cepstrum liftering based voice conversion using RBF and GMM , 2013, 2013 International Conference on Communication and Signal Processing.

[11]  Stephen J. Roberts,et al.  Multiscale Voice Morphing Using Radial Basis Function Analysis , 2007 .