Articulatory speech synthesis based upon fluid dynamic principles

In this paper, an articulatory speech synthesizer based on fluid dynamic principles is presented. The key idea is to devise a refined speech production model based on the most fundamental physics of the human vocal apparatus. Our articulatory synthesizer essentially contains two parts: a vocal fold model which represents the excitation source and a vocal tract model, which describes the positions of articulators. First, we propose a combined minimum error and minimum jerk criterion to estimated the moving vocal tract shapes during speech production. Second, we propose a nonlinear mechanical model to generate the vocal fold excitation signals. Finally, a computational fluid dynamics (CFD) approach is used to solve the Reynolds-averaged Navier-Stokes (RANS) equations, which are the governing equations of speech production inside vocal apparatus. Experimental results show that our system can synthesize intelligible continuous speech sentences while naturally handling the co-articulation effects during speech production.

[1]  Ingo R. Titze,et al.  Principles of voice production , 1994 .

[2]  C.H. Coker,et al.  A model of articulatory dynamics and control , 1976, Proceedings of the IEEE.

[3]  J. L. Flanagan,et al.  Synthesis of speech from a dynamic model of the vocal cords and vocal tract , 1975, The Bell System Technical Journal.

[4]  D H Klatt,et al.  Review of text-to-speech conversion for English. , 1987, The Journal of the Acoustical Society of America.

[5]  S E Levinson,et al.  Adaptive computation of articulatory parameters from the speech signal. , 1982, The Journal of the Acoustical Society of America.

[6]  Marc C. Beutnagel,et al.  The AT & T NEXT-GEN TTS system , 1999 .