TOWARD REAL-TIME PHYSICALLY-BASED VOICE SIMULATION: AN EIGENMODE-BASED APPROACH.

While physically-based continuum models of voice production have potential applications in clinical intervention of voice disorders and personalized natural speech synthesis, their current use is limited due to the high computational cost associated with resolving the complex fluid-structure interaction during voice production process. The goal of this study is to summarize recent efforts in developing a physically-based, computationally-efficient continuum model of voice production toward near real-time applications. The model uses an eigenmode-based formulation of the governing equations, in which vocal fold eigen-modes are used as building blocks to reconstruct more complex vocal fold vibration patterns. Simulations show that a reasonable accuracy in the fundamental frequency, vocal intensity, and selected spectral measures can be reached with the use of the first 100 vocal fold eigenmodes, thus significantly reducing the degrees of freedom of the governing equations (as compared to tens of thousands i...

[1]  J. Flanagan,et al.  Synthesis of voiced sounds from a two-mass model of the vocal cords , 1972 .

[2]  Juergen Neubauer,et al.  On the acoustical relevance of supraglottal flow structures to low-frequency voice production. , 2010, The Journal of the Acoustical Society of America.

[3]  Zhaoyan Zhang,et al.  Laryngeal muscular control of vocal fold posturing: Numerical modeling and experimental validation. , 2016, The Journal of the Acoustical Society of America.

[4]  Luc Mongeau,et al.  Experimental verification of the quasi-steady approximation for aerodynamic sound generation by pulsating jets in tubes. , 2002, The Journal of the Acoustical Society of America.

[5]  van Rr René Hassel,et al.  Theoretical and experimental study of quasisteady‐flow separation within the glottis during phonation. Application to a modified two‐mass model , 1994 .

[6]  Xavier Pelorson,et al.  An in vitro setup to test the relevance and the accuracy of low-order vocal folds models. , 2007, The Journal of the Acoustical Society of America.

[7]  Zhaoyan Zhang,et al.  A computational study of the effect of intraglottal vortex-induced negative pressure on vocal fold vibration. , 2014, The Journal of the Acoustical Society of America.

[8]  Rafael Laboissière,et al.  Effects of higher order propagation modes in vocal tract like geometries. , 2015, The Journal of the Acoustical Society of America.

[9]  Peter Birkholz,et al.  The contribution of phonation type to the perception of vocal emotions in German: an articulatory synthesis study. , 2015, The Journal of the Acoustical Society of America.

[10]  Janet Slifka,et al.  Some physiological correlates to regular and irregular phonation at the end of an utterance. , 2006, Journal of voice : official journal of the Voice Foundation.

[11]  Zhaoyan Zhang,et al.  Experimental validation of a three-dimensional reduced-order continuum model of phonation. , 2016, The Journal of the Acoustical Society of America.

[12]  Zhaoyan Zhang,et al.  Respiratory Laryngeal Coordination in Airflow Conservation and Reduction of Respiratory Effort of Phonation. , 2016, Journal of voice : official journal of the Voice Foundation.

[13]  I. Titze,et al.  Voice simulation with a body-cover model of the vocal folds. , 1995, The Journal of the Acoustical Society of America.

[14]  Yves Laprie,et al.  Extension of the single-matrix formulation of the vocal tract: Consideration of bilateral channels and connection of self-oscillating models of the vocal folds with a glottal chink , 2016, Speech Commun..

[15]  Shinji Maeda,et al.  A digital simulation method of the vocal-tract system , 1982, Speech Commun..

[16]  Zhaoyan Zhang Regulation of glottal closure and airflow in a three-dimensional phonation model: implications for vocal intensity control. , 2015, The Journal of the Acoustical Society of America.

[17]  Anders Löfqvist,et al.  Vocal tract aerodynamics in /aCa/ utterances: Simulations , 1995, Speech Commun..

[18]  Zhaoyan Zhang,et al.  Asymmetric vibration in a two-layer vocal fold model with left-right stiffness asymmetry: experiment and simulation. , 2012, The Journal of the Acoustical Society of America.

[19]  Zhaoyan Zhang Mechanics of human voice production and control. , 2016, The Journal of the Acoustical Society of America.

[20]  I. Titze,et al.  A theoretical study of the effects of various laryngeal configurations on the acoustics of phonation. , 1979, The Journal of the Acoustical Society of America.