Modelling an Italian talking head

Our goal is to create a natural Italian talking face with, in particular, lip-readable movements. Based on real data extracted from an Italian speaker with the ELITE system, we have approximated the data using radial basis functions. In this paper we present our 3D facial model based on MPEG-4 standard and our computational model of lip movements for Italian. Our experiment is based on some phoneticphonological considerations on the parameters defining labial orifice, and on identification tests of visual articulatory movements.

[1]  Mark Steedman,et al.  Generating Facial Expressions for Speech , 1996, Cogn. Sci..

[2]  Matthew Brand,et al.  Voice puppetry , 1999, SIGGRAPH.

[3]  Piero Cosi,et al.  Statistical Definition of Visual Information for Italian Vowels and Consonants , 1998, AVSP.

[4]  Stephen Michael Platt,et al.  A structural model of the human face (graphics, animation, object representation) , 1985 .

[5]  Bertrand Le Goff,et al.  A French-speaking synthetic head , 1997, AVSP.

[6]  Thierry Guiard-Marigny,et al.  3D Models of the Lips and Jaw for Visual Speech Synthesis , 1997 .

[7]  Michael M. Cohen,et al.  Modeling Coarticulation in Synthetic Visual Speech , 1993 .

[8]  Anders Löfqvist,et al.  Speech as Audible Gestures , 1990 .

[9]  Fabio Lavagetto,et al.  MPEG-4: Audio/video and synthetic graphics/audio for mixed media , 1997, Signal Process. Image Commun..

[10]  Frederick I. Parke,et al.  Computer generated animation of faces , 1972, ACM Annual Conference.

[11]  Piero Cosi,et al.  Italian consonantal visemes: relationships between spatial/ temporal articulatory characteristics and coproduced acoustic signal , 1997, AVSP.

[12]  Cinzia Avesani,et al.  Festival speaks Italian! , 2001, INTERSPEECH.

[13]  Jonas Beskow,et al.  Rule-based visual speech synthesis , 1995, EUROSPEECH.

[14]  Eric Vatikiotis-Bateson,et al.  The Dynamics of Audiovisual Behavior in Speech , 1996 .

[15]  Christoph Bregler,et al.  Video Rewrite: Driving Visual Speech with Audio , 1997, SIGGRAPH.

[16]  Jörn Ostermann,et al.  Animation of synthetic faces in MPEG-4 , 1998, Proceedings Computer Animation '98 (Cat. No.98EX169).

[17]  Catherine Pelachaud,et al.  Behavior Planning for a Reflexive Agent , 2001, IJCAI.