Symbiotic value of an embodied agent in language learning

Our perception and understanding are influenced by a speaker's face and accompanying gestures, as well as the actual sound of the speech. Given the value of face-to-face interaction, our persistent goal has been to develop, evaluate, and use animated agents to teach speech and language. Baldi/spl reg/ is an accurate three-dimensional agent appropriately aligned with either synthesized or natural speech. We describe our language-training program, which utilizes Baldi as a tutor, who guides students through a variety of exercises designed to teach vocabulary and grammar, to improve speech articulation, and to develop linguistic and phonological awareness.

[1]  Henk Sol,et al.  Proceedings of the 54th Hawaii International Conference on System Sciences , 1997, HICSS 2015.

[2]  Jonas Beskow,et al.  Recent Developments In Facial Animation: An Inside View , 1998, AVSP.

[3]  G. Plant.  Perceiving Talking Faces: From Speech Perception to a Behavioral Principle , 1999 .

[4]  Dominic W. Massaro,et al.  The processing of information from multiple sources in simultaneous interpreting , 2000 .

[5]  Julie Marie Wood,et al.  Can software support children's vocabulary development? , 2001 .

[6]  Jonas Beskow,et al.  Developing and evaluating conversational agents , 2001 .

[7]  S. Trychin.  Guidelines for Providing Mental Health Services to People Who Are Hard of Hearing. , 2002 .

[8]  Margaret G. McKeown,et al.  Bringing Words to Life: Robust Vocabulary Instruction , 2002 .

[9]  Dominic W. Massaro,et al.  Training a talking head , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[10]  Sandra R. Waxman,et al.  Early Word‐Learning and Conceptual Development: Everything had a Name, and Each Name Gave Birth to a New Thought , 2007 .

[11]  U. Goswami.  Blackwell handbook of childhood cognitive development , 2002 .

[12]  D. Massaro,et al.  Development and Evaluation of a Computer-Animated Tutor for Vocabulary and Language Learning in Children with Autism , 2003, Journal of autism and developmental disorders.

[13]  Dominic W. Massaro,et al.  Development and Evaluation of a Computer-Animated Tutor for Language and Vocabulary Learning , 2003 .

[14]  Dominic W. Massaro,et al.  Read my tongue movements: bimodal learning to perceive and produce non-native speech /r/ and /l/ , 2003, INTERSPEECH.

[15]  Slim Ouni,et al.  Internationalization of a Talking Head , 2003 .

[16]  L. Barker,et al.  Computer-Assisted Vocabulary Acquisition: The CSLU Vocabulary Tutor in Oral-Deaf Education. , 2003, Journal of deaf studies and deaf education.

[17]  Dominic W. Massaro,et al.  Improving the Vocabulary of Children with Hearing Loss , 2004 .