Application of Educational Emotion Inference via Speech and Agent Interaction

This paper brings together speech recognition, emotion inference and virtual agents to implement a system for student interaction in an educational environment. By analyzing the capture speech, we can perceive an indication of the emotion status of the target student. Using the inference results, an agent can choose the suitable dialogue to interact with the student. Our experiments indicate that there is a lot of potential for such a system to be applied in other situations as well.

[1]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[2]  Rosalind W. Picard.  Affective computing: challenges , 2003, Int. J. Hum. Comput. Stud..

[3]  Jennifer Healey,et al.  Digital processing of affective signals , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[4]  Frank van Harmelen,et al.  Ontology languages for the Semantic Web , 2005 .

[5]  Hsin-Hsi Chen,et al.  Emotion Classification of Online News Articles from the Reader's Perspective , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[6]  Dedre Gentner,et al.  Structure-Mapping: A Theoretical Framework for Analogy , 1983, Cogn. Sci..

[7]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[8]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[9]  Barbara Barry,et al.  Beating Some Common Sense into Interactive Applications , 2003 .

[10]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[11]  George N. Votsis,et al.  Emotion recognition in human-computer interaction , 2001, IEEE Signal Process. Mag..

[12]  Frank K. Soong,et al.  An HMM-Based Mandarin Chinese Text-To-Speech System , 2006, ISCSLP.

[13]  Rosalind W. Picard.  Toward computers that recognize and respond to user emotion , 2000, IBM Syst. J..

[14]  Jonathan Klein,et al.  This computer responds to user frustration , 1999, CHI Extended Abstracts.

[15]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.