Stand-alone application of user-specific emotion recognition model to improve real-time online voice communication using expressive avatar

One of the objectives of this research is to explore and investigate on how to improve online voice communication. We use our previously developed user-specific emotion recognition model to recognize user's emotion during communication and then to express it using an avatar to show to the partner. Another objective is to investigate the performance of our model in real-time environment using a stand-alone application developed by a party who is not proficient with emotion recognition. The results were: the said party can develop a stand-alone application despite not having much knowledge on emotion recognition using our model, and that real-time recognition can be achieved. The questionnaire results from the subjects also suggest that using expressive avatar improves communication, and that user-specific approach gives better performance compared to general approach.

[1]  P. Ekman,et al.  Facial action coding system , 2019 .

[2]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Tieniu Tan,et al.  Affective Computing: A Review , 2005, ACII.

[4]  John R. Koza,et al.  Genetic programming 2 - automatic discovery of reusable programs , 1994, Complex Adaptive Systems.

[5]  Ivan Tanev,et al.  Evolving Emotion Recognition Module for Intelligent Agent , 2015 .

[6]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[7]  Todd Rose,et al.  The End of Average , 2015 .

[8]  Yongzhao Zhan,et al.  Using Kinect for real-time emotion recognition via facial expressions , 2015, Frontiers of Information Technology & Electronic Engineering.

[9]  Rosalind W. Picard Affective Computing , 1997 .

[10]  Ivan Tanev,et al.  Designing Evolving Computer Agent Capable of Emotion Recognition and Expression , 2014, AAAI Spring Symposia.

[11]  B. Matthews Comparison of the predicted and observed secondary structure of T4 phage lysozyme. , 1975, Biochimica et biophysica acta.

[12]  Ivan Tanev,et al.  Application of genetic programming and genetic algorithm in evolving emotion recognition module , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[13]  Jeffrey F. Cohn,et al.  Foundations of human computing: facial expression and emotion , 2006, ICMI '06.

[14]  Jörgen Ahlberg AN UPDATED PARAMETERISED FACE , 2001 .