Experimental Results of Affective Valence and Arousal to Avatar's Facial Expressions

The objectives of this study were to propose a method of presenting dynamic facial expressions to experimental subjects, in order to investigate human perception of avatar's facial expressions of different levels of emotional intensity. The investigation concerned how perception varies according to the strength of facial expression, as well as according to an avatar's gender. To accomplish these goals, we generated a male and a female virtual avatar with five levels of intensity of happiness and anger using a morphing technique. We then recruited 16 normal healthy subjects and measured each subject's emotional reaction by scoring affective arousal and valence after showing them the avatar's face. Through this study, we were able to investigate human perceptual characteristics evoked by male and female avatars' graduated facial expressions of happiness and anger. In addition, we were able to identify that a virtual avatar's facial expression could affect human emotion in different ways according to the avatar's gender and the intensity of its facial expressions. However, we could also see that virtual faces have some limitations because they are not real, so subjects recognized the expressions well, but were not influenced to the same extent. Although a virtual avatar has some limitations in conveying its emotion using facial expressions, this study is significant in that it shows that a new potential exists to use or manipulate emotional intensity by controlling a virtual avatar's facial expression linearly using a morphing technique. Therefore, it is predicted that this technique may be used for assessing emotional characteristics of humans, and may be of particular benefit for work with people with emotional disorders through a presentation of dynamic expression of various emotional intensities.

[1]  Ralph Schroeder.  The Social Life of Avatars , 2002, Computer Supported Cooperative Work.

[2]  Dong Pyo Jang,et al.  The Effect of Virtual Reality Cognitive Training for Attention Enhancement , 2002, Cyberpsychology Behav. Soc. Netw..

[3]  A J Shinkfield,et al.  Recognition of facial emotional expressions from moving and static displays by individuals with mental retardation. , 1999, American journal of mental retardation : AJMR.

[4]  Brenda K. Wiederhold,et al.  A Virtual Environment for Investigating Schizophrenic Patients' Characteristics: Assessment of Cognitive and Navigation Ability , 2003, Cyberpsychology Behav. Soc. Netw..

[5]  Frank Biocca,et al.  The Effect of the Agency and Anthropomorphism on Users' Sense of Telepresence, Copresence, and Social Presence in Virtual Environments , 2003, Presence: Teleoperators & Virtual Environments.

[6]  Shigeo Morishima,et al.  Modeling of Facial Expression and Emotion for Human Communication System Displays , 1996 .

[7]  Steven Kerr,et al.  The AS interactive project: single-user and collaborative virtual environments for people with high-functioning autistic spectrum disorders , 2003, Comput. Animat. Virtual Worlds.

[8]  E. Naito,et al.  Enhanced neural activity in response to dynamic facial expressions of emotion: an fMRI study. , 2004, Brain research. Cognitive brain research.

[9]  Dong Pyo Jang,et al.  The development of virtual reality therapy (VRT) system for the treatment of acrophobia and therapeutic case , 2002, IEEE Transactions on Information Technology in Biomedicine.

[10]  Thomas C. Meyer,et al.  Presence as the Defining Factor in a VR Application , 1994 .

[11]  Andrew C. Beall,et al.  Three dimensional spatial memory and learning in real and virtual environments , 2001, Spatial Cogn. Comput..

[12]  Ruben C. Gur,et al.  Facial recognition deficits and cognition in schizophrenia , 2004, Schizophrenia Research.

[13]  Jeonghun Ku,et al.  A Virtual Reality System for the Assessment and Rehabilitation of the Activities of Daily Living , 2003, Cyberpsychology Behav. Soc. Netw..

[14]  Albert A. Rizzo,et al.  The Virtual Classroom: A Virtual Reality Environment for the Assessment and Rehabilitation of Attention Deficits , 2000, Cyberpsychology Behav. Soc. Netw..

[15]  Paul N Kizakevich,et al.  Lessons learned in modeling virtual pediatric patients. , 2003, Studies in health technology and informatics.

[16]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[17]  Dong Pyo Jang,et al.  The treatment of fear of flying: a controlled study of imaginal and virtual reality graded exposure therapy , 2002, IEEE Transactions on Information Technology in Biomedicine.

[18]  A. Berthoz,et al.  Navigating in a virtual three-dimensional maze: how do egocentric and allocentric reference frames interact? , 2004, Brain research. Cognitive brain research.

[19]  James Townsend,et al.  Making faces: Creating three-dimensional parameterized models of facial expression , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[20]  J. Loomis,et al.  Interpersonal Distance in Immersive Virtual Environments , 2003, Personality & social psychology bulletin.

[21]  J. Russell.  A circumplex model of affect. , 1980 .