An Expressive Virtual Audiencewith Flexible Behavioral Styles

Currently, expressive virtual humans are used in psychological research, training, and psychotherapy. However, the behavior of these virtual humans is usually scripted and therefore cannot be modified freely at runtime. To address this, we created a virtual audience with parameterized behavioral styles. This paper presents a parameterized audience model based on probabilistic models abstracted from the observation of real human audiences (n = 16). The audience's behavioral style is controlled by model parameters that define virtual humans' moods, attitudes, and personalities. Employing these parameters as predictors, the audience model significantly predicts audience behavior. To investigate if people can recognize the designed behavioral styles generated by this model, 12 audience styles were evaluated by two groups of participants. One group (n = 22) was asked to describe the virtual audience freely, and the other group (n = 22) was asked to rate the audiences on eight dimensions. The results indicated that people could recognize different audience attitudes and even perceive the different degrees of certain audience attitudes. In conclusion, the audience model can generate expressive behavior to show different attitudes by modulating model parameters.

[1]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[2]  Yun Ling,et al.  Human perception of a conversational virtual human: an empirical study on the effect of emotion and culture , 2013, Virtual Reality.

[3]  Josiane Bissonnette,et al.  The effect of virtual training on music performance anxiety , 2011 .

[4]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[5]  C. Kirschbaum,et al.  The 'Trier Social Stress Test'--a tool for investigating psychobiological stress responses in a laboratory setting. , 1993, Neuropsychobiology.

[6]  Andrew J. Cowell,et al.  Manipulation of non-verbal interaction style and demographic embodiment to increase anthropomorphic computer character credibility , 2005, Int. J. Hum. Comput. Stud..

[7]  Dwi Hartanto,et al.  A virtual reality dialogue system for the treatment of social phobia , 2012, CHI Extended Abstracts.

[8]  Andrea Kleinsmith,et al.  Affective Body Expression Perception and Recognition: A Survey , 2013, IEEE Transactions on Affective Computing.

[9]  Abigail A. Scholer,et al.  Keeping up impressions: Inferential rules for impression change across the Big Five , 2007 .

[10]  S. Russel and P. Norvig,et al.  “Artificial Intelligence – A Modern Approach”, Second Edition, Pearson Education, 2003. , 2015 .

[11]  Stacy Marsella,et al.  Towards More Comprehensive Listening Behavior: Beyond the Bobble Head , 2011, IVA.

[12]  Amy Banic,et al.  Social responses to virtual humans: implications for future interface design , 2007, CHI.

[13]  Mel Slater,et al.  Building Characters: Lessons Drawn from Virtual Environments , 2005 .

[14]  Daniel Thalmann,et al.  Virtual reality as a therapeutic tool in the confines of social anxiety disorder treatment , 2006 .

[15]  Yuyu Xu,et al.  Perception Markup Language: Towards a Standardized Representation of Perceived Nonverbal Behaviors , 2012, IVA.

[16]  Richard G. Heimberg,et al.  Cognitive-Behavioral Group Therapy for Social Phobia: Basic Mechanisms and Clinical Strategies , 2002 .

[17]  Zhigang Deng,et al.  Rigid Head Motion in Expressive Speech Animation: Analysis and Synthesis , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[18]  M. van der Kooij,et al.  The effects of a Dutch version of an Internet-based treatment program for fear of public speaking: A controlled study , 2011 .

[19]  Louis-Philippe Morency,et al.  Virtual Rapport 2.0 , 2011, IVA.

[20]  Chris Barker,et al.  An Experiment on Public Speaking Anxiety in Response to Three Different Types of Virtual Audience , 2002, Presence: Teleoperators & Virtual Environments.

[21]  Nicola Döring,et al.  Designing Virtual Audiences for Fear of Public Speaking Training - An Observation Study on Realistic Nonverbal Behavior , 2012, Annual Review of Cybertherapy and Telemedicine.

[22]  Peter Norvig,et al.  Artificial intelligence - a modern approach, 2nd Edition , 2003, Prentice Hall series in artificial intelligence.

[23]  Michael J. Lambert,et al.  Bergin and Garfield's Handbook of Psychotherapy and Behavior Change , 2003 .

[24]  S. Hofmann,et al.  Cognitive Behavioral Therapy for Social Anxiety Disorder: Evidence-Based and Disorder-Specific Treatment Techniques , 2008 .

[25]  Paul M. G. Emmelkamp,et al.  Behavior therapy with adults , 1986 .

[26]  J. Allwood.  BODILY COMMUNICATION DIMENSIONS OF EXPRESSION AND CONTENT , 2002 .

[27]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[28]  Shelley E. Taylor,et al.  Effects of a supportive or an unsupportive audience on biological and psychological responses to stress. , 2010, Journal of personality and social psychology.

[29]  P. Lang.  International Affective Picture System (IAPS) : Technical Manual and Affective Ratings , 1995 .

[30]  Graham D. Bodie,et al.  Discovering the Listener Within Us: The Impact of Trait-Like Personality Variables and Communicator Styles on Preferences for Listening Style , 2007 .

[31]  Nexhmedin Morina,et al.  Virtual Reality Exposure Treatment of Agoraphobia: a Comparison of Computer Automatic Virtual Environment and Head-Mounted Display , 2011, Annual Review of Cybertherapy and Telemedicine.

[32]  W. Brinkman,et al.  Design and evaluation of a virtual reality exposure therapy system with automatic free speech interaction , 2011 .

[33]  Etienne de Sevin,et al.  A listener model: introducing personality traits , 2012, Journal on Multimodal User Interfaces.

[34]  Stacy Marsella,et al.  Predicting Speaker Head Nods and the Effects of Affective Information , 2010, IEEE Transactions on Multimedia.

[35]  Willem-Paul Brinkman,et al.  Using virtual reality to study paranoia in individuals with and without psychosis , 2011 .

[36]  Owen Kelly,et al.  Psychosocial Stress Evoked by a Virtual Audience: Relation to Neuroendocrine Activity , 2007, Cyberpsychology Behav. Soc. Netw..

[37]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[38]  Dwi Hartanto,et al.  Automatic Mechanisms for Measuring Subjective Unit of Discomfort , 2012, Annual Review of Cybertherapy and Telemedicine.

[39]  Chris Barker,et al.  An Experimental Study on Fear of Public Speaking Using a Virtual Environment , 2006, Cyberpsychology Behav. Soc. Netw..

[40]  K. Krippendorff.  Krippendorff, Klaus, Content Analysis: An Introduction to its Methodology . Beverly Hills, CA: Sage, 1980. , 1980 .

[41]  Mark B. Powers,et al.  Virtual reality exposure therapy for anxiety disorders: A meta-analysis. , 2008, Journal of anxiety disorders.

[42]  C ALEC POLLARD,et al.  Four Types of Social Phobia in a Community Sample , 1988, The Journal of nervous and mental disease.

[43]  Anastasios A. Economides,et al.  Affective Learning: Empathetic Agents with Emotional Facial and Tone of Voice Expressions , 2012, IEEE Transactions on Affective Computing.