The effects of virtual characters on audiences' movie experience

In this paper, we first present a new audience-participating movie form in which 3D virtual characters of audiences are constructed by computer graphics (CG) technologies and are embedded into a in a pre-rendered movie as different roles. Then, we investigate how the audiences respond to these virtual characters using physiological and subjective evaluation methods. To facilitate the investigation, we present three versions of a movie to an audience-a Traditional version, its SDIM version with the participation of the audience's virtual character, and its SFDIM version with the co-participation of the audience and her/his friends' virtual characters. The subjective evaluation results show that the participation of virtual characters indeed causes increased subjective sense of spatial presence and engagement, and emotional reaction; moreover, SFDIM performs significantly better than SDIM, due to the co-participation of friends' virtual characters. Also, we find that the audiences experience not only significantly different galvanic skin response (GSR) changes on average-changing trend over time and number of fluctuations-but they also show the increased phasic GSR responses to the appearance of their own or friends' virtual 3D characters on the screen. The evaluation results demonstrate the success of the new audience-participating movie form and contribute to understanding how people respond to virtual characters in a role-playing entertainment interface.

[1]  Marc Cavazza,et al.  Interacting with virtual characters in interactive storytelling , 2002, AAMAS '02.

[2]  Cheryl Campanella Bracken,et al.  Telepresence and Video Games: The Impact of Image Quality , 2009, PsychNology J..

[3]  Timothy Bickmore,et al.  Taking the time to care: empowering low health literacy hospital patients with virtual nurse agents , 2009, CHI.

[4]  Joseph Bates,et al.  Dramatic Presence , 1993, Presence: Teleoperators & Virtual Environments.

[5]  Susan Persky,et al.  The Independent and Interactive Effects of Embodied-Agent Appearance and Behavior on Self-Report, Cognitive, and Behavioral Markers of Copresence in Immersive Virtual Environments , 2005, Presence: Teleoperators & Virtual Environments.

[6]  Catherine C. Marshall,et al.  Designing Qualitative Research , 1996 .

[7]  Luca Chittaro,et al.  Supporting presentation techniques based on virtual humans in educational virtual worlds , 2005, 2005 International Conference on Cyberworlds (CW'05).

[8]  Nicolas Szilas,et al.  The future of interactive drama , 2005 .

[9]  Jonathan Freeman,et al.  A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory , 2001, Presence: Teleoperators & Virtual Environments.

[10]  Jonathan P. Rowe,et al.  The effects of empathetic virtual characters on presence in narrative-centered learning environments , 2008, CHI.

[11]  P. Lang.  Behavioral treatment and bio-behavioral assessment: computer applications , 1980 .

[12]  S. Lao,et al.  A Fast and Robust Automatic Face Alignment System , 2005 .

[13]  Rinat B. Rosenberg-Kima,et al.  Interface agents as social models: the impact of appearance on females' attitude toward engineering , 2006, CHI Extended Abstracts.

[14]  Amy Banic,et al.  Social responses to virtual humans: implications for future interface design , 2007, CHI.

[15]  Robert D. Ward,et al.  Physiological responses to different WEB page designs , 2003, Int. J. Hum. Comput. Stud..

[16]  Jeremy N. Bailenson,et al.  A meta-analysis of the impact of the inclusion and realism of human-like faces on user experiences in interfaces , 2007, CHI.

[17]  Regan L. Mandryk,et al.  Using psychophysiological techniques to measure user experience with entertainment technologies , 2006, Behav. Inf. Technol..

[18]  Judy Brown,et al.  Changing the virtual self: avatar transformations in popular games , 2006 .

[19]  Paul Skalski,et al.  The Role of Presence in the Experience of Electronic Games , 2004 .

[20]  Sung Yong Shin,et al.  Scattered Data Interpolation with Multilevel B-Splines , 1997, IEEE Trans. Vis. Comput. Graph..

[21]  P. Lang.  The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[22]  N. Simionescu,et al.  The Cardiovascular System , 1983 .

[23]  Gavin J. Sade,et al.  Proceedings of the Sixth Australasian Conference on Interactive Entertainment , 2008 .

[24]  Penelope M. Sanderson,et al.  Exploratory sequential data analysis: exploring continuous observational data , 1996, INTR.

[25]  M. Angela Sasse,et al.  Do Users Always Know What's Good For Them? Utilising Physiological Responses to Assess Media Quality , 2000, BCS HCI.

[26]  Gm Wilson,et al.  Investigating the impact of audio degradations on users: subjective vs objective assessment methods , 2000 .

[27]  RavajaNiklas,et al.  Spatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play? , 2006 .

[28]  Marc M. Sebrechts,et al.  A gaze contingent environment for fostering social attention in autistic children , 2004, ETRA.

[29]  Randy J. Pagulayan,et al.  User-centered design in games , 2012 .

[30]  Marko Turpeinen,et al.  Spatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play? , 2006, PRESENCE: Teleoperators and Virtual Environments.

[31]  Andrew Stern,et al.  Façade: An Experiment in Building a Fully-Realized Interactive Drama , 2003 .

[32]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[33]  Regan L. Mandryk,et al.  A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies , 2007, Int. J. Hum. Comput. Stud..

[34]  Byron Reeves,et al.  Computer agents versus avatars: Responses to interactive game characters controlled by a computer or other player , 2010, Int. J. Hum. Comput. Stud..

[35]  P. Vorderer,et al.  (8) Constructing Presence: Towards a two-level model of the formation of Spatial Presence experiences , 2003 .

[36]  James M. King,et al.  Effects of arousal level and below-zero habituation training on the spontaneous recovery and dishabituation of the orienting response , 1977 .

[37]  Amy L. Baylor,et al.  The Impact of Pedagogical Agent Image on Affective Outcomes , 2004 .

[38]  R. Zajonc.  SOCIAL FACILITATION. , 1965, Science.

[39]  M. Kawade.  Vision-based face understanding technologies and applications , 2002, Proceedings of 2002 International Symposium on Micromechatronics and Human Science.

[40]  A. L. Baylor,et al.  A Social-Cognitive Framework for Pedagogical Agents as Learning Companions , 2006 .

[41]  Manfred Tscheligi,et al.  Proceedings of the international conference on Advances in computer entertainment technology , 2007, ACE 2008.

[42]  Ming-Hsuan Yang,et al.  Gender classification using support vector machines , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[43]  Nur Arad,et al.  Image Warping Using Few Anchor Points and Radial Functions , 1995, Comput. Graph. Forum.

[44]  Mark Blythe,et al.  Funology:From Usability to Enjoyment , 2003 .

[45]  Mel Slater,et al.  Body Centred Interaction in Immersive Virtual Environments , 1994 .

[46]  Bao-Liang Lu,et al.  Gender Recognition Using a Min-Max Modular Support Vector Machine , 2005, ICNC.

[47]  Johanna D. Moore,et al.  Proceedings of the Conference on Human Factors in Computing Systems , 1989 .

[48]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[49]  Dell Zhang,et al.  Question classification using support vector machines , 2003, SIGIR.

[50]  J. Bryant,et al.  Playing video games: Motives, responses, and consequences. , 2012 .

[51]  Byron Reeves,et al.  The effects of animated characters on anxiety, task performance, and evaluations of user interfaces , 2000, CHI.

[52]  Zhigang Deng,et al.  Can local avatars satisfy a global audience? A case study of high-fidelity 3D facial avatar animation in subject identification and emotion perception by US and international groups , 2009, CIE.

[53]  Yukinori Matsumoto,et al.  Multicamera 3D modeling system to digitize human head and body , 2001, IS&T/SPIE Electronic Imaging.

[54]  Regan L. Mandryk,et al.  A continuous and objective evaluation of emotional experience with interactive play environments , 2006, CHI.

[55]  P C Molenaar,et al.  Heart rate and sustained attention during childhood: age changes in anticipatory heart rate, primary bradycardia, and respiratory sinus arrhythmia. , 1994, Psychophysiology.

[56]  J. E. Rose,et al.  Autonomic Nervous System Activity Distinguishes Among Emotions , 2009 .

[57]  J. Cacioppo,et al.  Principles of psychophysiology : physical, social, and inferential elements , 1990 .

[58]  Larry F. Hodges,et al.  Can a virtual cat persuade you?: the role of gender and realism in speaker persuasiveness , 2006, CHI.

[59]  C. F. Bond,et al.  Social facilitation: a meta-analysis of 241 studies. , 1983, Psychological bulletin.

[60]  Sharif Razzaque,et al.  The Responses of People to Virtual Humans in an Immersive Virtual Environment , 2005, Presence: Teleoperators & Virtual Environments.

[61]  Frank Biocca,et al.  The Cyborg's Dilemma: Progressive Embodiment in Virtual Environments , 2006, J. Comput. Mediat. Commun..

[62]  J. Andreassi.  Psychophysiology: Human Behavior and Physiological Response , 1980 .

[63]  Susanne van Mulken,et al.  The impact of animated interface agents: a review of empirical research , 2000, Int. J. Hum. Comput. Stud..

[64]  Julie A. Jacko,et al.  Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications, Third Edition , 2012 .

[65]  Kyle Johnsen,et al.  Experiences in using immersive virtual characters to educate medical communication skills , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[66]  Manolya Kavakli,et al.  An implementation of real-time 3D interactive drama , 2007, CIE.

[67]  N. Ravaja.  Contributions of Psychophysiology to Media Research: Review and Recommendations , 2004 .

[68]  Henry Been-Lirn Duh,et al.  Understanding social interaction in world of warcraft , 2007, ACE '07.

[69]  Mel Slater,et al.  Building Characters: Lessons Drawn from Virtual Environments , 2005 .