The Subjective Sense of Presence, Emotion Recognition, and Experienced Emotions in Auditory Virtual Environments

Realistic aural rendering of events in mediated environments is becoming an increasingly important aspect in many multi-modal applications. In a between-group experiment with 45 participants, it was studied how ratings of presence (a sense of being in the mediated environment), emotional reactions to the auditory environment, and emotion recognition vary as a function of number of audio channels (mono, stereo, and six-channel reproduction). The results showed that stereo and six-channel reproduction resulted in significantly stronger changes in emotional reactions than the mono condition. Further, six-channel reproduction received the highest ratings of presence and emotional realism. Taken together, the result suggested that both emotional reactions and ratings of presence increase with spatialized sound. Further, emotional reactions and presence were highly correlated. The results are discussed in relation to theories of mediated presence and emotional reactions in an attempt to further delineate the concept of presence.

[1]  P. Lang.  The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[2]  David M. Clark,et al.  On the induction of depressed mood in the laboratory: Evaluation and comparison of the velten and musical procedures , 1983 .

[3]  M. Bradley,et al.  Affective reactions to acoustic stimuli. , 2000, Psychophysiology.

[4]  Scott D. Lipscomb,et al.  Perceptual judgement of the relationship between musical and visual components in film. , 1994 .

[5]  S. Thomas Elder,et al.  A Psychophysiological Comparison of the Velten and Musical Mood Induction Techniques , 1989 .

[6]  Mendel Kleiner,et al.  Auralization-An Overview , 1993 .

[7]  E. Tan.  Emotion and the structure of narrative film , 1996 .

[8]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[9]  Daniel Västfjäll,et al.  Emotion and Auditory Virtual Environments: Affect-Based Judgments of Music Reproduced with Virtual Reverberation Times , 2002, Cyberpsychology Behav. Soc. Netw..

[10]  C. Camp,et al.  Musical mood induction: an alternative to the Velten technique. , 1986, Journal of abnormal psychology.

[11]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[12]  R. Simons,et al.  Affective response to color-slide stimuli in subjects with physical anhedonia: a three-systems analysis. , 2007, Psychophysiology.

[13]  Woodrow Barfield,et al.  The Sense of Presence within Auditory Virtual Environments , 1996, Presence: Teleoperators & Virtual Environments.

[14]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[15]  Pamela Kenealy,et al.  Validation of a music mood induction procedure: Some preliminary findings , 1988 .

[16]  Qingwen Dong,et al.  The Effects of Emotional Arousal and Valence on Television Viewers' Cognitive Capacity and Memory. , 1995 .

[17]  Elizabeth M. Wenzel,et al.  Localization in Virtual Acoustic Displays , 1992, Presence: Teleoperators & Virtual Environments.

[18]  Stephen R. Ellis,et al.  Presence of Mind:A Reaction to Thomas Sheridan's Further Musings on the Psychophysics of Presence , 1996, Presence: Teleoperators & Virtual Environments.

[19]  R. Simons,et al.  Image motion and context: a between- and within-subjects comparison. , 2000, Psychophysiology.

[20]  J. Westwood,et al.  Medicine meets virtual reality : the convergence of physical & informational technologies : options for a new era in healthcare , 1999 .

[21]  F. Albersnagel,et al.  Velten and musical mood induction procedures: a comparison with accessibility of thought associations. , 1988, Behaviour research and therapy.

[22]  Jonathan Freeman,et al.  Here, there and everywhere: The effects of multichannel audio on presence , 2001 .

[23]  N. Frijda.  The laws of emotion. , 1988, The American psychologist.

[24]  Thomas B. Sheridan.  Further Musings on the Psychophysics of Presence , 1996, Presence: Teleoperators & Virtual Environments.

[25]  J. Persons,et al.  Longitudinal study of cognitions, life events, and depression in psychiatric inpatients. , 1985, Journal of abnormal psychology.

[26]  James Price Dillard,et al.  Communication and Affect , 1993 .

[27]  Daniel Västfjäll,et al.  ECOLOGICAL ACOUSTICS AND THE MULTI-MODAL PERCEPTION OF ROOMS: REAL AND UNREAL EXPERIENCES OF AUDITORY-VISUAL VIRTUAL ENVIRONMENTS , 2001 .

[28]  W. Gerrod Parrott,et al.  Mood induction and instructions to sustain moods: A test of the subject compliance hypothesis of mood congruent memory , 1991 .

[29]  Frank Biocca,et al.  Immersive virtual reality technology , 1995 .

[30]  Gregory Kramer,et al.  Sound and communication in virtual reality , 1995 .

[31]  R. Simons,et al.  Roll ‘em!: The effects of picture motion on emotional responses , 1998 .

[32]  N. Alessi,et al.  Presence as an emotional experience. , 1999, Studies in health technology and informatics.

[33]  Ulf Dimberg,et al.  Fear of snakes and facial reactions : A case of rapid emotional responding , 1998 .

[34]  RONALD M. AARTS.  Calculation of the loudness of loudspeakers during listening tests , 1990 .

[35]  Søren Bech,et al.  Interaction Between Audio-Visual Factors in a Home Theater System: Experimental Results , 1995 .

[36]  Byron Reeves,et al.  Negative video as structure: Emotion, attention, capacity, and memory , 1996 .

[37]  D. Västfjäll.  Emotion induction through music: A review of the musical mood induction procedure , 2001 .

[38]  B. Detenber,et al.  A Bio‐Informational Theory of Emotion: Motion and Image Size Effects on Viewers , 1996 .

[39]  Michael A. Casey,et al.  The sound dimension , 1997 .