Emotion and Auditory Virtual Environments: Affect-Based Judgments of Music Reproduced with Virtual Reverberation Times

Emotions are experienced both in real and virtual environments (VEs). Most research to date have focused on the content that causes emotional reactions, but noncontent features of a VE (such as the realism and quality of object rendering) may also influence emotional reactions to the mediated object. The present research studied how noncontent features (different reverberation times) of an auditory VE influenced 76 participants' ratings of emotional reactions and expressed emotional qualities of the sounds. The results showed that the two emotion dimensions of pleasantness and arousal were systematically affected if the same musical piece was rendered with different reverberation times. Overall, it was found that high reverberation time was perceived as most unpleasant. Taken together, the results suggested that noncontent features of a VE influence emotional reactions to mediated objects. Moreover, the study suggests that emotional reactions may be a important aspect of the VE experience that can help complementing standard presence questionnaires and quality evaluations.

[1]  James A. Russell,et al.  Approach-Avoidance and Affiliation as Functions of the Emotion-Eliciting Quality of an Environment , 1978 .

[2]  Søren Bech,et al.  Interaction Between Audio-Visual Factors in a Home Theater System: Experimental Results , 1995 .

[3]  Tommy Gärling,et al.  The measurement of core affect: a Swedish self-report measure derived from the affect circumplex. , 2002, Scandinavian journal of psychology.

[4]  Wijnand A. IJsselsteijn,et al.  Effects of Sensory Information and Prior Experience on Direct Subjective Ratings of Presence , 1999, Presence: Teleoperators & Virtual Environments.

[5]  Jennifer Lawrence,et al.  Communication in the Age of Virtual Reality. , 1997 .

[6]  Daniel Västfjäll,et al.  The Subjective Sense of Presence, Emotion Recognition, and Experienced Emotions in Auditory Virtual Environments , 2003, Cyberpsychology Behav. Soc. Netw..

[7]  S. Fiske,et al.  The Handbook of Social Psychology , 1935 .

[8]  Daniel Västfjäll,et al.  The Actor-Observer Effect in Virtual Reality Presentations , 2001, Cyberpsychology Behav. Soc. Netw..

[9]  B. Detenber,et al.  A Bio‐Informational Theory of Emotion: Motion and Image Size Effects on Viewers , 1996 .

[10]  Ulf Dimberg,et al.  Fear of snakes and facial reactions : A case of rapid emotional responding , 1998 .

[11]  Woodrow Barfield,et al.  The Sense of Presence within Auditory Virtual Environments , 1996, Presence: Teleoperators & Virtual Environments.

[12]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[13]  J. Westwood,et al.  Medicine meets virtual reality : the convergence of physical & informational technologies : options for a new era in healthcare , 1999 .

[14]  J. Freeman,et al.  Aroused and Immersed: The Psychophysiology of Presence , 2000 .

[15]  M. Bradley,et al.  Affective reactions to acoustic stimuli. , 2000, Psychophysiology.

[16]  William W. Gaver.  What in the World Do We Hear? An Ecological Approach to Auditory Event Perception , 1993 .

[17]  Daniel Västfjäll,et al.  ECOLOGICAL ACOUSTICS AND THE MULTI-MODAL PERCEPTION OF ROOMS: REAL AND UNREAL EXPERIENCES OF AUDITORY-VISUAL VIRTUAL ENVIRONMENTS , 2001 .

[18]  Gregory Kramer,et al.  Sound and communication in virtual reality , 1995 .

[19]  E. Miller.  Handbook of Social Psychology , 1946, Mental Health.

[20]  James Price Dillard,et al.  Communication and Affect , 1993 .

[21]  Byron Reeves,et al.  Negative video as structure: Emotion, attention, capacity, and memory , 1996 .

[22]  R. Simons,et al.  Image motion and context: a between- and within-subjects comparison. , 2000, Psychophysiology.

[23]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[24]  A. Collins,et al.  The Cognitive Structure of Emotions: The Structure of the Theory , 1988 .

[25]  R. Simons,et al.  Affective response to color-slide stimuli in subjects with physical anhedonia: a three-systems analysis. , 2007, Psychophysiology.

[26]  Qingwen Dong,et al.  The Effects of Emotional Arousal and Valence on Television Viewers' Cognitive Capacity and Memory. , 1995 .

[27]  C. Krumhansl.  An exploratory study of musical emotions and psychophysiology. , 1997, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[28]  Mendel Kleiner,et al.  Auralization-An Overview , 1993 .

[29]  D. Watson,et al.  Toward a consensual structure of mood. , 1985, Psychological bulletin.

[30]  R. Simons,et al.  Roll ‘em!: The effects of picture motion on emotional responses , 1998 .

[31]  N. Alessi,et al.  Presence as an emotional experience. , 1999, Studies in health technology and informatics.

[32]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[33]  E. A. Bjork.  The perceived quality of natural sounds , 1985 .

[34]  William W. Gaver.  How Do We Hear in the World?: Explorations in Ecological Acoustics , 1993 .

[35]  J. Russell.  A circumplex model of affect. , 1980 .

[36]  E. Tan,et al.  Emotion and the Structure of Narrative Film: Film As An Emotion Machine , 1995 .

[37]  Elizabeth M. Wenzel,et al.  Localization in Virtual Acoustic Displays , 1992, Presence: Teleoperators & Virtual Environments.

[38]  Renato S. Pellegrini,et al.  Quality assessment of auditory virtual environments , 2001 .

[39]  P. Lang.  The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[40]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[41]  J. Russell,et al.  An approach to environmental psychology , 1974 .