Evaluating Environmental Sounds from a Presence Perspective for Virtual Reality Applications

We propose a methodology to design and evaluate environmental sounds for virtual environments. We propose to combine physically modeled sound events with recorded soundscapes. Physical models are used to provide feedback to users' actions, while soundscapes reproduce the characteristic soundmarks of an environment. In this particular case, physical models are used to simulate the act of walking in the botanical garden of the city of Prague, while soundscapes are used to reproduce the particular sound of the garden. The auditory feedback designed was combined with a photorealistic reproduction of the same garden. A between-subject experiment was conducted, where 126 subjects participated, involving six different experimental conditions, including both uni- and bimodal stimuli (auditory and visual). The auditory stimuli consisted of several combinations of auditory feedback, including static sound sources as well as self-induced interactive sounds simulated using physical models. Results show that subjects' motion in the environment is significantly enhanced when dynamic sound sources and sound of egomotion are rendered in the environment.

[1]  Jean-Marie Adrien,et al.  The missing link: modal synthesis , 1991 .

[2]  T. Maurer,et al.  A comparison of Likert scale and traditional measures of self-efficacy. , 1998 .

[3]  Rolf Nordahl.  Increasing the Motion of Users in Photo-realistic Virtual Environments by Utilising Auditory Rendering of the Environment and Ego-motion , 2006 .

[4]  S. Handel.  Perceptual Coherence: Hearing and Seeing , 2006 .

[5]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[6]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[7]  D. Ross Jeffery,et al.  CASE: a testbed for modeling, measurement and management , 1992, CACM.

[8]  Michael Zyda,et al.  Interactions in Perceived Quality of Auditory-Visual Displays , 2000, Presence: Teleoperators & Virtual Environments.

[9]  Nathaniel I. Durlach,et al.  Virtual Reality: Scientific and Technological Challenges , 1994 .

[10]  Kenji Ozawa,et al.  Psychological factors involved in auditory presence , 2003 .

[11]  Steven van de Par,et al.  Auditory-visual interaction: from fundamental research in cognitive psychology to (possible) applications , 1999, Electronic Imaging.

[12]  B. Stein,et al.  The Merging of the Senses , 1993 .

[13]  Gregory B. Newby,et al.  Virtual reality: Scientific and technological challenges , 1996 .

[14]  Jonathan Freeman,et al.  A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory , 2001, Presence: Teleoperators & Virtual Environments.

[15]  Robert H. Gilkey,et al.  The Sense of Presence for the Suddenly Deafened Adult:Implications for Virtual Environments , 1995, Presence: Teleoperators & Virtual Environments.

[16]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[17]  Philip H. Marsden,et al.  Designing Auditory Spaces to Support Sense of Place: The Role of Expectation , 2002 .

[18]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[19]  N. F. Dixon,et al.  The Detection of Auditory Visual Desynchrony , 1980, Perception.

[20]  W. IJsselsteijn,et al.  Presence in depth , 2004 .

[21]  Barry Arons,et al.  A Review of The Cocktail Party Effect , 1992 .

[22]  Mel Slater,et al.  A note on presence terminology , 2003 .

[23]  Marc M. Sebrechts,et al.  HANDBOOK OF VIRTUAL ENVIRONMENTS , 2014 .

[24]  Stefania Serafin,et al.  Sound Design to Enhance Presence in Photorealistic Virtual Reality , 2004, ICAD.

[25]  Perry R. Cook,et al.  Physically Informed Sonic Modeling (PhISM): Synthesis of percussive sounds , 1997 .

[26]  Kay M. Stanney,et al.  Virtual environments , 2002 .