Audio-Haptic Simulation of Walking on Virtual Ground Surfaces to Enhance Realism

In this paper we describe two experiments whose goal is to investigate the role of physics-based auditory and haptic feedback provided at feet level to enhance realism in a virtual environment. To achieve this goal, we designed a multimodal virtual environment where subjects could walk on a platform overlooking a canyon. Subjects were asked to visit the environment wearing an head-mounted display and a custom made pair of sandals enhanced with sensors and actuators. A 12-channels surround sound system delivered a soundscape which was consistent with the visual environment. In the first experiment, passive haptics was provided by having a physical wooden platform present in the laboratory. In the second experiment, no passive haptics was present. In both experiments, subjects reported of having a more realistic experience while auditory and haptic feedback are present. However, measured physiological data and post-experimental presence questionnaire do not show significant differences when audio-haptic feedback is provided.

[1]  Eric Burns,et al.  Combining passive haptics with redirected walking , 2005, ICAT '05.

[2]  Klaus H. Hinrichs,et al.  Enhancing Presence in Head-Mounted Display Environments by Visual Body Feedback Using Head-Mounted Cameras , 2009, 2009 International Conference on CyberWorlds.

[3]  Joseph A. Paradiso,et al.  Interactive Music for Instrumented Dancing Shoes , 1999, ICMC.

[4]  Joseph A. Paradiso,et al.  A wireless modular sensor architecture and its application in on-shoe gait analysis , 2003, Proceedings of IEEE Sensors 2003 (IEEE Cat. No.03CH37498).

[5]  Jan J. Koenderink,et al.  Editorial: Walking in real and virtual environments , 2007, TAP.

[6]  Maria V. Sanchez-Vives,et al.  How we experience immersive virtual environments: the concept of presence and its measurement * , 2009 .

[7]  Mary C. Whitton,et al.  Passive haptics significantly enhances virtual environments , 2001 .

[8]  M. Whitton,et al.  Physiological Measures of Presence in Virtual Environments , 2001 .

[9]  Vincent Hayward,et al.  Audio-haptic physically-based simulation of walking on different grounds , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[10]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[11]  Luca Turchet,et al.  Physically Based Sound Synthesis and Control of Footsteps Sounds , 2010 .

[12]  Vincent Hayward,et al.  Preliminary Experiment Combining Virtual Reality Haptic Shoes and Audio Synthesis , 2010, EuroHaptics.

[13]  Mel Slater,et al.  Using Presence Questionnaires in Reality , 2000, Presence: Teleoperators & Virtual Environments.

[14]  Mel Slater,et al.  Depth of Presence in Virtual Environments , 1994, Presence: Teleoperators & Virtual Environments.