Influence of multisensory feedback on haptic accessibility tasks

Environments of a certain nature, such as those related to maintenance tasks can benefited from haptic stimuli by performing accessibility simulation in a realistic manner. Accessibility is defined as the physical feasibility of accessing an element of a 3D model avoiding undesirable collisions. This paper studies the benefits that multisensory systems can provide in performing this kind of tasks. The research is specially focused on the improvements provided by auditory feedback to the user’s performance. We have carried out a user study where participants had to perform an accessibility task with the aid of different combinations of sensorial stimuli. A large haptic interface for aeronautic maintainability has been extended with real-time sound generation capabilities to study this issue. The results of these experiments show that auditory stimuli provide with useful cues to the users helping them to correct trajectories and hence improving their performance.

[1]  M. A. Srinivassan.  The impact of visual information on the haptic perception of stiffness in virtual environments , 1996 .

[2]  Larry F. Hodges,et al.  Tutorial: time-multiplexed stereoscopic computer graphics , 1992, IEEE Computer Graphics and Applications.

[3]  Durand R. Begault,et al.  Sensitivity to haptic-audio asynchrony , 2003, ICMI '03.

[4]  Angel Rubio,et al.  Stability analysis of a 1 DOF haptic interface using the Routh-Hurwitz criterion , 2004, IEEE Transactions on Control Systems Technology.

[5]  Dinesh K. Pai,et al.  Multisensory Interaction: Real and Virtual , 2003, ISRR.

[6]  James R. Leger,et al.  Stereoscopic displays for terrain database visualization , 1990, Other Conferences.

[7]  Diego Borro,et al.  Approximation of Optimal Voxel Size for Collision Detection in Maintainability Simulations within Massive Virtual Environments , 2004, Comput. Graph. Forum.

[8]  James F. O'Brien,et al.  Synthesizing sounds from physically based motion , 2001, SIGGRAPH.

[9]  Dinesh K. Pai,et al.  Active measurement of contact sounds , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[10]  C. Spence,et al.  Audiotactile interactions in roughness perception , 2002, Experimental Brain Research.

[11]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[12]  J. J. Gil,et al.  Interfaces for VR Applications Development in Design , 2005 .

[13]  B. Stein,et al.  The Merging of the Senses , 1993 .

[14]  Cornelis Pieter van den Doel.  Sound synthesis for virtual reality and computer games , 1998 .

[15]  Dinesh K. Pai,et al.  The AHI: an audio and haptic interface for contact interactions , 2000, UIST '00.

[16]  Dinesh K. Pai,et al.  FoleyAutomatic: physically-based sound effects for interactive simulation and animation , 2001, SIGGRAPH.

[17]  I. Mansa.  Occlusion culling for dense geometric scenarios , 2006 .

[18]  Stephen Brewster,et al.  Feeling Rough: Multimodal Perception of Virtual Roughness , 2001 .

[19]  Diego Borro,et al.  A large haptic device for aircraft engine maintainability , 2004, IEEE Computer Graphics and Applications.

[20]  J. Edward Colgate,et al.  Passivity of a class of sampled-data systems: Application to haptic interfaces , 1997, J. Field Robotics.

[21]  Y. Yeh,et al.  Limits of Fusion and Depth Judgment in Stereoscopic Color Displays , 1990, Human factors.

[22]  M. Heller.  Visual and tactual texture perception: Intersensory cooperation , 1982, Perception & psychophysics.

[23]  Derek DiFilippo.  The AHI : an audio and haptic interface for simulating contact interactions , 2000 .

[24]  Dinesh K. Pai,et al.  JASS: A JAVA AUDIO SYNTHESIS SYSTEM FOR PROGRAMMERS , 2001 .

[25]  Thomas Kerwin,et al.  The role of multisensory feedback in haptic surface perception , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[26]  Larry F. Hodges,et al.  Geometric Considerations for Stereoscopic Virtual Environments , 1993, Presence: Teleoperators & Virtual Environments.

[27]  Stephen A. Brewster,et al.  The Effective Combination of Haptic and Auditory Textural Information , 2000, Haptic Human-Computer Interaction.

[28]  Dinesh K. Pai,et al.  The Sounds of Physical Shapes , 1998, Presence.

[29]  Karon E. MacLean,et al.  The perception of cross-modal simultaneity (or ``the Greenwich Observatory Problem'' revisited) , 2001 .

[30]  John Kenneth Salisbury,et al.  Haptic rendering: programming touch interaction with virtual objects , 1995, I3D '95.

[31]  Kenneth R. Boff,et al.  Engineering data compendium : human perception and performance , 1988 .

[32]  Hiroo Iwata,et al.  Software Architecture for Audio and Haptic Rendering Based on a Physical Model , 2001, INTERACT.

[33]  Mandayam A. Srinivasan,et al.  The Effect of Auditory Cues on the Haptic Perception of Stiffness in Virtual Environments , 1997, Dynamic Systems and Control.

[34]  Yoshitaka Adachi,et al.  Intermediate representation for stiff virtual objects , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[35]  S. Lederman.  Auditory Texture Perception , 1979, Perception.