Sensitivity to haptic-audio asynchrony

The natural role of sound in actions involving mechanical impact and vibration suggests the use of auditory display as an augmentation to virtual haptic interfaces. In order to budget available computational resources for sound simulation, the perceptually tolerable asynchrony between paired haptic-auditory sensations must be known. This paper describes a psychophysical study of detectable time delay between a voluntary hammer tap and its auditory consequence (a percussive sound of either 1, 50, or 200 ms duration). The results show Just Noticeable Differences (JNDs) for temporal asynchrony of 24 ms with insignificant response bias. The invariance of JND and response bias as a function of sound duration in this experiment indicates that observers cued on the initial attack of the auditory stimuli.

[1]  H. Levitt Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[2]  William K. Durfee,et al.  Relative influence of sensory cues in a multi-modal virtual environment , 1999 .

[3]  Dinesh K. Pai,et al.  The Sounds of Physical Shapes , 1998, Presence.

[4]  Derek Brock,et al.  An extensible toolkit for creating virtual sonic environments , 2000 .

[5]  Mandayam A. Srinivasan,et al.  The Effect of Auditory Cues on the Haptic Perception of Stiffness in Virtual Environments , 1997, Dynamic Systems and Control.

[6]  R. Welch Chapter 15 Meaning, attention, and the “unity assumption” in the intersensory bias of spatial and temporal perceptions , 1999 .

[7]  T. Bachmann,et al.  Cognitive contributions to the perception of spatial and temporal events (Advances in Psychology, Vol. 129) , 1999 .

[8]  Jon Driver,et al.  Cross-modal links in attention between audition, vision, and touch: Implications for interface design , 1997 .

[9]  Susan J. Lederman,et al.  Integrating multimodal information about surface texture via a probe: relative contributions of haptic and touch-produced sound sources , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[10]  Karon E. MacLean,et al.  The perception of cross-modal simultaneity (or ``the Greenwich Observatory Problem'' revisited) , 2001 .

[11]  J. Craig,et al.  Temporal order and tactile patterns , 1990, Perception & psychophysics.

[12]  George A. Gescheider,et al.  Auditory and cutaneous temporal resolution of successive brief stimuli. , 1967 .

[13]  C. L. Doren,et al.  Vibrotactile temporal gap detection as a function of age. , 1990, The Journal of the Acoustical Society of America.

[14]  J. Edward Colgate,et al.  Haptic interfaces for virtual environment and teleoperator systems , 1995 .

[15]  D. H. Warren,et al.  Immediate perceptual response to intersensory discrepancy. , 1980, Psychological bulletin.

[16]  Susan J. Lederman,et al.  Relative performance using haptic and/or touch-produced auditory cues in a remote absolute texture identification task , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..