Cross-modal visual and vibrotactile tracking.

The present study investigates tracking performance with tactile and/or visual presentation of target and cursor. The tactile display consisted of vibrators in a horizontal linear array on the torso, the visual display consisted of dots projected on a horizontal plane surrounding the observer. Both displays presented qualitatively identical information: direction in a horizontal plane. Participants performed two different tracking tasks with target and cursor presented to the same modality (either visual or tactile) or to different modalities (a visual target and a tactile cursor or vice versa). The errors in both cross-modal settings were well predicted by the uni-modal errors. This indicates that no additional costs are involved in cross-modal visual-vibrotactile tracking. Closer inspection of the data reveals that the tactile modality is less suited for processing external disturbances. These results give directions on how to allocate information to the visual and tactile modalities in a multi-modal tracking interface, such as those applied in military cockpits.

[1]  Thomas B. Sheridan,et al.  Sensory Substitution for Force Feedback in Teleoperation , 1992, Presence: Teleoperators & Virtual Environments.

[2]  R. Shepard,et al.  Constraints common to apparent motion in visual, tactile, and auditory space. , 1997, Journal of Experimental Psychology: Human Perception and Performance.

[3]  Richard D. Gilson,et al.  Kinesthetic-Tactual Information Presentations-Inflight Studies , 1974, IEEE Trans. Syst. Man Cybern..

[4]  D J Newman,et al.  A tactile display for international space station (ISS) extravehicular activity (EVA). , 2000, Aviation, space, and environmental medicine.

[5]  Jan B. F. van Erp,et al.  Tactile Navigation Display , 2000, Haptic Human-Computer Interaction.

[6]  J. Marshall.  THE SKIN SENSES , 1969 .

[7]  D. Lewkowicz.  Heterogeneity and heterochrony in the development of intersensory perception. , 2002, Brain research. Cognitive brain research.

[8]  Philip J Tarnoff,et al.  ROUTE GUIDANCE SYSTEMS , 2001 .

[9]  C. Spence,et al.  Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision , 1998, Perception & psychophysics.

[10]  Lynn A. Streeter,et al.  How to Tell People Where to Go: Comparing Navigational Aids , 1985, Int. J. Man Mach. Stud..

[11]  Jan B. F. van Erp,et al.  Control Performance With Three Translational Degrees of Freedom , 2002, Hum. Factors.

[12]  J Decker,et al.  Cross-modality transfer of spatial information. , 1977, British journal of psychology.

[13]  T Dobbins,et al.  The Use of Tactile Navigation Cues In High-Speed Craft Operations , 2003 .

[14]  Robert E. Schlegel,et al.  Tactile Stimulation of the Human Head for Information Display , 1994 .

[15]  T. W. Forbes,et al.  Auditory Signals for Instrument Flying , 1946 .

[16]  Jon Driver,et al.  Cross-modal links in attention between audition, vision, and touch: Implications for interface design , 1997 .

[17]  David Wood,et al.  Editorial Tactile displays: present and future , 1998 .

[18]  Heinrich H. Bülthoff,et al.  Size Discrimination of seen and grasped objects and the effect of presentation time , 1998 .

[19]  Kenneth R. Boff,et al.  Engineering data compendium : human perception and performance , 1988 .

[20]  Hendrik A. H. C. van Veen,et al.  Tactile Information Presentation in the Cockpit , 2000, Haptic Human-Computer Interaction.

[21]  Jan B F van Erp,et al.  Vibro-Tactile and Visual Asynchronies: Sensitivity and Consistency , 2004, Perception.

[22]  J.B.F. van Erp,et al.  Tactile Torso Display as Countermeasure to Reduce Night Vision Goggles Induced Drift , 2003 .

[23]  S. Goldstone.  Variability of Temporal Judgment: Intersensory Comparisons and Sex Differences , 1968, Perceptual and motor skills.

[24]  J. C. Bliss,et al.  Compensatory Tracking with Visual and Tactile Displays , 1966 .

[25]  D. Mcnicol,et al.  Modality-Specific Differences in the Processing of Spatially, Temporally, and Spatiotemporally Distributed Information , 1994, Perception.

[26]  P E Roland,et al.  Cross-Modal Transfer of Information between the Tactile and the Visual Representations in the Human Brain: A Positron Emission Tomographic Study , 1998, The Journal of Neuroscience.

[27]  J.B.F. van Erp,et al.  Vibro-Tactile Information Presentation in Automobiles , 2001 .

[28]  J. Kirman,et al.  Tactile apparent movement: The effects of interstimulus onset interval and stimulus duration , 1974 .

[29]  R W Cholewiak,et al.  The generation of vibrotactile patterns on a linear array: Influences of body site, time, and presentation mode , 2000, Perception & psychophysics.

[30]  J H Mather,et al.  Cross-modal judgments of length. , 1966, The American journal of psychology.

[31]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[32]  C. Spence,et al.  Cross-modal links in spatial attention. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[33]  Anil K. Raj,et al.  Vibrotactile Displays for Improving Spatial Awareness , 2000 .

[34]  W. A. Wagenaar.  Note on the construction of digram-balanced Latin squares. , 1969 .

[35]  R. Klatzky,et al.  Visual mediation and the haptic recognition of two-dimensional pictures of common objects , 1990, Perception & psychophysics.

[36]  J.B.F. van Erp.  Tactile Displays in Virtual Environments , 2001 .

[37]  Nadine B. Sarter,et al.  Good Vibrations: Tactile Feedback in Support of Attention Allocation and Human-Automation Coordination in Event-Driven Domains , 1999, Hum. Factors.

[38]  Roger A. Browse,et al.  Using tactile information in telerobotics , 1992, IEEE Trans. Syst. Man Cybern..

[39]  Marc O. Ernst.  Psychophysikalische Untersuchungen zur visuomotorischen Integration beim Menschen: visuelle und haptische Wahrnehmung virtueller und realer Objekte. , 2001 .

[40]  J F Hahn.  Unidimensional Compensatory Tracking with a Vibrotactile Display , 1965, Perceptual and motor skills.

[41]  Pamela S. Tsang,et al.  Time-Sharing Visual and Auditory Tracking Tasks , 1987 .

[42]  J C Bliss,et al.  Visual and tactile tracking with step commands. NASA CR-623. , 1967, NASA contractor report. NASA CR. United States. National Aeronautics and Space Administration.

[43]  E C Lechelt,et al.  Spatial Anisotropy in Intramodal and Cross-Modal Judgments of Stimulus Orientation: The Stability of the Oblique Effect , 1980, Perception.

[44]  S J Bolanowski,et al.  Mechanisms of attention in touch. , 1999, Somatosensory & motor research.

[45]  R. E. Fenton.  An Improved Man-Machine Interface for the Driver-Vehicle System , 1966 .

[46]  Angus H. Rupert,et al.  The use of a tactile interface to convey position and motion perceptions , 1994 .

[47]  John W. Hill.  A Describing Function Analysis of Tracking Performance Using Two Tactile Displays , 1970 .