A comparison of "on-thigh" vibrotactile, combined visual-vibrotactile, and visual-only alerting systems for the cockpit under visually demanding conditions

In the cockpit, performance is prone to break down. Conveying crucial information through the tactile modality, which requires little to no additional effort, has been previously examined as means to improve performance and safety. Previously, we demonstrated the ability of the on-thigh vibrotactile alerting display to convey directional cues in the vertical plane. We hypothesized that tactile directional alerting cues would be beneficial in a visually loaded multi-tasking environment. In the current study, two tasks were introduced simultaneously: a directional task where participants respond to directional cues (visual, tactile, or combination of both), and a visual-memory recall task where participants identify, count and recall objects embedded in flight movies. Response time, accuracy and subjective workload were evaluated. Performance in the memory recall task and subjective workload were in favor of the combined tactile & visual configuration. No performance difference was found between visual and tactile & visual in the directional task. We conclude that the tactile & visual configuration may allow operators to choose a strategy in which perceptual and cognitive resources are better utilized.

[1]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[2]  Peter A Hancock,et al.  The Workload and Performance Relationship in the Real World: A Study of Police Officers in a Field Shooting Exercise , 2008, International journal of occupational safety and ergonomics : JOSE.

[3]  Thomas E. Nygren,et al.  The Subjective Workload Assessment Technique: A Scaling Procedure for Measuring Mental Workload , 1988 .

[4]  Lynette A. Jones,et al.  Tactile Displays: Guidance for Their Design and Application , 2008, Hum. Factors.

[5]  J. V. Erp,et al.  Vibrotactile in-vehicle navigation system , 2004 .

[6]  Tal Oron-Gilad,et al.  Vibrotactor-Belt on the Thigh - Directions in the Vertical Plane , 2010, EuroHaptics.

[7]  Sion Jennings,et al.  Flight-Test of a Tactile Situational Awareness System in a Land-based Deck Landing Task , 2004 .

[8]  Hong Z. Tan,et al.  Using spatial vibrotactile cues to direct visual attention in driving scenes , 2005 .

[9]  C. Wickens Engineering psychology and human performance, 2nd ed. , 1992 .

[10]  J.B.F. van Erp,et al.  Tactile Torso Display as Countermeasure to Reduce Night Vision Goggles Induced Drift , 2003 .

[11]  Charles Spence,et al.  Capturing spatial attention with multisensory cues , 2008, Psychonomic bulletin & review.

[12]  Tal Oron-Gilad,et al.  Vibrotactile “On-Thigh” Alerting System in the Cockpit , 2011, Hum. Factors.

[13]  Daniel Gopher,et al.  On the Economy of the Human Processing System: A Model of Multiple Capacity. , 1977 .

[14]  Richard D. Gilson,et al.  The Effects of Physiological Stress on Tactile Communication , 2006 .

[15]  Yoav Kessler,et al.  All updateable objects in working memory are updated whenever any of them are modified: evidence from the memory updating paradigm. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[16]  Frank L. Kooi,et al.  Multimodal Interfaces: A Framework Based on Modality Appropriateness , 2006 .

[17]  Lars Eriksson,et al.  Vibrotactile and Visual Threat Cueing with High G Threat Intercept in Dynamic Flight Simulation , 2006 .

[18]  C. Wickens,et al.  Dissociation of Performance and Subjective Measures of Workload , 1988 .