Turbulent Touch: Touchscreen Input for Cockpit Flight Displays

Touchscreen input in commercial aircraft cockpits offers potential advantages, including ease of use, modifiability, and reduced weight. However, tolerance to turbulence is a challenge for their deployment. To better understand the impact of turbulence on cockpit input methods we conducted a comparative study of user performance with three input methods -- touch, trackball (as currently used in commercial aircraft), and a touchscreen stencil overlay designed to assist finger stabilization. These input methods were compared across a variety of interactive tasks and at three levels of simulated turbulence (none, low, and high). Results showed that performance degrades and subjective workload increases as vibration increases. Touch-based interaction was faster than the trackball when precision requirements were low (at all vibrations), but it was slower and less accurate for more precise pointing, particularly at high vibrations. The stencil did not improve touch selection times, although it did reduce errors on small targets at high vibrations, but only when finger lift-off errors had been eliminated by a timeout. Our work provides new information on the types of tasks affected by turbulence and the input mechanisms that perform best under different levels of vibration.

[1]  Daniel Avrahami,et al.  The Effect of Edge Targets on Touch Performance , 2015, CHI.

[2]  Brad A. Myers,et al.  Trackball text entry for people with motor impairments , 2006, CHI.

[3]  Philip Tuddenham,et al.  Graspables revisited: multi-touch vs. tangible input for tabletop displays in acquisition and manipulation tasks , 2010, CHI.

[4]  Bob DeMers,et al.  Touch Screens on the Flight Deck , 2014 .

[5]  Marco Fabbri,et al.  A Single Interactive Display Concept for Commercial and Business Jet Cockpits , 2011 .

[6]  Daniel Vogel,et al.  Shift: a technique for operating pen-based interfaces using touch , 2007, CHI.

[7]  E C Poulton,et al.  The influence of ship motion on manual control skills , 1980 .

[8]  David Lindlbauer,et al.  GelTouch: Localized Tactile Feedback Through Thin, Programmable Gel , 2015, UIST.

[9]  V. Huzur Saran,et al.  Error analysis of task performance with laptop in vibration environment , 2011, Comput. Hum. Behav..

[10]  William Buxton,et al.  Issues and techniques in touch-sensitive tablet input , 1985, SIGGRAPH '85.

[11]  Chaoyi Zhao,et al.  The Effect of Touch-key Size and Shape on the Usability of Flight Deck MCDU , 2015, ACHI 2015.

[12]  Xiangshi Ren,et al.  Improving selection performance on pen-based systems: a study of pen-based interaction for selection tasks , 2000, TCHI.

[13]  Christopher W. Branton,et al.  Casier: structures for composing tangibles and complementary interactors for use across diverse systems , 2010, TEI.

[14]  Tom Rodden,et al.  Designing touch-enabled electronic flight bags in SAR helicopter operations , 2016, HCI-Aero.

[15]  Doug Harper,et al.  P‐171: Physical Touch Aspects of the Touch Interface for Flight Deck Applications , 2014 .

[16]  Daniel J. Wigdor,et al.  Direct-touch vs. mouse input for tabletop displays , 2007, CHI.

[17]  Sheue-Ling Hwang,et al.  Effects of Input Device and Motion Type on a Cursor-Positioning Task , 2008, Perceptual and motor skills.

[18]  David Huffman,et al.  Panoramic cockpit displays for tactical military cockpits , 2010, Defense + Commercial Sensing.

[19]  Eric Barboni,et al.  Multi-Touch interactions for control and display in interactive cockpits: issues and a proposal , 2014 .

[20]  Robert L. Mack,et al.  A Benchmark Comparison of Mouse and Touch Interface Techniques for an Intelligent Workstation Windowing Environment , 1989 .

[21]  Shumin Zhai,et al.  Foundational Issues in Touch-Surface Stroke Gesture Design - An Integrative Review , 2012, Found. Trends Hum. Comput. Interact..

[22]  Tom Rodden,et al.  Future flight decks: impact of +Gz on touchscreen usability , 2016, HCI-Aero.

[23]  Pierre Dragicevic,et al.  Tangible remote controllers for wall-size displays , 2012, CHI.

[24]  Chris Harrison,et al.  Providing dynamically changeable physical buttons on a visual display , 2009, CHI.

[25]  Catherine Harvey,et al.  To twist, roll, stroke or poke? A study of input devices for menu navigation in the cockpit , 2013, Ergonomics.

[26]  Susan G. Hill,et al.  Soldier Performance Issues in C2 `On the Move' , 2005 .

[27]  B. Shneiderman,et al.  Improving the accuracy of touch screens: an experimental evaluation of three strategies , 1988, CHI '88.

[28]  Daniel M. Johnson,et al.  Enhancing physicality in touch interaction with programmable friction , 2011, CHI.

[29]  Brad A. Myers,et al.  EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion , 2003, UIST '03.

[30]  Jon Froehlich,et al.  Barrier pointing: using physical edges to assist target acquisition on mobile device touch screens , 2007, Assets '07.

[31]  Chiuhsiang Joe Lin,et al.  The performance of computer input devices in a vibration environment , 2010, Ergonomics.

[32]  Marion Wolff,et al.  Physical ergonomics approach for touch screen interaction in an aircraft cockpit , 2012, Ergo'IHM.

[33]  Xavier Servantie,et al.  Testing Touch Screens in Realistic Aeronautic Turbulent Conditions (Light to Severe) , 2015 .

[34]  Sridher Kaminani Human computer interaction issues with touch screen interfaces in the flight deck , 2011, 2011 IEEE/AIAA 30th Digital Avionics Systems Conference.

[35]  Brad A. Myers,et al.  An alternative to push, press, and tap-tap-tap: gesturing on an isometric joystick for mobile phone text entry , 2007, CHI.

[36]  Carl Gutwin,et al.  Understanding performance in touch selections: Tap, drag and radial pointing drag with finger, stylus and mouse , 2012, Int. J. Hum. Comput. Stud..

[37]  Raymond Lewis The Effect of Handedness on use of Touch Screen versus Touch Pad , 2015, ATACCS '15.

[38]  Kristin G Bauersfeld EFFECTS OF TURBULENCE AND ACTIVATION METHOD ON TOUCHSCREEN PERFORMANCE IN AVIATION ENVIRONMENTS. , 1992 .

[39]  D.M.科尔柏 Method for determining valid touch screen inputs , 2012 .