Investigating Pilot Performance Using Mixed-Modality Simulated Data Link

Objective: General aviation (GA) pilot performance utilizing a mixed-modality simulated data link was objectively evaluated based on the time required in accessing, understanding, and executing data link commands. Additional subjective data were gathered on workload, situation awareness (SA), and preference. Background: Research exploring mixed-modality data link integration to the single-pilot GA cockpit is lacking, especially with respect to potential effects on safety. Methods: Sixteen visual flight rules (VFR)—rated pilots participated in an experiment using a flight simulator equipped with a mixed-modality data link. Data link modalities were text display, synthesized speech, digitized speech, and synthesized speech/text combination. Flight conditions included VFR (unlimited ceiling and visibility) or marginal VFR flight conditions (clouds 2,800 ft above ground level, 3-mile visibility). Results: Statistically significant differences were found in pilot performance, mental workload, and SA across the data link modalities. Textual data link resulted in increased time and workload as compared with the three speech-type data link conditions, which did not differ. SA measures indicated higher performance with textual and digitized speech data link conditions. Conclusion: Textual data link can be significantly enhanced for single-pilot GA operations by the addition of a speech component. Application: Potential applications include operational safety in future GA systems that incorporate data link for use by a single pilot and guidance in the development of flight performance objectives for these systems.

[1]  J. Walker,et al.  In-vehicle navigation devices: Effects on the safety of driver performance , 1990, Vehicle Navigation and Information Systems Conference, 1991.

[2]  J.-M. Bauschat.  On the Dependence of Pilot Task and Pilot Workload , 2001 .

[3]  V. David Hopkin,et al.  Human Factors Certification of Advanced Aviation Technologies , 1994 .

[4]  S. Soli,et al.  Development of the Hearing in Noise Test for the measurement of speech reception thresholds in quiet and in noise. , 1994, The Journal of the Acoustical Society of America.

[5]  V. David Hopkin.  Human Factors In Air Traffic Control , 1995 .

[6]  O. V. Prinzo.  An Analysis of Approach Control/Pilot Voice Communications. , 1996 .

[7]  Mansour Rahimi,et al.  Evaluation of 16 Measures of Mental Workload using a Simulated Flight Task Emphasizing Mediational Activity , 1985 .

[8]  Yung-ching Liu,et al.  EFFECT OF ADVANCED TRAVELER INFORMATION SYSTEM DISPLAYS ON YOUNGER AND OLDER DRIVERS PERFORMANCE , 2000 .

[9]  Barry H. Kantowitz,et al.  On experimenter-limited processes. , 1976 .

[10]  C Speaks,et al.  Effect of a competing message on synthetic sentence identification. , 1967, Journal of speech and hearing research.

[11]  Daniel J. Garland,et al.  Situation Awareness Analysis and Measurement , 2009 .

[12]  Steven J. Landry,et al.  Predicting Human Performance , 2007 .

[13]  C. A. Simpson,et al.  Response Time Effects of Alerting Tone and Semantic Context for Synthesized Voice Cockpit Warnings , 1980, Human factors.

[14]  A Stokes,et al.  Display Technology: Human Factors Concepts , 1988 .

[15]  Christopher D. Wickens,et al.  Traffic and Data Link Displays: Auditory? Visual? or Redundant? A Visual Scanning Analysis , 2003 .

[16]  V. David Hopkin,et al.  Automation and Systems Issues in Air Traffic Control , 1991, NATO ASI Series.

[17]  M A Hofmann,et al.  NATIONAL PLAN FOR CIVIL AVIATION HUMAN FACTORS: AN INITIATIVE FOR RESEARCH AND APPLICATION , 1995 .

[18]  C. A. Simpson,et al.  Synthesized Speech Rate and Pitch Effects on Intelligibility of Warning Messages for Pilots , 1984, Human factors.

[19]  G. Kottmeyer,et al.  [The effects of noise on man]. , 1960, HNO.

[20]  Albert J. Rehmann,et al.  Airborne Data Link Operational Evaluation Test Plan , 1993 .

[21]  David Woods,et al.  Situation Awareness: A Critical But Ill-Defined Phenomenon , 1991 .

[22]  J Edworthy,et al.  The design and implementation of non-verbal auditory warnings. , 1994, Applied ergonomics.

[23]  Paul E. Illman.  The pilot's handbook of aeronautical knowledge , 1979 .

[25]  Mica R. Endsley,et al.  Situation awareness global assessment technique (SAGAT) , 1988, Proceedings of the IEEE 1988 National Aerospace and Electronics Conference.

[26]  K. D. Kryter,et al.  ARTICULATION-TESTING METHODS: CONSONANTAL DIFFERENTIATION WITH A CLOSED-RESPONSE SET. , 1965, The Journal of the Acoustical Society of America.

[27]  D M Jones,et al.  Synthesized or digitized? A guide to the use of computer speech. , 1992, Applied ergonomics.

[28]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[29]  Horabail S Venkatagiri.  Segmental intelligibility of four currently used text-to-speech synthesis methods. , 2003, The Journal of the Acoustical Society of America.

[30]  Michael Reynolds,et al.  FAA AIRBORNE DATA LINK HUMAN FACTORS RESEARCH PLAN. , 1993 .

[31]  C. Wickens,et al.  Visual scanning and pilot expertise: the role of attentional flexibility and mental model development. , 1997, Aviation, space, and environmental medicine.

[32]  Joseph Pitts,et al.  The National Plan for Aviation Human Factors , 1993 .

[33]  Marc J Amar.  A human subject evaluation of airport surface situational awareness using prototypical flight deck electronic taxi chart displays , 1994 .

[34]  Carol A. Simpson,et al.  Comparison of voice types for helicopter voice warning systems , 1984 .

[35]  Sandra P. Marshall.  Monitoring Situational Awareness in Tactical Information Displays with Eye-Tracking Instrumentation. , 1996 .

[36]  Durand R. Begault,et al.  Techniques and applications for binaural sound manipulation in human-machine interfaces , 1992 .

[37]  Cristina Delogu,et al.  Cognitive factors in the evaluation of synthetic speech , 1998, Speech Commun..

[38]  John H. L. Hansen,et al.  Analysis, modeling and perturbation of speech under stress with applications to speech synthesis and recognition , 1996 .

[39]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[40]  William H. Rogers,et al.  SITUATIONAL AWARENESS IN THE COMMERCIAL FLIGHT DECK: DEFINITION, MEASUREMENT, AND ENHANCEMENT , 1988 .

[41]  Christopher D. Wickens,et al.  Display Formatting Techniques for Improving Situation Awareness in the Aircraft Cockpit , 1991 .

[42]  S. Metalis,et al.  Assessment of Pilot Situational Awareness: Measurement via Simulation , 1993 .

[43]  Albert J. Rehmann.  Human Factors Recommendations for Airborne Controller-Pilot Data Link Communications (CPDLS) Systems: A Synthesis of Research Results and Literature. , 1997 .

[44]  F. T. Eggemeier,et al.  Recommendations for Mental Workload Measurement in a Test and Evaluation Environment , 1993 .

[45]  Omer Tsimhoni,et al.  Listening to Natural and Synthesized Speech while Driving: Effects on User Performance , 2001, Int. J. Speech Technol..

[46]  Alexander L. Francis,et al.  The Effect of Lexical Complexity on Intelligibility , 1999, Int. J. Speech Technol..

[47]  E Svensson,et al.  Mission challenge, mental workload and performance in military aviation. , 1993, Aviation, space, and environmental medicine.

[48]  Richard D. Gilson,et al.  Linguistic Cues and Memory for Synthetic and Natural Speech , 2000, Hum. Factors.

[49]  Christopher D. Wickens,et al.  Effects of Data-Link Modality and Display Redundancy on Pilot Performance: An Attentional Perspective , 2003 .

[50]  Craig M. Harvey,et al.  Effects of the Controller-to-Pilot Data Link (Datalink) on Crew Communication , 2002 .

[51]  Barry H. Kantowitz,et al.  Inferring decay in short-term memory: The issue of capacity , 1977, Memory & cognition.

[52]  R. M. Taylor,et al.  Workload or Situational Awareness?: TLX vs. SART for Aerospace Systems Design Evaluation , 1991 .

[53]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[54]  Michael A. Vidulich,et al.  Testing a Subjective Metric of Situation Awareness , 1991 .

[55]  F. Hawkins.  Human factors in aviation. , 1979, Journal of psychosomatic research.

[56]  Rhona Flin,et al.  Building fire commander situational awareness from team shared mental models , 1997 .

[57]  P. Finn.  Word Frequency, Information Theory, and Cloze Performance: A Transfer Feature Theory of Processing in Reading. , 1977 .

[58]  Gavriel Salvendy,et al.  Handbook of Human Factors and Ergonomics , 2005 .

[59]  R. E. Curry,et al.  The effect of communications and traffic situation displays on pilots awareness of traffic in the terminal area , 1973 .

[60]  M R Endsley,et al.  Sources of situation awareness errors in aviation. , 1996, Aviation, space, and environmental medicine.

[61]  M. Endsley.  Automation and situation awareness. , 1996 .

[62]  Steven E. Stern,et al.  The Persuasiveness of Synthetic Speech versus Human Speech , 1999, Hum. Factors.

[63]  Dual-Task Performance and Visual Attention Switching , 1996 .

[64]  David B Pisoni,et al.  Perception of synthetic speech produced automatically by rule: Intelligibility of eight text-to-speech systems , 1986, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[65]  C. A. Simpson,et al.  System Design for Speech Recognition and Generation , 1985, Human factors.

[66]  W W Wierwille,et al.  Physiological Measures of Aircrew Mental Workload , 1979, Human factors.

[67]  Mark Chignell,et al.  Cognitive Processes during Instrument Landing , 1987 .

[68]  H.A.P. Blom.  The layered safety concept, an integrated approach to the design and validation of air traffic management enhancements , 1992 .

[69]  Danko Nikolić,et al.  SITUATION AWARENESS AS A PREDICTOR OF PERFORMANCE IN EN ROUTE AIR TRAFFIC CONTROLLERS , 1998 .

[70]  Vernol Battiste,et al.  An Operation Evaluation of ADS-B and CDTI during Airport Surface and Final Approach Operations , 2002 .

[71]  Donald Hameluck.  Mental Models, Mental Workload, and Instrument Scanning in Flight , 1990 .

[72]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[73]  W. Wierwille,et al.  A Comparison of Rating Scale, Secondary-Task, Physiological, and Primary-Task Workload Estimation Techniques in a Simulated Flight Task Emphasizing Communications Load , 1983, Human factors.

[74]  A Latorella Kara,et al.  Effects of Modality on Interrupted Flight Deck Performance: Implications for Data Link , 1998 .

[75]  Claude Navarro,et al.  DATALINK COMMUNICATION IN FLIGHT DECK OPERATIONS: A SYNTHESIS OF RECENT STUDIES , 1999 .

[76]  S. Trollip,et al.  Human Factors for General Aviation , 1991 .

[77]  David Wood,et al.  The effect of task conditions on the comprehensibility of synthetic speech , 2000, CHI.

[78]  Daryle Gardner-Bonneau,et al.  Lifting Problems of Air Ambulance Crews , 2001 .

[79]  Avrdec,et al.  Rapid Pilot Interface Development Simulator , 1998 .

[80]  Martine Grice,et al.  The SUS test: A method for the assessment of text-to-speech synthesis intelligibility using Semantically Unpredictable Sentences , 1996, Speech Commun..

[81]  G. L. Ricard,et al.  Intelligibility and Localization of Speech from Virtual Directions , 1994, Human factors.

[82]  Michael E. McCauley,et al.  Voice Technology Design Guides for Navy Training Systems. , 1983 .

[83]  J. Lave.  Cognition in Practice: Outdoors: a social anthropology of cognition in practice , 1988 .

[84]  Mica R. Endsley,et al.  Situation Awareness Problems in General Aviation , 2000 .

[85]  Carryl L. Baldwin,et al.  Dual Task Assessment of Age Differences in Mental Workload with Implications for Driving , 1995 .

[86]  Christopher D. Wickens,et al.  Attentional Models of Multitask Pilot Performance Using Advanced Display Technology , 2003, Hum. Factors.

[87]  John G. Casali,et al.  A Validated Rating Scale for Global Mental Workload Measurement Applications , 1983 .

[88]  Kip Smith,et al.  Situation Awareness Is Adaptive, Externally Directed Consciousness , 1995, Hum. Factors.

[89]  Daniel Gopher,et al.  Workload: An examination of the concept. , 1986 .

[90]  H Kantowitz,et al.  Testing tapping timesharing, II: Auditory secondary task. , 1976, Acta psychologica.

[91]  G. Labiale,et al.  In-Car Road Information: Comparisons of Auditory and Visual Presentations , 1990 .

[92]  Thomas A. Dingus,et al.  The Effect of Advanced Traveler Information Display Modality on Driver Performance , 2000 .

[93]  Daniel G. Morrow,et al.  Expertise and Age Effects on Pilot Mental Workload in a Simulated Aviation Task , 1996 .

[94]  Richard H. Mogford,et al.  AIRBORNE DATA LINK STUDY REPORT , 1996 .

[95]  D R Begault,et al.  Three-dimensional audio versus head-down traffic alert and collision avoidance system displays. , 1996, The International journal of aviation psychology.

[96]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[97]  Carryl L Baldwin,et al.  Impact of speech presentation level on cognitive task performance: implications for auditory display design , 2002, Ergonomics.

[98]  D R Begault,et al.  Head-Up Auditory Displays for Traffic Collision Avoidance System Advisories: A Preliminary Investigation , 1993, Human factors.

[99]  J. Ballas.  The Niche Hypothesis: Implications for Auditory Display Design , 2000 .

[100]  Gary S. Robinson,et al.  Comparison of Two Voice Synthesis Systems as to Speech Intelligibility in Aircraft Cockpit Engine Noise , 2004 .