Factors influencing the usability of collision alerting systems in gliding

The dissertation at hand identifies and analyzes how well glider pilots use low-cost collision alerting systems. While being generally recognized as a commendable tool for helping glider pilots see and avoid other traffic, these systems have been cited as possible contributing factors in several accidents. In literature, no in-depth research on how glider pilots may interpret or misinterpret their indications was found. At the beginning of this dissertation, a market study of human-machine interfaces for low-cost collision alerting systems is presented. During the study, different human-machine interfaces are taxonomized. The low-complexity and radar-style displays were found to be popular display formats. Also it was discovered that a perspective presentation of traffic has been evaluated for military applications, but not for a gliding context. Thus, a perspective presentation of traffic is proposed. The prototype of a perspective display format for gliding is developed by relying on a user-centered design process. Then, the design features of the low-complexity, radar-style and perspective displays are compared. This results in several hypotheses comparing the usability of the three display formats being postulated. In order to experimentally evaluate these hypotheses, 137 glider pilots partake in a laboratory experiment. They are presented with traffic information on one of the three display formats installed in a flight simulator. The participants then indicate where they suspect the traffic to be located in the outside world while being exposed to different flight conditions. Performance and subjective satisfaction measurements are recorded during the experiment. Inferential statistics are used to evaluate the experimental data. The perspective display format results in the most precise estimates of where traffic is located. Generally, errors in estimating traffic position increase as the participants’ ownship deviates from straight and level flight. Reaction time does not vary notably between display formats or different flight conditions. Subjective learnability and usability ratings favor the perspective display format over the two other formats analyzed. Overall, the perspective display format exhibits optimized usability in all dimensions when compared to the other two formats. During the usability analysis, circumstantial evidence arises which suggests that not all participants might interpret the data shown on their display similarly. A probable cause for this may be different knowledge deficits which are experienced between participants. These deficits may result in participants mentally modeling the collision alerting system incorrectly, thus leading to incorrect coordinate systems for interpreting the traffic information. A method for identifying these mental models is developed. The ensuing analysis reveals that most participants using low-complexity or radar-style display formats incorrectly interpret traffic information in an ownship-fixed fashion. Contrary, most participants working with the perspective display format perform at least some of the required rotations of their personal coordinate systems. The concept of different mental models based on different personal coordinate systems shows potential as an analysis tool for future display designs. From these findings multiple recommendations are deduced. They are directed at different stakeholders in the gliding community, including glider pilots, aircraft owners and operators, regulatory authorities, glider manufacturers, flight schools, competition rule makers and organizers, as well as designers of collision alerting systems and associated human-machine interfaces. Closing this dissertation, the potential for future human factors research in the gliding community is highlighted.

[1]  Tyler T Prevett,et al.  Exploring the dimensions of egocentricity in aircraft navigation displays , 1995 .

[2]  J W Andrews Unalerted Air-to-Air Visual Acquisition , 1991 .

[3]  Christopher D. Wickens,et al.  An introduction to human factors engineering , 1997 .

[4]  Thomas S. Tullis,et al.  An Evaluation of Alphanumeric, Graphic, and Color Information Displays , 1981 .

[5]  Stanley N. Roscoe,et al.  Airborne Displays for Flight and Navigation , 1968 .

[6]  Mica R. Endsley,et al.  Designing for Situation Awareness : An Approach to User-Centered Design , 2003 .

[7]  Kevin D. Carlson,et al.  So what? Beyond statistical significance to substantive significance in strategy research , 2009 .

[8]  Michael P. Snow,et al.  Human Factors Issues in Synthetic Vision Displays: Government, Academic, Military, and Industry Perspectives , 2004 .

[9]  Miles MacLeod,et al.  Usability measurement in context , 1994, Behav. Inf. Technol..

[10]  F. Donders On the speed of mental processes. , 1969, Acta psychologica.

[11]  M. Endsley Situation Models: An Avenue to the Modeling of Mental Models , 2000 .

[12]  George Mason Situation Awareness, Mental Workload, and Trust in Automation:Viable, Empirically Supported Cognitive Engineering Constructs , 2011 .

[13]  J W Andrews Air-to-Air Visual Acquisition Performance with Pilot Warning Instruments (PWI). , 1977 .

[14]  M K Kaiser,et al.  MANOVA method for analyzing repeated measures designs: an extensive primer. , 1985, Psychological bulletin.

[15]  Stephen Jarvis,et al.  A misjudged approach to a high accident rate : exploration of accident causes and instructor decisons relating to inexperienced glider pilots , 2009 .

[16]  Mykel J. Kochenderfer,et al.  Airspace Encounter Models for Conventional and Unconventional Aircraft , 2009 .

[17]  Andy P. Field,et al.  Discovering Statistics Using Ibm Spss Statistics , 2017 .

[18]  Francis T. Durso,et al.  Chapter 8 – Managing Workload, Performance, and Situation Awareness in Aviation Systems , 2010 .

[19]  Neil D. Van Sickle,et al.  Van Sickle's Modern Airmanship , 1958 .

[20]  R. Michael Furr,et al.  Interpreting Effect Sizes in Contrast Analysis , 2004 .

[21]  Erik Hollnagel,et al.  Human factors and folk models , 2004, Cognition, Technology & Work.

[22]  C. L. Olson On choosing a test statistic in multivariate analysis of variance. , 1976 .

[23]  J. Osborne Notes on the use of data transformations. , 2002 .

[24]  Desmond M. Connolly Aviation visual perception: research, misperception and mishaps , 2011 .

[25]  Christopher D. Wickens,et al.  Multiple Resources and Mental Workload , 2008, Hum. Factors.

[26]  R. D. Campbell,et al.  Human performance and limitations in aviation , 1991 .

[27]  Kim F. Nimon,et al.  Interpreting Multiple Linear Regression: A Guidebook of Variable Importance , 2012 .

[28]  Douglas A. Wiegmann,et al.  Analysis of Mid-Air Collisions in Civil Aviation , 2001 .

[29]  Fred H. Previc,et al.  Spatial Orientation in Flight , 1993 .

[30]  S. Sternberg Memory-scanning: mental processes revealed by reaction-time experiments. , 1969, American scientist.

[31]  Chester L. Olson,et al.  Comparative Robustness of Six Tests in Multivariate Analysis of Variance , 1974 .

[32]  Anthony J. Aretz,et al.  The Mental Rotation of Map Displays , 1992 .

[33]  Anthony J. Aretz The Design of Electronic Map Displays , 1991 .

[34]  B. Tabachnick,et al.  Using multivariate statistics, 5th ed. , 2007 .

[35]  Reinhard Braunstingl,et al.  Traffic Displays for Visual Flight Indicating Track and Priority Cues , 2014, IEEE Transactions on Human-Machine Systems.

[36]  Juergen Thorbeck Gliding Research – An Important Incubator for the Entire Aviation , 2009 .

[37]  Jeff Sauro,et al.  The Factor Structure of the System Usability Scale , 2009, HCI.

[38]  C Craig Morris,et al.  Midair collisions: limitations of the see-and-avoid concept in civil aviation. , 2005, Aviation, space, and environmental medicine.

[39]  R. Bakeman Recommended effect size statistics for repeated measures designs , 2005, Behavior research methods.

[40]  Kurt Colvin,et al.  Is Pilots’ Visual Scanning Adequate to Avoid Mid-Air Collisions? , 2005 .

[41]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[42]  Urban Maeder,et al.  Trajectory prediction for low-cost collision avoidance systems , 2009, 2009 IEEE/AIAA 28th Digital Avionics Systems Conference.

[43]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[44]  Saul Sternberg,et al.  The discovery of processing stages: Extensions of Donders' method , 1969 .

[45]  Morton B. Brown,et al.  372: The Anova and Multiple Comparisons for Data with Heterogeneous Variances , 1974 .

[46]  Amy L. Alexander,et al.  Measuring Traffic Awareness in an Integrated Hazard Display , 2004 .

[47]  H P Shuch,et al.  The influence of flight experience on midair collision risk perception. , 1992, Accident; analysis and prevention.

[48]  David D. Woods,et al.  Visual Momentum: A Concept to Improve the Cognitive Coupling of Person and Computer , 1984, Int. J. Man Mach. Stud..

[49]  H. Viebahn Konzeption und Untersuchung eines bordautonomen Systems zur Vermeidung von Kollisionen im Luftverkehr , 1997 .

[50]  Guy L. Lacroix,et al.  Decomposing interactions using GLM in combination with the COMPARE, LMATRIX and MMATRIX subcommands in SPSS , 2012 .

[51]  Uwe Klingauf,et al.  Enhancing Situational Awareness by Perspective Panoramic Information Presentation , 2012 .

[52]  Lynne M Connelly,et al.  Fisher's Exact Test. , 2016, Medsurg nursing : official journal of the Academy of Medical-Surgical Nurses.

[53]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[54]  Diana Adler,et al.  Using Multivariate Statistics , 2016 .

[55]  Mica R. Endsley,et al.  Situation awareness global assessment technique (SAGAT) , 1988, Proceedings of the IEEE 1988 National Aerospace and Electronics Conference.

[56]  Eric de Boer SAFETY PAYS! A proposal to the International Gliding Commission , 2011 .

[57]  Chester L. Olson,et al.  Practical considerations in choosing a MANOVA test statistic: A rejoinder to Stevens. , 1979 .

[58]  Christopher D. Wickens,et al.  Situation Awareness and Workload in Aviation , 2002 .

[59]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[60]  F. Thomas Eggemeier,et al.  Workload assessment methodology. , 1986 .

[61]  John Uhlarik,et al.  A Review of Situation Awareness Literature Relevant to Pilot Surveillance Functions , 2002 .

[62]  Nima Barraci Conflict Resolution in Autonomous Operations Area Airspace , 2010 .

[63]  Christina König Analyse und Anwendung eines menschzentrierten Gestaltungsprozesses zur Entwicklung von Human-Machine-Interfaces im Arbeitskontext am Beispiel Flugsicherung , 2012 .

[64]  Robert R A van Doorn,et al.  Glider accidents: an analysis of 143 cases, 2001-2005. , 2007, Aviation, space, and environmental medicine.

[65]  Reinhard Braunstingl,et al.  Requirements for Future Collision Avoidance Systems in Visual Flight: A Human-Centered Approach , 2013, IEEE Transactions on Human-Machine Systems.

[66]  J. R. Thomas,et al.  A generalized rank-order method for nonparametric analysis of data from exercise science: a tutorial. , 1999, Research quarterly for exercise and sport.

[67]  N. M. Morris,et al.  On Looking into the Black Box: Prospects and Limits in the Search for Mental Models , 1986 .

[68]  Robert McLeish,et al.  The executive producer , 2005 .