The Influence of Dynamics, Flight Domain and Individual Flight Training & Experience on Pilot Perception of Clutter in Aviation Displays.

NAYLOR, JAMES T. The Influence of Dynamics, Flight Domain and Individual Flight Training & Experience on Pilot Perception of Clutter in Aviation Displays. (Under the direction of Dr. David Kaber). This thesis is a meta-analysis of a NASA-sponsored series of three studies conducted over three years, 2007 through 2009. The series, entitled Measures and Models of Aviation Display Clutter (MMADC), was intended to develop and test a model of flight display clutter using pilot perceptions of clutter based on multiple relevant dimensions. Year 1 (Y1) presented the pilots with static flight images from which to make their clutter assessments. Year 2 (Y2) employed a high-fidelity flight simulator, and Year 3 (Y3) was conducted using a Vertical Take-Off and Landing (VTOL) flight simulator. This thesis used statistical analysis of data gathered over the three studies to assess the effect of dynamics and vehicle-type on pilot perceptions of display clutter. This was accomplished through a comparative analysis of data from Years 1 and 2 and Years 2 and 3, respectively. Additionally, this thesis study used statistical analysis of Y3 data (the only year in which the author participated directly) to draw inferences about the effect of pilot-specific training and flight experience on flight task performance and clutter perceptions. The primary finding regarding the effect of dynamics on perceived clutter was that tasks conducted under dynamic display conditions generated lower clutter ratings, primarily attributed to the temporal context provided by dynamic displays. Primary findings from the Y2/Y3 analysis on domain (vehicle type) indicated that the pilots used primary flight cues differently between years and that an increased level of difficulty in the Y3 flight task increased pilot sensitivity to display clutter. The most significant finding among demographic factors assessed in the Y3 study was that pilots with military attack aircraft flight training and experience performed better statistically in the experimental flight tasks and produced higher clutter ratings. This combination was interpreted to indicate that pilots trained with highly complex flight displays and flight domains were more quickly able to accommodate the experimental display conditions and the unfamiliar flight environment. (The Y3 study used fixed-wing pilots as the subjects in the VTOL flight simulator.) It also indicates that the attack pilots were more discriminating in terms of which display features they found useful for the given task and which they did not. Another conclusion reached in this thesis is that goal states associated with specific flight tasks and approach segments directly impacted where the pilot was looking on the flight displays. This directly affected clutter perception in that local salience, contrast and occlusion specific to information features being actively used in the flight task drove clutter assessments. It was also determined that few training or experience factors had any significant impact on flight performance or clutter assessments. This finding indicates that ergonomic display design will prove generally more effective than a training intervention in mitigating the effects of display clutter on pilot performance and mental workload. The Influence of Dynamics, Flight Domain and Individual Flight Training & Experience on Pilot Perception of Clutter in Aviation Displays by James Theodore Naylor A thesis submitted to the Graduate Faculty of North Carolina State University in partial fulfillment of the requirements for the Degree of Master of Science Industrial Engineering Raleigh, North Carolina 2010

[1]  Michael S. Ambinder,et al.  The Role of Highlighting in Visual Search Through Maps , 2004, Spatial vision.

[2]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[3]  T. Schnell,et al.  Flight simulator evaluation of an integrated synthetic and enhanced vision system for terrain avoidance , 2005, 24th Digital Avionics Systems Conference.

[4]  Cleotilde Gonzalez,et al.  Situation Awareness in Dynamic Decision Making: Effects of Practice and Working Memory , 2007 .

[5]  Jens Rasmussen,et al.  Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[7]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[8]  M. Posner,et al.  Visual dominance: an information-processing account of its origins and significance. , 1976, Psychological review.

[9]  David B. Kaber,et al.  MODELING THE EFFECTS OF HUD VISUAL PROPERTIES, PILOT EXPERIENCE AND FLIGHT SCENARIO ON A MULTI-DIMENSIONAL MEASURE OF CLUTTER , 2008 .

[10]  Stanley R. Rotman,et al.  Evaluating human detection performance of targets and false alarms, using a statistical texture image metric , 2000 .

[11]  Randall E. Bailey,et al.  Flight Simulator Evaluation of Synthetic Vision Display Concepts to Prevent Controlled Flight Into Terrain (CFIT) , 2004 .

[12]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[13]  Michael S. Brandstein,et al.  Real-Time Automated Video and Audio Capture with Multiple Cameras and Microphones , 2001, J. VLSI Signal Process..

[14]  Douglas Vickers,et al.  Effects of 'local' clutter on human target detection. , 2006, Spatial vision.

[15]  Jing Xing,et al.  Measures of Information Complexity and the Implications for Automation Design , 2004 .

[16]  Yuanzhen Li,et al.  Feature congestion: a measure of display clutter , 2005, CHI.

[17]  Bernd Korn,et al.  Combining Enhanced and Synthetic Vision for Autonomous All-Weather Approach and Landing , 2009 .

[18]  Jarvis J. Arthur,et al.  The Efficacy of Head-Down and Head-Up Synthetic Vision Display Concepts for Retro- and Forward-Fit of Commercial Aircraft , 2004 .

[19]  Christopher D. Wickens,et al.  Costs and Benefits of Head-Up Display Use: A Meta-Analytic Approach , 1998 .

[20]  Lawrence J. Prinzel,et al.  Head-Up Displays and Attention Capture , 2004 .

[21]  Thomas B. Sheridan,et al.  Understanding Human Error and Aiding Human Diagnostic Behaviour in Nuclear Power Plants , 1981 .

[22]  Daniel J. Garland,et al.  Situation Awareness Analysis and Measurement , 2009 .

[23]  Susana Rubio,et al.  Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA‐TLX, and Workload Profile Methods , 2004 .

[24]  Thomas Schnell,et al.  Trade-Offs in Synthetic Vision System Display Resolution, Field of Regard, Terrain Data Density, Texture, and Shading During Off-Path Operations , 2009 .

[25]  Sang-Hwan Kim Examining and Explaining the Effects of Non-Iconic Conformal Features in Advanced Head-up Displays on Pilot Performance , 2009 .

[26]  Sam Herron A Case for Early Objective Evaluation of Candidate Display Formats , 1980 .

[27]  Catherine M. Burns,et al.  Putting It All Together: Improving Display Integration in Ecological Displays , 2000, Hum. Factors.

[28]  Michael P. Snow,et al.  EFFECT OF PATHWAY-IN-THE-SKY AND SYNTHETIC TERRAIN IMAGERY ON SITUATION AWARENESS IN A SIMULATED LOW-LEVEL INGRESS SCENARIO , 1999 .

[29]  Sang-Hwan Kim,et al.  Perceived clutter in advanced cockpit displays: measurement and modeling with experienced pilots. , 2008, Aviation, space, and environmental medicine.

[30]  Ulf Ahlstrom,et al.  Work domain analysis for air traffic controller weather displays. , 2005, Journal of safety research.

[31]  Robert P. Smith,et al.  Attention Distribution and Decision Making in Tactical Air Combat , 1996, Hum. Factors.

[32]  Gil Tidhar,et al.  Clutter metrics for target detection systems , 1994 .

[33]  C D Wickens,et al.  Head-Up Displays: Effect of Clutter, Display Intensity, and Display Location on Pilot Performance , 1998 .

[34]  D O'Hare,et al.  Situational awareness ability and cognitive skills training in a complex real-world task , 2007, Ergonomics.

[35]  Arthur D. Fisk,et al.  Supporting Perception in the Service of Dynamic Decision Making , 1996, Hum. Factors.

[36]  Loran A. Haworth,et al.  Test Techniques for Evaluating Flight Displays , 1993 .