Prepared for

An extensive investigation of the format for head-up display (HUD) instrumentation was conducted in a two-part experiment. First, a pilot’s information requirements for the tasks of approach, landing, and taxi were determined through a survey administered to professional commercial pilots via the world wide web. The results of the survey were applied in the development of two symbology sets, one set for flight navigation and the second for ground navigation. Second, twenty pilots from the University of Illinois at Urbana-Champaign were recruited to participate a 3-day experiment. The study was designed to investigate the format for symbology on HUDs and the performance effects of using conformal and partially conformal symbology to support the pilots’ tasks. In addition, two different methods were investigated for supporting the pilots’ transition between the task of flying and the task of landing. A seamless transition used visual momentum techniques to smoothly guide the pilots’ cognitive transition between the serial displays and the associated tasks. A seamed approach employed an abrupt change between the displays to alert the pilots of the task switch. The results indicate that incorporating a virtually conformal, tunnel-in-the-sky symbology into a complete HUD instrumentation set offers promising pilot performance effects. Pilots easily navigated the complex curved approaches with little to no deviation from the flight path (approximately 10 feet), while performing the secondary tasks of the scanning their instruments and the environment. The seamless transition between the flight and ground symbology offered the pilots a preview of the upcoming landing task, thereby preparing them for the task switch. On the ground, the perspective (scene-linked) symbology set supported landing and taxi navigation tasks with the equal efficiency to the plan view display but with much greater precision. Theories of allocation of attention were used to interpret the experimental findings. Attention was found to be more widely distributed in X-Y space when the pilots were flying with the conformal, tunnel-in-the-sky as compared to the partially conformal ILS symbology set. There was little evidence that the air-based navigation displays were supporting divided attention in three-dimensional space. The ground-based scene-linked (truly conformal) display indicated promising effects of dividing attention in depth without negative consequences to processing the near domain symbology. Event expectancy was found to modulate pilot performance in the detection of events both on the symbology and in the environment. The phenomenon known as cognitive tunneling is discussed as a possible cause of the inadequate response times in resolving the anomalous events.

[1]  H. A. Witkin A Manual for the embedded figures tests , 1971 .

[2]  C. Owsley,et al.  The useful field of view test: a new technique for evaluating age-related declines in visual function. , 1993, Journal of the American Optometric Association.

[3]  David C. Foyle,et al.  Scene-Linked Symbology to Improve Situation Awareness , 1996 .

[4]  S. Yantis,et al.  Uniqueness of abrupt visual onset in capturing attention , 1988, Perception & psychophysics.

[5]  Tyler T Prevett,et al.  Exploring the dimensions of egocentricity in aircraft navigation displays , 1995 .

[6]  J. Duncan Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[7]  George P. Boucek,et al.  The Use of Holographic Head-Up Display of Flight Path Symbology in Varying Weather Conditions , 1983 .

[8]  W H Teichner,et al.  Visual Search for Complex Targets , 1979, Human factors.

[9]  Patricia A. May,et al.  The Role of Visual Attention in Head-Up Displays: Design Implications for Varying Symbology Intensity , 1995 .

[10]  A H van der Heijden,et al.  Some evidence for a limited capacity parallel selfterminating process in simple visual search tasks. , 1975, Acta psychologica.

[11]  Christopher D. Wickens,et al.  Superimposition, Symbology, Visual Attention, and the Head-Up Display , 1997, Hum. Factors.

[12]  C D Wickens,et al.  Head-Up Displays: Effect of Clutter, Display Intensity, and Display Location on Pilot Performance , 1998 .

[13]  Richard F. Haines,et al.  Head-Up Display (HUD) Utility, II: Runway to Hud Transitions Monitoring Eye Focus and Decision Times , 1985 .

[14]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[15]  C. Eriksen,et al.  Effects of noise letters upon the identification of a target letter in a nonsearch task , 1974 .

[16]  Christopher D. Wickens,et al.  Two- and Three-Dimensional Displays for Aviation: A Theoretical and Empirical Comparison , 1993 .

[17]  Arthur F. Kramer,et al.  Attentional Guidance in Visual Attention , 1993 .

[18]  Marilyn Bohl,et al.  Information processing , 1971 .

[19]  G. Santucci,et al.  [Visual displays]. , 1981, L'Annee therapeutique et clinique en ophtalmologie.

[20]  D. Alan Allport,et al.  SHIFTING INTENTIONAL SET - EXPLORING THE DYNAMIC CONTROL OF TASKS , 1994 .

[21]  Lisa F. Weinstein,et al.  Use of Nontraditional Flight Displays for the Reduction of Central Visual Overload in the Cockpit , 1992 .

[22]  Charles E. Billings,et al.  Aviation Automation: The Search for A Human-centered Approach , 1996 .

[23]  Geerd Philipsen,et al.  Effects of six different highlighting modes on visual search performance in menu options , 1994, Int. J. Hum. Comput. Interact..

[24]  James W. Lasswell The Effects of Display Location and Dimensionality on Taxiway Navigation. , 1995 .

[25]  John M. Reising,et al.  A Comparison of Two Head up Display Formats Used to Fly Curved Instrument Approaches , 1995 .

[26]  E. Theunissen Integrated design of a man-machine interface for 4-D navigation , 1997 .

[27]  Jonathan Levy,et al.  Performance Benefits with Scene-Linked Hud Symbology: An Attentional Phenomenon? , 1998 .

[28]  Beverly D. Sanford,et al.  Attentional issues in superimposed flight symbology , 1991 .

[29]  R. Becklen,et al.  Selective looking and the noticing of unexpected events , 1983 .

[30]  Thomas E. Nygren,et al.  Psychometric Properties of Subjective Workload Measurement Techniques: Implications for Their Use in the Assessment of Perceived Mental Workload , 1991 .

[31]  Dennis B. Beringer Automation in General Aviation: Responses of Pilots to Autopilot and Pitch Trim Malfunctions , 1996 .

[32]  Charles Curtis Eriksen,et al.  The extent of processing of noise elements during selective encoding from visual displays , 1973 .

[33]  Anthony D. Andre,et al.  Taxiway Navigation and Situation Awareness (T-NASA) System: Problem, Design Philosophy, and Description of an Integrated Display Suite for Low-Visibility Airport Surface Operations , 1996 .

[34]  U. Neisser,et al.  Selective looking: Attending to visually specified events , 1975, Cognitive Psychology.

[35]  S. Yantis Multielement visual tracking: Attention and perceptual organization , 1992, Cognitive Psychology.

[36]  R. Patterson Auditory warning sounds in the work environment. , 1990, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[37]  Susan G. Hill,et al.  Traditional and raw task load index (TLX) correlations: Are paired comparisons necessary? In A , 1989 .

[38]  Amy R. Pritchett,et al.  Issues in airborne systems for closely-spaced parallel runway operations , 1995, Proceedings of 14th Digital Avionics Systems Conference.

[39]  Neville Moray The Role of Attention in the Detection of Errors and the Diagnosis of Failures in Man-Machine Systems , 1981 .

[40]  G. Baylis,et al.  Visual attention and objects: evidence for hierarchical coding of location. , 1993, Journal of experimental psychology. Human perception and performance.

[41]  C.D. Wickens,et al.  Ergonomic design for perspective flight-path displays , 1989, IEEE Control Systems Magazine.

[42]  Christopher D. Wickens,et al.  Electronic Map Evaluation in Simulated Visual Meteorological Conditions , 1997 .

[43]  R. S. Bray,et al.  An Operational evaluation of head up displays for civil transport operations. NASA/FAA phase 3 report , 1982 .

[44]  J. diVita,et al.  A Redundant Use of Luminance and Flashing with Shape and Color as Highlighting Codes ,in Symbolic Displays , 2022 .

[45]  J. Senders,et al.  Eye Movements and Psychological Processes , 1976 .

[46]  K Nakayama,et al.  Visual attention to surfaces in three-dimensional space. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[47]  Christopher D. Wickens,et al.  Costs and Benefits of Head-Up Display Use: A Meta-Analytic Approach , 1998 .

[48]  A. Kramer,et al.  Perceptual organization and focused attention: The role of objects and proximity in visual processing , 1991, Perception & psychophysics.

[49]  Amy R. Pritchett,et al.  Pilot Situation Awareness and Alerting System Commands , 1998 .

[50]  D L Fisher,et al.  Minimizing the Time to Search Visual Displays: The Role of Highlighting , 1989, Human factors.

[51]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[52]  T J Triggs,et al.  THE EFFECTS OF DRIVING DEMAND AND ROADWAY ENVIRONMENT ON PERIPHERAL VISUAL DETECTIONS , 1976 .

[53]  J. Easterbrook The effect of emotion on cue utilization and the organization of behavior. , 1959, Psychological review.

[54]  David C. Foyle,et al.  Attentional Issues with Superimposed Symbology: Formats for Scene-Linked Displays , 1995 .

[55]  L W Stark,et al.  Efficiency of searchpatterns. , 1993, Computers in biology and medicine.

[56]  Carole A Shifrin AVIATION SAFETY TAKES CENTER STAGE WORLDWIDE. , 1996 .

[57]  A. Nagy,et al.  Chromaticity and Luminance as Coding Dimensions in Visual Search , 1992, Human factors.

[58]  S. Monsell,et al.  Costs of a predictible switch between simple cognitive tasks. , 1995 .

[59]  Nicholas J. Ward,et al.  Effect of Background Scene Complexity and Field Dependence on the Legibility of Head-Up Displays for Automotive Applications , 1995, Hum. Factors.

[60]  C. Wickens Engineering psychology and human performance, 2nd ed. , 1992 .

[61]  Marilyn Jager Adams,et al.  Situation Awareness and the Cognitive Management of Complex Systems , 1995, Hum. Factors.

[62]  Curt C. Braun,et al.  Clutter and Display Conformality: Changes in Cognitive Capture , 1996 .

[63]  Richard E. Ozmore,et al.  EVALUATION OF DUAL SIMULTANEOUS INSTRUMENT LANDING SYSTEM APPROACHES TO RUNWAYS SPACED 3000 FEET APART WITH ONE LOCALIZER OFFSET USING A PRECISION RUNWAY MONITOR SYSTEM , 1996 .

[64]  K. W. Alter,et al.  Definition of the 2005 flight deck environment , 1992 .

[65]  I. Rock,et al.  Perceptual organization and attention , 1992, Cognitive Psychology.

[66]  Christopher D. Wickens,et al.  Object versus space-based models of visual attention: Implications for the design of head-up displays , 1995 .

[67]  Beverly D. Sanford,et al.  Attentional Effects with Superimposed Symbology: Implications for Head-up Displays (HUD) , 1993 .

[68]  S. Yantis Stimulus-Driven Attentional Capture , 1993 .

[69]  Christopher D. Wickens,et al.  Proximity Compatibility and Information Display: Effects of Color, Space, and Objectness on Information Integration , 1990 .

[70]  Mustapha Mouloua,et al.  Automation Technology and Human Performance: Current Research and Trends , 1999 .

[71]  David C. Foyle,et al.  Modelling Attentional Effects with Head-up Displays , 1993 .

[72]  William J. Cody,et al.  An Exploration of Function Analysis and Function Allocation in the Commercial Flight Domain , 1991 .

[73]  D. Kahneman,et al.  Attention and Effort , 1973 .

[74]  Christopher D. Wickens,et al.  Display Formatting Techniques for Improving Situation Awareness in the Aircraft Cockpit , 1991 .

[75]  D L Fisher,et al.  Visual Displays: The Highlighting Paradox , 1989, Human factors.

[76]  David D. Woods,et al.  Visual Momentum: A Concept to Improve the Cognitive Coupling of Person and Computer , 1984, Int. J. Man Mach. Stud..

[77]  Melanie C. Clay Key Cognitive Issues in the Design of Electronic Displays of Instrument Approach Procedure Charts , 1993 .

[78]  R I Thackray,et al.  Effects of monitoring under high and low taskload on detection of flashing and coloured radar targets. , 1991, Ergonomics.

[79]  D. Broadbent Task combination and selective intake of information. , 1982, Acta psychologica.

[80]  Wendell R. Ricks,et al.  Cognitive models of pilot categorization and prioritization of flight-deck information , 1995 .

[81]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[82]  Anthony J. Aretz The Design of Electronic Map Displays , 1991 .

[83]  Christopher D. Wickens,et al.  Tactical Displays for Combat Awareness: An Examination of Dimensionality and Frame of Reference Concepts and the Application of Cognitive Engineering , 2000 .

[84]  G J Andersen,et al.  Focused attention in three-dimensional space , 1990, Perception & psychophysics.

[85]  Richard F. Haines,et al.  The Utility of Head-Up Displays: Eye-Focus vs Decision Times , 1984 .

[86]  Mica R. Endsley,et al.  Experimental Analysis and Measurement of Situation Awareness , 1995 .

[87]  Nicholas J. Ward,et al.  The Effect of Vision Enhancement Systems on Driver Peripheral Visual Performance , 1997 .

[88]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[89]  A. H. C. van der Heijden,et al.  Some evidence for a limited capacity parallel selfterminating process in simple visual search tasks , 1975 .

[90]  Anthony D. Andre,et al.  Advanced Navigation Aids in the Flight Deck: Effects on Ground Taxi Performance Under Low Visibility Conditions , 1996 .

[91]  Donald E. Broadbent,et al.  The current state of noise research: Reply to Poulton. , 1978 .

[92]  Christopher D. Wickens,et al.  Attentional tunneling and the head-up display , 1993 .

[93]  J. Theeuwes,et al.  Spatial cuing in a stereoscopic display: Evidence for a “depth-aware” attentional focus , 1997 .

[94]  S.M. Harris,et al.  Information Processing , 1977, Nature.

[95]  Ken Nakayama,et al.  Serial and parallel processing of visual feature conjunctions , 1986, Nature.

[96]  Gary E. Riccio,et al.  Visual Cue Dominance Hierarchies: Implications for Simulator Design , 1985 .