Display Clutter

Objective: We aimed to synthesize the literature on display clutter by reviewing definitions and measurement techniques and to develop a comprehensive, ergonomics-oriented perspective on clutter. We provide guidance for the selection of measurement approaches that can capture the various aspects and effects of clutter on visual search in particular. Background: There is agreement that clutter may represent a significant problem to operators. The challenge is to determine the ideal middle ground between excessive data and insufficient information. However, definitions of clutter vary widely, which explains the range of measurement approaches, including image-processing algorithms, performance evaluation, subjective evaluation, and eye tracking. It is important to understand the affordances of each technique and provide guidance for their use. Method: We provide a systematic review of clutter definitions and develop a performance-oriented perspective for ergonomics research. Next, we present a critical overview of clutter measurement approaches. The benefits and limitations of each technique are detailed, and recommendations for best practice are provided. Results: From an ergonomics perspective, clutter matters to the extent that it affects performance, particularly, visual search. A combination of measurement techniques can be employed in order to assess the performance costs stemming from the multiple aspects of clutter. Conclusion: Display clutter is a multifaceted construct that is a problem when it results in performance and attentional costs. The assessment of these costs is critical and requires the use of appropriate and complementary techniques. Application: It is important that the performance costs of clutter are detected reliably to be able to better support attention management.

[1]  A. Oliva,et al.  Segmentation of objects from backgrounds in visual search tasks , 2002, Vision Research.

[2]  David L. Wilson.  Image-based contrast-to-clutter modeling of detection , 2001 .

[3]  Zelin Shi,et al.  FD: A feature difference based image clutter metric for targeting performance , 2012 .

[4]  M. Bravo,et al.  Object recognition in dense clutter , 2006, Perception & psychophysics.

[5]  Randall E. Bailey,et al.  Crew and display concepts evaluation for synthetic/enhanced vision systems , 2006, SPIE Defense + Commercial Sensing.

[6]  C. Trevarthen.  Review: Cognition and Reality: Principles and Implications of Cognitive Psychology , 1977 .

[7]  Thomas S. Tullis.  Chapter 18 – Screen Design , 1988 .

[8]  Tom Troscianko,et al.  Regional effects of clutter on human target detection performance. , 2013, Journal of vision.

[9]  Mohan M. Trivedi,et al.  Developing texture-based image clutter measures for object detection , 1992 .

[10]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[11]  William R. Reynolds,et al.  Sensor and detection algorithm-based clutter metrics , 1997 .

[12]  Robert J. K. Jacob,et al.  Eye tracking in human-computer interaction and usability research : Ready to deliver the promises , 2002 .

[13]  Biyun Zhu,et al.  Effects of Superposition on Oculomotor Guidance and Target Recognition , 2012 .

[14]  D L Fisher,et al.  Visual Displays: The Highlighting Paradox , 1989, Human factors.

[15]  Maura C. Lohrenz,et al.  Investigating Issues of Display Content vs. Clutter during Air-to-Ground Targeting Missions , 2004 .

[16]  Michael S. Ambinder,et al.  The Role of Highlighting in Visual Search Through Maps , 2004, Spatial vision.

[17]  Randall E. Bailey,et al.  Flight test comparison between enhanced vision (FLIR) and synthetic vision systems , 2005, SPIE Defense + Commercial Sensing.

[18]  Preeti Verghese,et al.  Visual search in clutter , 2004, Vision Research.

[19]  Stanley R. Rotman,et al.  Textural metrics for clutter affecting human target acquisition , 1996 .

[20]  George L. Malcolm,et al.  The effects of target template specificity on visual search in real-world scenes: evidence from eye movements. , 2009, Journal of vision.

[21]  Marc van Kreveld,et al.  Evaluating the Consistency of Cartographic Generalization , 1998 .

[22]  Efthimis N. Efthimiadis,et al.  Efficient De-identification of Electronic Patient Records for User Cognitive Testing , 2012, 2012 45th Hawaii International Conference on System Sciences.

[23]  Christopher D. Wickens,et al.  Head Up versus Head Down: The Costs of Imprecision, Unreliability, and Visual Clutter on Cue Effectiveness for Display Signaling , 2003, Hum. Factors.

[24]  Stanley R. Rotman,et al.  Evaluation of human detection performance of targets embedded in natural and enhanced infrared images using image metrics , 2000 .

[25]  L G Williams,et al.  Color Coding for Information Location , 1971, Human factors.

[26]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[27]  Randa L. Shehab,et al.  Complexity Questionnaires of Visual Displays: A Validation Study of Two Information Complexity Questionnaires of Visual Displays , 2013 .

[28]  Marshall Weathersby,et al.  Detection Performance in Clutter with Variable Resolution , 1983, IEEE Transactions on Aerospace and Electronic Systems.

[29]  L. P. Roy,et al.  Accurate K-distributed clutter model for scanning radar application , 2010 .

[30]  G. R. J. Hockey,et al.  Applied Attention Theory , 2009 .

[31]  S. Yantis.  Stimulus-Driven Attentional Capture , 1993 .

[32]  O.O. Fadiran,et al.  Clutter complexity analysis of hyper-spectral bands , 2004, Thirty-Sixth Southeastern Symposium on System Theory, 2004. Proceedings of the.

[33]  Qian Li,et al.  Sparse-representation-based clutter metric. , 2011, Applied optics.

[34]  D. Burr,et al.  Visual Clutter Causes High-Magnitude Errors , 2006, PLoS biology.

[35]  Dennis E. Egan,et al.  Handbook of Human Computer Interaction , 1988 .

[36]  S. Sundar,et al.  Relevance to the Rescue: Can “Smart Ads” Reduce Negative Response to Online Ad Clutter? , 2010 .

[37]  Melissa R. Beck,et al.  Measuring search efficiency in complex visual search tasks: global and local clutter. , 2010, Journal of experimental psychology. Applied.

[38]  S. Yantis,et al.  Visual attention: control, representation, and time course. , 1997, Annual review of psychology.

[39]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[40]  David B. Kaber,et al.  Assessing the Effects of Conformal Terrain Features in Advanced Head-Up Displays on Pilot Performance , 2009 .

[41]  Ying Wu,et al.  Effects of perceptual complexity on older and younger adults’ target acquisition performance , 2014, Behav. Inf. Technol..

[42]  Mosleh Uddin,et al.  Clutter modeling in infrared images using genetic programming , 2000 .

[43]  Christopher D. Wickens,et al.  Costs and Benefits of Head-Up Display Use: A Meta-Analytic Approach , 1998 .

[44]  Melanie C. Clay.  Key Cognitive Issues in the Design of Electronic Displays of Instrument Approach Procedure Charts , 1993 .

[45]  Christopher D. Wickens,et al.  The Proximity Compatibility Principle: Its Psychological Foundation and Relevance to Display Design , 1995, Hum. Factors.

[46]  J. Henderson,et al.  The effects of semantic consistency on eye movements during complex scene viewing , 1999 .

[47]  Harri Siirtola,et al.  Using Gaze Data in Evaluating Interactive Visualizations , 2009, HCIV.

[48]  D. Pelli,et al.  The uncrowded window of object recognition , 2008, Nature Neuroscience.

[49]  Marcus Nyström,et al.  A vector-based, multidimensional scanpath similarity measure , 2010, ETRA.

[50]  Harvey S. Smallman,et al.  Heuristic Automation for Decluttering Tactical Displays , 2005, Hum. Factors.

[51]  David B. Kaber,et al.  Bottom-up and Top-down Contributors to Pilot Perceptions of Display Clutter in Advanced Flight Deck Technologies , 2008 .

[52]  Stanley R. Rotman,et al.  Evaluating human detection performance of targets and false alarms, using a statistical texture image metric , 2000 .

[53]  Daniel McCrobie.  Visual Display Screen Clutter Metrics , 2000 .

[54]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[55]  Moreno I. Coco,et al.  The Impact of Visual Information on Reference Assignment in Sentence Production , 2009 .

[56]  Carl E. Halford,et al.  Rotational clutter metric , 2009 .

[57]  George A. Lampropoulos,et al.  Clutter and target characterization using Markov chains , 2003, SPIE Remote Sensing.

[58]  C D Wickens,et al.  Head-Up Displays: Effect of Clutter, Display Intensity, and Display Location on Pilot Performance , 1998 .

[59]  Kamesh Namuduri,et al.  Image metrics for clutter characterization , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[60]  Delian Liu,et al.  Clutter metric based on the Cramer-Rao lower bound on automatic target recognition. , 2008, Applied optics.

[61]  Christopher D. Wickens,et al.  Target Cuing in Visual Search: The Effects of Conformality and Display Location on the Allocation of Visual Attention , 1999, Hum. Factors.

[62]  Charles T. Scialfa,et al.  Age Differences in Search of Web Pages: The Effects of Link Size, Link Number, and Clutter , 2004, Hum. Factors.

[63]  Jia Xu,et al.  Clutter modeling for bistatic SAR with phased array antenna and arbitrary geometry configuration , 2009, 2009 IEEE Radar Conference.

[64]  Mary Hegarty,et al.  Decoupling of Intuitions and Performance in the Use of Complex Visual Displays , 2008 .

[65]  Jianqi Zhang,et al.  Color Image Clutter Metrics for Predicting Human Target Acquisition Performance , 2010, 2010 6th International Conference on Wireless Communications Networking and Mobile Computing (WiCOM).

[66]  Joseph H. Goldberg,et al.  Eye tracking in web search tasks: design implications , 2002, ETRA.

[67]  Alan Hedge,et al.  Beauty and the Beast: Predicting Web Page Visual Appeal , 2010 .

[68]  Amy L. Alexander,et al.  Attentional Tunneling and Task Management in Synthetic Vision Displays , 2009 .

[69]  Christopher D. Wickens,et al.  Object versus space-based models of visual attention: Implications for the design of head-up displays , 1995 .

[70]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[71]  Christopher D. Wickens,et al.  Displaying multi-domain graphical databases: An evaluation of scanning clutter, display size, and user activity , 2002 .

[72]  Mary Hegarty,et al.  Cognitively Inspired and Perceptually Salient Graphic Displays for Efficient Spatial Inference Making , 2010 .

[73]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[74]  G J Zelinsky,et al.  Eye movements during change detection: Implications for search constraints, memory limitations, and scanning strategies , 2001, Perception & psychophysics.

[75]  Stanley R. Rotman,et al.  Modeling human search and target acquisition performance: fixation-point analysis , 1994 .

[76]  Steve Moyer,et al.  Performance characteristics of the masked target transform volume clutter metric , 2012 .

[77]  Christopher D. Wickens,et al.  When Users Want What's not Best for Them , 1995 .

[78]  Björn N. S. Vlaskamp,et al.  Crowding degrades saccadic search performance , 2005, Vision Research.

[79]  Sean Bechhofer,et al.  Visual complexity and aesthetic perception of web pages , 2008, SIGDOC '08.

[80]  Qian Li,et al.  Hidden Markov Models for background clutter , 2013 .

[81]  D. Donderi.  Visual complexity: a review. , 2006, Psychological bulletin.

[82]  D. Pelli,et al.  Crowding is unlike ordinary masking: distinguishing feature integration from detection. , 2004, Journal of vision.

[83]  Rebecca R. Goldstein,et al.  Searching in clutter: Visual attention strategies of expert pilots , 2012 .

[84]  Alfons Maes,et al.  Referential scope and visual clutter in navigation tasks , 2011 .

[85]  Michael L. Mack,et al.  Identifying the Perceptual Dimensions of Visual Complexity of Scenes , 2004 .

[86]  J. H. Bertera,et al.  Latency of sequential eye movements: implications for reading. , 1983, Journal of experimental psychology. Human perception and performance.

[87]  Sang-Hwan Kim,et al.  Testing and Validation of a Psychophysically Defined Metric of Display Clutter , 2013, J. Aerosp. Inf. Syst..

[88]  Yuanzhen Li,et al.  Measuring visual clutter. , 2007, Journal of vision.

[89]  Joseph H. Goldberg,et al.  Computer interface evaluation using eye movements: methods and constructs , 1999 .

[90]  Ulf Ahlstrom,et al.  Work domain analysis for air traffic controller weather displays. , 2005, Journal of safety research.

[91]  David B. Kaber,et al.  MODELING THE EFFECTS OF HUD VISUAL PROPERTIES, PILOT EXPERIENCE AND FLIGHT SCENARIO ON A MULTI-DIMENSIONAL MEASURE OF CLUTTER , 2008 .

[92]  Emilie M. Roth,et al.  Can We Ever Escape from Data Overload? A Cognitive Systems Diagnosis , 1999, Cognition, Technology & Work.

[93]  Gregory J. Zelinsky,et al.  Visual search is guided to categorically-defined targets , 2009, Vision Research.

[94]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[95]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[96]  Steven K. Moyer,et al.  Comparing masked target transform volume (MTTV) clutter metric to human observer evaluation of visual clutter , 2010, Defense + Commercial Sensing.

[97]  Tianxu Zhang,et al.  Clutter-adaptive infrared small target detection in infrared maritime scenarios , 2011 .

[98]  Geary Layne,et al.  Intelligent Electronic Navigational Aids: A New Approach , 2006, 2006 5th International Conference on Machine Learning and Applications (ICMLA'06).

[99]  James Naylor.  The Influence of Dynamics, Flight Domain and Individual Flight Training & Experience on Pilot Perception of Clutter in Aviation Displays. , 2010 .

[100]  Loran A. Haworth,et al.  Test Techniques for Evaluating Flight Displays , 1993 .

[101]  Lars Harrie,et al.  Identifying map regions that are difficult to read , 2011 .

[102]  Xing Xu,et al.  Quaternion phase-correlation-based clutter metric for color images , 2007 .

[103]  Frans W Cornelissen,et al.  A crowding model of visual clutter. , 2009, Journal of vision.

[104]  R. Phillips,et al.  An Investigation of Visual Clutter in the Topographic Base of a Geological Map , 1982 .

[105]  David B. Kaber,et al.  The Influence of Individual Differences in Perceptual Performance on Pilot Perceptions of Head-Up Display Clutter , 2010 .

[106]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[107]  C. Wickens,et al.  SYNTHETIC VISION SYSTEMS: FLIGHTPATH TRACKING, SITUATION AWARENESS, AND VISUAL SCANNING IN AN INTEGRATED HAZARD DISPLAY , 2005 .

[108]  D. Levi.  Crowding—An essential bottleneck for object recognition: A mini-review , 2008, Vision Research.

[109]  Zelin Shi,et al.  A structural difference based image clutter metric with brain cognitive model constraints , 2013 .

[110]  Sang-Hwan Kim,et al.  Multidimensional measure of display clutter and pilot performance for advanced head-up display. , 2011, Aviation, space, and environmental medicine.

[111]  M. Bravo,et al.  A scale invariant measure of clutter. , 2008, Journal of vision.

[112]  Myriam Chanceaux,et al.  The influence of clutter on real-world scene search: evidence from search efficiency and eye movements. , 2009, Journal of vision.

[113]  Charles T. Zahn,et al.  Graph-Theoretical Methods for Detecting and Describing Gestalt Clusters , 1971, IEEE Transactions on Computers.

[114]  Christopher D. Wickens,et al.  Driving and Side Task Performance: The Effects of Display Clutter, Separation, and Modality , 2004, Hum. Factors.

[115]  Christopher D. Wickens,et al.  Pathway HUDs: Are They Viable? , 2001, Hum. Factors.

[116]  Cornell Juliano,et al.  The hunt for usability: tracking eye movements , 1999, CHI Extended Abstracts.

[117]  P. Subramanian.  Active Vision: The Psychology of Looking and Seeing , 2006 .

[118]  Gregory J Zelinsky,et al.  Cutting through the clutter: searching for targets in evolving complex scenes. , 2011, Journal of vision.

[119]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[120]  Matthew O. Ward,et al.  Clutter Reduction in Multi-Dimensional Data Visualization Using Dimension Reordering , 2004, IEEE Symposium on Information Visualization.

[121]  Honghua Chang,et al.  New metrics for clutter affecting human target acquisition , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[122]  Maura C. Lohrenz,et al.  Feature Clustering to Measure Clutter in Electronic Displays , 2006 .

[123]  Alan J. Dix,et al.  A Taxonomy of Clutter Reduction for Information Visualisation , 2007, IEEE Transactions on Visualization and Computer Graphics.

[124]  M. Zuschlag,et al.  Quantification of visual clutter using a computation model of human perception : an application for head-up displays , 2004 .

[125]  O. M. Borcan,et al.  Improving visualization of trajectories by dataset reduction and line simplification , 2012 .

[126]  Jing Xing,et al.  Information Complexity in Air Traffic Control Displays , 2007, HCI.

[127]  Danny Gibbins,et al.  An empirical evaluation of infrared clutter for point target detection algorithms , 2013, Defense, Security, and Sensing.

[128]  P. Doyon-Poulin,et al.  Review of visual clutter and its effects on pilot performance: A new look at past research , 2012, 2012 IEEE/AIAA 31st Digital Avionics Systems Conference (DASC).

[129]  W H Teichner,et al.  Visual Search for Complex Targets , 1979, Human factors.

[130]  J. Palmer.  Set-size effects in visual search: The effect of attention is independent of the stimulus for simple tasks , 1994, Vision Research.

[131]  Douglas Vickers,et al.  Effects of 'local' clutter on human target detection. , 2006, Spatial vision.

[132]  G. Zelinsky.  A theory of eye movements during target acquisition. , 2008, Psychological review.

[133]  Yusuke Yamani,et al.  Visual search asymmetries within color-coded and intensity-coded displays. , 2010, Journal of experimental psychology. Applied.

[134]  Qian Li,et al.  Contrast-sensitivity-function-based clutter metric , 2012 .

[135]  Christopher D. Wickens,et al.  Up or Down? A Comparison of Helmet Mounted Display and Hand Held Display Tasks With High Clutter Imagery , 2000 .

[136]  Xin Chen,et al.  Online clutter estimation using a Gaussian kernel density estimator for target tracking , 2011, 14th International Conference on Information Fusion.

[137]  Michael E. Holmes,et al.  Clutter or content?: how on-screen enhancements affect how TV viewers scan and what they learn , 2006, ETRA.

[138]  Randall E. Bailey,et al.  Commercial Flight Crew Decision Making During Low-Visibility Approach Operations Using Fused Synthetic and Enhanced Vision Systems , 2009 .

[139]  Mohan M. Trivedi,et al.  Quantitative characterization of image clutter: problem, progress, and promises , 1993, Defense, Security, and Sensing.

[140]  Jeff B. Pelz,et al.  Fixation-identification in dynamic scenes: comparing an automated algorithm to manual coding , 2008, APGV '08.

[141]  Grant R. Gerhart,et al.  A relative clutter metric , 1998 .

[142]  B. Moran,et al.  Clutter map and target tracking , 2005, 2005 7th International Conference on Information Fusion.

[143]  Yuanzhen Li,et al.  Feature congestion: a measure of display clutter , 2005, CHI.

[144]  R. E. Christ.  Review and Analysis of Color Coding Research for Visual Displays , 1975 .

[145]  Jakob Nielsen,et al.  Chapter 4 – The Usability Engineering Lifecycle , 1993 .

[146]  S. Richard F. Sims,et al.  Signal-to-clutter measure for ATR performance comparison , 1997, Defense, Security, and Sensing.

[147]  Qian Li,et al.  Target acquisition performance in a cluttered environment. , 2012, Applied optics.

[148]  Joseph A. O'Sullivan,et al.  Kullback-Leibler distances for quantifying clutter and models , 1999 .

[149]  O.O. Fadiran,et al.  A statistical approach to quantifying clutter in hyperspectral infrared images , 2006, 2006 IEEE Aerospace Conference.

[150]  Rajesh P. N. Rao,et al.  PSYCHOLOGICAL SCIENCE Research Article EYE MOVEMENTS REVEAL THE SPATIOTEMPORAL DYNAMICS OE VISUAL SEARCH , 2022 .

[151]  M. Bravo,et al.  Recognizing and segmenting objects in clutter , 2004, Vision Research.

[152]  Zenzi M. Griffin,et al.  Why Look? Reasons for Eye Movements Related to Language Production. , 2004 .

[153]  S. Sternberg.  Retrieval of contextual information from memory , 1967 .

[154]  M. Carrasco,et al.  The contribution of covert attention to the set-size and eccentricity effects in visual search. , 1998, Journal of experimental psychology. Human perception and performance.

[155]  Miguel P Eckstein,et al.  Visual search: a retrospective. , 2011, Journal of vision.

[156]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[157]  Song Chun ZhuDept.  Clutter Modeling and Performance Analysis in Automatic Target Recognition 1 , 1998 .

[158]  Christopher D. Wickens,et al.  Traffic and Flight Guidance Depiction on a Synthetic Vision System Display: The Effects of Clutter on Performance and Visual Attention Allocation , 2004 .

[159]  Carl E. Halford,et al.  Masked target transform volume clutter metric applied to vehicle search , 2010, Defense + Commercial Sensing.

[160]  Christopher D. Wickens,et al.  3D Navigation and Integrated Hazard Display in Advanced Avionics: Workload, Performance, and Situation Awareness , 2004 .

[161]  Alexander Toet,et al.  Structural similarity determines search time and detection probability , 2010 .

[162]  David B. Kaber,et al.  Measurement and Modeling of Display Clutter in Advanced Flight Deck Technologies , 2012 .

[163]  Philip M. Blumenau,et al.  Detection of targets in infrared clutter , 2001, SPIE Defense + Commercial Sensing.

[164]  Maura C. Lohrenz,et al.  Evidence of Clutter Avoidance in Complex Scenes , 2010 .

[165]  T S Tullis,et al.  The Formatting of Alphanumeric Displays: A Review and Analysis , 1983, Human factors.

[166]  Maura C. Lohrenz,et al.  Human Factors : The Journal of the Human Factors and Ergonomics Society , 2007 .

[167]  Sang-Hwan Kim,et al.  Influence of Flight Domain and Cockpit Display Dynamics on Pilot Perceived Clutter , 2013, J. Aerosp. Inf. Syst..

[168]  A. Butchibabu,et al.  Evaluating a de-cluttering technique for NextGen RNAV and RNP charts , 2012, 2012 IEEE/AIAA 31st Digital Avionics Systems Conference (DASC).

[169]  Tommy Strandvall,et al.  Eye Tracking in Human-Computer Interaction and Usability Research , 2009, INTERACT.

[170]  Christopher D. Wickens,et al.  Attentional Filtering in the Design of Electronic Map Displays: A Comparison of Color Coding, Intensity Coding, and Decluttering Techniques , 2001, Hum. Factors.