Thinking about the weather: How display salience and knowledge affect performance in a graphic inference task.

Three experiments examined how bottom-up and top-down processes interact when people view and make inferences from complex visual displays (weather maps). Bottom-up effects of display design were investigated by manipulating the relative visual salience of task-relevant and task-irrelevant information across different maps. Top-down effects of domain knowledge were investigated by examining performance and eye fixations before and after participants learned relevant meteorological principles. Map design and knowledge interacted such that salience had no effect on performance before participants learned the meteorological principles; however, after learning, participants were more accurate if they viewed maps that made task-relevant information more visually salient. Effects of display design on task performance were somewhat dissociated from effects of display design on eye fixations. The results support a model in which eye fixations are directed primarily by top-down factors (task and domain knowledge). They suggest that good display design facilitates performance not just by guiding where viewers look in a complex display but also by facilitating processing of the visual features that represent task-relevant information at a given display location. (PsycINFO Database Record (c) 2009 APA, all rights reserved).

[1]  Jiajie Zhang,et al.  Representations in Distributed Cognitive Tasks , 1994, Cogn. Sci..

[2]  D. Ballard,et al.  Task constraints in visual working memory , 1997, Vision Research.

[3]  Richard Lowe,et al.  Constructing a mental representation from an abstract technical diagram , 1993 .

[4]  T. Foulsham,et al.  How Does the Purpose of Inspection Influence the Potency of Visual Salience in Scene Perception? , 2007, Perception.

[5]  Michael J. Spivey,et al.  Eye Movements and Problem Solving , 2003, Psychological science.

[6]  M. Hegarty,et al.  Graphs as aids to knowledge construction: Signaling techniques for guiding the process of graph comprehension. , 1999 .

[7]  Peter Chapman,et al.  VISUAL SEARCH PATTERNS IN TRAINED AND UNTRAINED NOVICE DRIVERS , 2002 .

[8]  J. Henderson,et al.  Testing a conceptual locus , 2003 .

[9]  Robin L. Hill,et al.  Eye movements : a window on mind and brain , 2007 .

[10]  J. Henderson,et al.  Testing a conceptual locus for the inconsistent object change detection advantage in real-world scenes. , 2003, Memory & cognition.

[11]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[12]  Priti Shah,et al.  A Model of the Perceptual and Conceptual Processes in Graph Comprehension , 1998 .

[13]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[14]  Richard Lowe,et al.  Selectivity in diagrams: reading beyond the lines , 1994 .

[15]  Priti Shah,et al.  The Comprehension of Quantitative Information in Graphical Displays. , 2005 .

[16]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[17]  Alan M. MacEachren,et al.  How Maps Work - Representation, Visualization, and Design , 1995 .

[18]  Laura E. Thomas,et al.  Moving eyes and moving thought: On the spatial compatibility between eye movements and cognition , 2007, Psychonomic bulletin & review.

[19]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[20]  Michael L. Mack,et al.  VISUAL SALIENCY DOES NOT ACCOUNT FOR EYE MOVEMENTS DURING VISUAL SEARCH IN REAL-WORLD SCENES , 2007 .

[21]  N. Charness,et al.  Visual Span in Expert Chess Players: Evidence From Eye Movements , 2001, Psychological science.

[22]  Fernanda Ferreira,et al.  Scene Perception for Psycholinguists. , 2004 .

[23]  D. E. Irwin,et al.  Our Eyes do Not Always Go Where we Want Them to Go: Capture of the Eyes by New Objects , 1998 .

[24]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[25]  S. Dumais,et al.  Handbook of applied cognition , 2007 .

[26]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[27]  R. Ratwani.  Graph Schema 1 Running Head : Shedding Light on the Graph Schema Shedding Light on the Graph Schema : Perceptual Features vs . Invariant Structure , 2008 .

[28]  Gerald L. Lohse,et al.  A Cognitive Model for Understanding Graphical Perception , 1993, Hum. Comput. Interact..

[29]  Susan Bell Trickett,et al.  Toward a Comprehensive Model of Graph Comprehension: Making the Case for Spatial Cognition , 2006, Diagrams.

[30]  M. Scheerer,et al.  Problem Solving , 1967, Nature.

[31]  Sara Irina Fabrikant,et al.  THEMATIC RELEVANCE AND PERCEPTUAL SALIENCE OF DYNAMIC GEOVISUALIZATION DISPLAYS , 2005 .

[32]  Christopher D. Wickens,et al.  Attentional Filtering in the Design of Electronic Map Displays: A Comparison of Color Coding, Intensity Coding, and Decluttering Techniques , 2001, Hum. Factors.

[33]  Padraic Monaghan,et al.  Proceedings of the 23rd annual conference of the cognitive science society , 2001 .

[34]  H. Haider,et al.  Eye movement during skill acquisition: More evidence for the information-reduction hypothesis , 1999 .

[35]  R. Dodhia.  A Review of Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences (3rd ed.) , 2005 .

[36]  S. Kosslyn.  Understanding charts and graphs , 1989 .

[37]  S. Yantis,et al.  On the distinction between visual salience and stimulus-driven attentional capture. , 1999, Journal of experimental psychology. Human perception and performance.

[38]  J. Henderson,et al.  Object appearance, disappearance, and attention prioritization in real-world scenes , 2005, Psychonomic bulletin & review.

[39]  Susan Bell Trickett,et al.  A New Model of Graph and Visualization Usage , 2001 .

[40]  Stephan Lewandowsky,et al.  Statistical graphs and maps , 1999 .

[41]  L. R. Novick,et al.  Understanding phylogenies in biology: the influence of a Gestalt Perceptual Principle. , 2007, Journal of experimental psychology. Applied.

[42]  K. Holyoak,et al.  Mapping conceptual to spatial relations in visual reasoning. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[43]  Mary M Hayhoe,et al.  Task and context determine where you look. , 2016, Journal of vision.

[44]  Mary Hegarty,et al.  Effects of knowledge and display design on comprehension of complex graphics , 2010 .

[45]  David K. Simkin,et al.  An Information-Processing Analysis of Graph Perception , 1987 .

[46]  Steven Pinker,et al.  A theory of graph comprehension. , 1990 .

[47]  W. Hays.  Semiology of Graphics: Diagrams Networks Maps. , 1985 .

[48]  Richard K. Lowe.  Background knowledge and the construction of a situational representation from a diagram , 1996 .

[49]  Priti Shah,et al.  Toward a Model of Knowledge-Based Graph Comprehension , 2002, Diagrams.

[50]  N. Charness,et al.  The perceptual aspect of skilled performance in chess: Evidence from eye movements , 2001, Memory & cognition.

[51]  T. Foulsham,et al.  Quarterly Journal of Experimental Psychology: in press Visual saliency and semantic incongruency influence eye movements when , 2022 .

[52]  P. Carpenter,et al.  Conceptual limitations in comprehending line graphs. , 1995 .

[53]  M. Farah,et al.  Does visual attention select objects or locations? , 1994, Journal of experimental psychology. General.

[54]  A. Friedman.  Framing pictures: the role of knowledge in automatized encoding and memory for gist. , 1979, Journal of experimental psychology. General.

[55]  Roy O. Freedle,et al.  Artificial Intelligence and the Future of Testing , 1990 .

[56]  D. Simons.  Attentional capture and inattentional blindness , 2000, Trends in Cognitive Sciences.

[57]  Linda W. Pickle,et al.  A Cognitive Subtask Model of Statistical Map Reading , 1996 .

[58]  K. Turano,et al.  Oculomotor strategies for the direction of gaze tested with a real-world activity , 2003, Vision Research.

[59]  I. Biederman,et al.  Scene perception: Detecting and judging objects undergoing relational violations , 1982, Cognitive Psychology.

[60]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987 .

[61]  Daniel L. Schwartz,et al.  A time for telling , 1998 .

[62]  Zenzi M. Griffin,et al.  Why Look? Reasons for Eye Movements Related to Language Production. , 2004 .

[63]  Raj M. Ratwani,et al.  Shedding light on the graph schema: Perceptual features versus invariant structure , 2008, Psychonomic bulletin & review.

[64]  Peter A. Frensch,et al.  The Role of Information Reduction in Skill Acquisition , 1996, Cognitive Psychology.

[65]  Peter C.-H. Cheng,et al.  Modeling the Effect of Task and Graphical Representation on Response Latency in a Graph Reading Task , 2003, Hum. Factors.

[66]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[67]  Robert L. Goldstone,et al.  How abstract is symbolic thought? , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[68]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[69]  D. E. Irwin,et al.  Attentional and oculomotor capture by onset, luminance and color singletons , 2000, Vision Research.

[70]  Jeffrey S. Torguson,et al.  Cartography , 2019, Dictionary of Geotourism.

[71]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[72]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[73]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[74]  G Underwood,et al.  Visual attention and the transition from novice to advanced driver , 2007, Ergonomics.

[75]  I. Rock,et al.  The effect of inattention on form perception. , 1981, Journal of experimental psychology. Human perception and performance.

[76]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .