Patterns of Attention: How Data Visualizations Are Read

Data visualizations are used to communicate information to people in a wide variety of contexts, but few tools are available to help visualization designers evaluate the effectiveness of their designs. Visual saliency maps that predict which regions of an image are likely to draw the viewer’s attention could be a useful evaluation tool, but existing models of visual saliency often make poor predictions for abstract data visualizations. These models do not take into account the importance of features like text in visualizations, which may lead to inaccurate saliency maps. In this paper we use data from two eye tracking experiments to investigate attention to text in data visualizations. The data sets were collected under two different task conditions: a memory task and a free viewing task. Across both tasks, the text elements in the visualizations consistently drew attention, especially during early stages of viewing. These findings highlight the need to incorporate additional features into saliency models that will be applied to visualizations.

[1]  Joseph H. Goldberg,et al.  Eye tracking for visualization evaluation: Reading values on linear versus radial graphs , 2011, Inf. Vis..

[2]  Masaaki Kawahashi,et al.  Renovation of Journal of Visualization , 2010, J. Vis..

[3]  Hanspeter Pfister,et al.  Beyond Memorability: Visualization Recognition and Recall , 2016, IEEE Transactions on Visualization and Computer Graphics.

[4]  Benjamin Strobel,et al.  Do graph readers prefer the graph type most suited to a given task? Insights from eye tracking , 2017 .

[5]  Priti Shah,et al.  A Model of the Perceptual and Conceptual Processes in Graph Comprehension , 1998 .

[6]  Peter C.-H. Cheng,et al.  Modeling the Effect of Task and Graphical Representation on Response Latency in a Graph Reading Task , 2003, Hum. Factors.

[7]  Jonathan Tran,et al.  Using Eye Tracking Metrics and Visual Saliency Maps to Assess Image Utility , 2016, HVEI.

[8]  P. Shah,et al.  Review of Graph Comprehension Research: Implications for Instruction , 2002 .

[9]  K. Rayner The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[10]  K. Rayner,et al.  Eye movements when viewing advertisements , 2013, Front. Psychol..

[11]  Ali Borji,et al.  CAT2000: A Large Scale Fixation Dataset for Boosting Saliency Research , 2015, ArXiv.

[12]  Christopher Habel,et al.  Multimodal Comprehension of Language and Graphics: Graphs with and without annotations , 2008 .

[13]  Frédo Durand,et al.  What Do Different Evaluation Metrics Tell Us About Saliency Models? , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Hanspeter Pfister,et al.  What Makes a Visualization Memorable? , 2013, IEEE Transactions on Visualization and Computer Graphics.

[15]  Ruth Rosenholtz,et al.  Do predictions of visual perception aid design? , 2011, TAP.

[16]  Bo Fu,et al.  Eye tracking the user experience - An evaluation of ontology visualization techniques , 2016, Semantic Web.

[17]  Michael J. Haass,et al.  Modeling Human Comprehension of Data Visualizations , 2017, HCI.

[18]  Cristina Conati,et al.  Individual user characteristics and information visualization: connecting the dots through eye tracking , 2013, CHI.

[19]  V. Lamme,et al.  Bottom-up and top-down attention are independent. , 2013, Journal of vision.

[20]  Joseph H. Goldberg,et al.  Comparing information graphics: a critical look at eye tracking , 2010, BELIV '10.

[21]  S. Yantis,et al.  Visual Attention: Bottom-Up Versus Top-Down , 2004, Current Biology.

[22]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[23]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[24]  Frédo Durand,et al.  A Benchmark of Computational Models of Saliency to Predict Human Fixations , 2012 .

[25]  Mary Hegarty,et al.  Effects of knowledge and display design on comprehension of complex graphics , 2010 .

[26]  Linda J. Lombardino,et al.  Comparing graphs and text: Effects of complexity and task , 2015 .