Learning From Science News via Interactive and Animated Data Visualizations: An Investigation Combining Eye Tracking, Online Survey, and Cued Retrospective Reporting

Relying on a multimethod approach with eye tracking, cued retrospective reporting, and a memory test, this experimental study (N = 45) shows how individuals engage with static, interactive, and interactive-animated data visualizations embedded in online science news. The results suggest that interactivity and animation engage participants most strongly: The second part of the news article is fixated the longest by participants exposed to the interactive-animated visualization, which translates into higher learning outcomes. However, the dynamic process of news reception requires a nuanced understanding of how users attend to visual and textual parts of a message to make informed statements about their effectiveness.

[1]  Jimmy Johansson,et al.  Map-Based Web Tools Supporting Climate Change Adaptation , 2015 .

[2]  Aleksandra Dulic,et al.  Visual Climate Change Communication: From Iconography to Locally Framed 3D Visualization , 2014 .

[3]  Luc Pauwels.  11. On the nature and role of visual representations in knowledge production and science communication , 2019 .

[4]  Lucy Atkinson,et al.  Putting Environmental Infographics Center Stage , 2015 .

[5]  Barbara Tversky,et al.  Animation: can it facilitate? , 2002, Int. J. Hum. Comput. Stud..

[6]  Michael Zeiller,et al.  Interactive Infographics in German Online Newspapers , 2016, FMT.

[7]  Connie V. Chan,et al.  Interactive Graphics for Expressing Health Risks: Development and Qualitative Evaluation , 2009, Journal of health communication.

[8]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[9]  Luis Cárcamo Ulloa,et al.  News photography for Facebook: effects of images on the visual behaviour of readers in three simulated newspaper formats , 2015, Inf. Res..

[10]  A. Leiserowitz,et al.  How to communicate the scientific consensus on climate change: plain facts, pie charts or metaphors? , 2014, Climatic Change.

[11]  Sandra Berney,et al.  Does animation enhance learning? A meta-analysis , 2016, Comput. Educ..

[12]  R. Palm,et al.  Counteracting Climate Science Politicization With Effective Frames and Imagery , 2019, Science Communication.

[13]  Kai Kaspar.  What Guides Visual Overt Attention under Natural Conditions? Past and Future Research , 2013, ISRN neuroscience.

[14]  Laurence D. Smith,et al.  Visual Inscriptions in the Scientific Hierarchy , 2006 .

[15]  Birgit Schneider,et al.  Climate model simulation visualization from a visual studies perspective , 2012 .

[16]  Annie Lang,et al.  The limited capacity model of mediated message processing , 2000 .

[17]  Sara Irina Fabrikant,et al.  How Do People View Multi-Component Animated Maps? , 2014 .

[18]  Claes H. de Vreese,et al.  Political communication in a high-choice media environment: a challenge for democracy? , 2017 .

[19]  Erik P. Bucy.  The Interactivity Paradox: Closer to the News but Confused , 2003 .

[20]  William P. Eveland,et al.  User Control and Structural Isomorphism or Disorientation and Cognitive Load? , 2001, Commun. Res..

[21]  Matthew O. Ward,et al.  Interactive Data Visualization - Foundations, Techniques, and Applications , 2010 .

[22]  Marcus Maurer,et al.  What You See Is What You Know: The Influence of Involvement and Eye Movement on Online Users’ Knowledge Acquisition , 2019 .

[23]  David Retchless,et al.  Sea Level Rise Maps: How Individual Differences Complicate the Cartographic Communication of an Uncertain Climate Change Hazard , 2014 .

[24]  Sara Leckner.  Presentation factors affecting reading behaviour in readers of newspaper media: an eye-tracking perspective , 2012 .

[25]  Sanne Kruikemeier,et al.  Learning From News on Different Media Platforms: An Eye-Tracking Experiment , 2018, Studying Politics Across Media.

[26]  S. Shyam Sundar,et al.  Interactivity and memory: Information processing of interactive versus non-interactive content , 2016, Comput. Hum. Behav..

[27]  Florian Schmidt-Weigand,et al.  A closer look at split visual attention in system- and self-paced instruction in multimedia learning , 2010 .

[28]  Richard K. Lowe,et al.  External and internal representations in multimedia learning , 2003 .

[29]  Jeffrey Heer,et al.  Capture & Analysis of Active Reading Behaviors for Interactive Articles on the Web , 2019, Comput. Graph. Forum.

[30]  Nadine Bol,et al.  Improving Visual Behavior Research in Communication Science: An Overview, Review, and Reporting Recommendations for Using Eye-Tracking Methods , 2019, Communication Methods and Measures.

[31]  J. Sterman.  Communicating climate change risks in a skeptical world , 2011 .

[32]  S. Kruikemeier,et al.  When Does an Infographic Say More Than a Thousand Words? , 2017 .

[33]  Gerd Bohner,et al.  Need for cognition: eine Skala zur Erfassung von Engagement und Freude bei Denkaufgaben , 1991 .

[34]  S. Shyam Sundar,et al.  How does Parallax Scrolling Influence User Experience? A Test of TIME (Theory of Interactive Media Effects) , 2018, Int. J. Hum. Comput. Interact..

[35]  M. Siegrist,et al.  Consumers’ knowledge about climate change , 2012, Climatic Change.

[36]  Hans-Jürgen Bucher,et al.  The relevance of attention for selecting news content. An eye-tracking study on attention patterns in the reception of print and online media , 2006 .

[37]  Priti Shah,et al.  A Model of the Perceptual and Conceptual Processes in Graph Comprehension , 1998 .

[38]  Sabrina Heike Kessler,et al.  Eyeing CRISPR on Wikipedia: Using Eye Tracking to Assess What Lay Audiences Look for to Learn about CRISPR and Genetic Engineering , 2020 .

[39]  Nathaniel J. S. Ashby,et al.  Applications and innovations of eye-movement research in judgment and decision making , 2016 .

[40]  Mounia Lalmas,et al.  Reader preferences and behavior on Wikipedia , 2014, HT.

[41]  Eun-Ju Lee,et al.  Effects of infographics on news elaboration, acquisition, and evaluation: Prior knowledge and issue involvement as moderators , 2015, New Media Soc..

[42]  Esther Greussing.  Powered by Immersion? Examining Effects of 360-Degree Photography on Knowledge Acquisition and Perceived Message Credibility of Climate Change News , 2019, Environmental Communication.

[43]  Jeeyun Oh,et al.  How Does Interactivity Persuade? An Experimental Test of Interactivity on Cognitive Absorption, Elaboration, and Attitudes , 2015 .

[44]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[45]  Joemon M. Jose,et al.  User engagement in online News: Under the scope of sentiment, interest, affect, and gaze , 2014, J. Assoc. Inf. Sci. Technol..

[46]  K. Holmqvist,et al.  Entry points and reading paths on newspaper spreads: comparing a semiotic analysis with eye-tracking measurements , 2006 .

[47]  F. Wester,et al.  The ‘Media Use as Social Action’ Approach: Theory, Methodology, and Research Evidence So Far , 2001 .

[48]  Reto Knutti,et al.  The scientific veneer of IPCC visuals , 2016, Climatic Change.

[49]  S. Elo,et al.  Qualitative Content Analysis , 2014 .

[50]  Sabrina Heike Kessler,et al.  Measuring selective exposure to online information: combining eye-tracking and content analysis of users’ actual search behavior , 2019 .

[51]  Elaine Toms,et al.  What is user engagement? A conceptual framework for defining user engagement with technology , 2008, J. Assoc. Inf. Sci. Technol..

[52]  Sara Irina Fabrikant,et al.  The Role of Map Animation for Geographic Visualization , 2008 .

[53]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .

[54]  W. Allen,et al.  Visual brokerage: Communicating data and research through visualisation , 2018, Public understanding of science.

[55]  Kenneth Holmqvist,et al.  The role of local design factors for newspaper reading behaviour – an eye-tracking perspective , 2005 .

[56]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[57]  Sriram Kalyanaraman,et al.  AROUSAL, MEMORY, AND IMPRESSION-FORMATION EFFECTS OF ANIMATION SPEED IN WEB ADVERTISING , 2004 .

[58]  T. Nocke,et al.  Visualization of Climate and Climate Change Data : An Overview , 2008 .

[59]  Cheryl I. Johnson,et al.  An eye movement analysis of the spatial contiguity effect in multimedia learning. , 2012, Journal of experimental psychology. Applied.

[60]  Mounia Lalmas,et al.  On saliency, affect and focused attention , 2012, CHI.

[61]  R. Glenn Cummins,et al.  Communicating Local Climate Risks Online Through an Interactive Data Visualization , 2017 .

[62]  Fabiola Cristina Rodríguez Estrada,et al.  Improving Visual Communication of Science Through the Incorporation of Graphic Design Theories and Practices Into Science Communication , 2015 .

[63]  Yuen-Hsien Tseng,et al.  Tracking learners' visual attention during a multimedia presentation in a real classroom , 2013, Comput. Educ..

[64]  T. Shipley,et al.  Cognitive and psychological science insights to improve climate change data visualization , 2016 .

[65]  F. Paas,et al.  Uncovering the problem-solving process: cued retrospective reporting versus concurrent and retrospective reporting. , 2005, Journal of experimental psychology. Applied.

[66]  S. Shyam Sundar,et al.  Clicking, Assessing, Immersing, and Sharing: An Empirical Model of User Engagement with Interactive Media , 2018, Commun. Res..

[67]  Dezhi Wu,et al.  Are your users actively involved? A cognitive absorption perspective in mobile training , 2015, Comput. Hum. Behav..

[68]  Jeffery. M. Zacks,et al.  Bars and lines: A study of graphic communication , 1999, Memory & cognition.

[69]  Richard C. Anderson,et al.  A Schema-Theoretic View of Basic Processes in Reading Comprehension. Technical Report No. 306. , 1988 .