Explaining the Gap: Visualizing One's Predictions Improves Recall and Comprehension of Data

Information visualizations use interactivity to enable user-driven querying of visualized data. However, users' interactions with their internal representations, including their expectations about data, are also critical for a visualization to support learning. We present multiple graphically-based techniques for eliciting and incorporating a user's prior knowledge about data into visualization interaction. We use controlled experiments to evaluate how graphically eliciting forms of prior knowledge and presenting feedback on the gap between prior knowledge and the observed data impacts a user's ability to recall and understand the data. We find that participants who are prompted to reflect on their prior knowledge by predicting and self-explaining data outperform a control group in recall and comprehension. These effects persist when participants have moderate or little prior knowledge on the datasets. We discuss how the effects differ based on text versus visual presentations of data. We characterize the design space of graphical prediction and feedback techniques and describe design recommendations.

[1]  S. Stone-Elander,et al.  Targeting VEGF-B as a novel treatment for insulin resistance and type 2 diabetes , 2012, Nature.

[2]  Priti Shah,et al.  A Model of the Perceptual and Conceptual Processes in Graph Comprehension , 1998 .

[3]  K. VanLehn,et al.  Teaching Meta-cognitive Skills: Implementation and Evaluation of a Tutoring System to Guide Self- Explanation While Learning from Examples , 1999 .

[4]  Danielle S. McNamara Reading comprehension strategies : theories, interventions, and technologies , 2007 .

[5]  Susan Bell Trickett,et al.  Connecting Internal and External Representations: Spatial Transformations of Scientific Visualizations , 2005 .

[6]  Vincent Aleven,et al.  An effective metacognitive strategy: learning by doing and explaining with a computer-based Cognitive Tutor , 2002, Cogn. Sci..

[7]  Matthew W. Lewis,et al.  Self-Explonations: How Students Study and Use Examples in Learning to Solve Problems , 1989, Cogn. Sci..

[8]  J. Gregory Trafton,et al.  Understanding Static and Dynamic Visualizations , 2002, Diagrams.

[9]  Richard E. Mayer,et al.  The Cambridge Handbook of Multimedia Learning: Cognitive Theory of Multimedia Learning , 2005 .

[10]  Alexander Renkl,et al.  Learning from Worked-Out-Examples: A Study on Individual Differences , 1997, Cogn. Sci..

[11]  Ruth Wylie,et al.  The Self-Explanation Principle in Multimedia Learning , 2014 .

[12]  Michelene T. H. Chi,et al.  Eliciting Self-Explanations Improves Understanding , 1994, Cogn. Sci..

[13]  Danielle S. McNamara,et al.  iSTART: A Web-based tutor that teaches self-explanation and metacognitive reading strategies. , 2007 .

[14]  Dianne E. Howie,et al.  Making the most of ecological interface design: the role of self-explanation , 1998, Int. J. Hum. Comput. Stud..

[15]  Jeffery. M. Zacks,et al.  Bars and lines: A study of graphic communication , 1999, Memory & cognition.

[16]  R. Cox Representation construction, externalised cognition and individual differences , 1999 .

[17]  Shaaron Ainsworth,et al.  The effects of self-explaining when learning with text or diagrams , 2003, Cogn. Sci..

[18]  M. Ferguson-Hessler,et al.  Studying Physics Texts: Differences in Study Processes Between Good and Poor Performers , 1990 .

[19]  Mary Hegarty,et al.  Diagrams in the Mind and in the World: Relations between Internal and External Visualizations , 2004, Diagrams.

[20]  Ann L. Brown,et al.  Training in Self-Explanation and Self-Regulation Strategies: Investigating the Effects of Knowledge Acquisition Activities on Problem Solving , 1995 .

[21]  Mary Hegarty,et al.  Effects of knowledge and display design on comprehension of complex graphics , 2010 .

[22]  Mary Hegarty,et al.  Effects of Knowledge and Spatial Ability on Learning from Animation , 2007 .

[23]  Ruth B. Ekstrom,et al.  Manual for kit of factor-referenced cognitive tests , 1976 .

[24]  Mary Hegarty,et al.  Individual differences in use of diagrams as external memory in mechanical reasoning , 1997 .

[25]  Sirkka L. Jarvenpaa,et al.  Graphic displays in decision making — the visual salience effect , 1990 .

[26]  L. Cosmides,et al.  Are humans good intuitive statisticians after all? Rethinking some conclusions from the literature on judgment under uncertainty , 1996, Cognition.

[27]  John T. Stasko,et al.  Mental Models, Visual Reasoning and Interaction in Information Visualization: A Top-down Perspective , 2010, IEEE Transactions on Visualization and Computer Graphics.

[28]  L. Ball,et al.  Self-Explanation, Feedback and the Development of Analogical Reasoning Skills: Microgenetic Evidence for a Metacognitive Processing Account , 2005 .

[29]  Steven Pinker,et al.  A theory of graph comprehension. , 1990 .

[30]  Cristina Conati,et al.  Toward Computer-Based Support of Meta-Cognitive Skills: a Computational Framework to Coach Self-Explanation , 2000 .

[31]  Margaret M. Recker,et al.  Learning Strategies and Transfer in the Domain of Programming , 1994 .

[32]  H. Mandl,et al.  Learning from Worked-Out Examples: The Effects of Example Variability and Elicited Self-Explanations , 1998, Contemporary educational psychology.

[33]  D. Berry,et al.  Effects of active information processing on the understanding of risk information , 2005 .

[34]  Juliane Junker,et al.  Artificial Intelligence And The Future Of Testing , 2016 .

[35]  Krzysztof Z. Gajos,et al.  Curiosity Killed the Cat, but Makes Crowdwork Better , 2016, CHI.

[36]  M. Just,et al.  Constructing mental models of machines from text and diagrams. , 1993 .

[37]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[38]  M. Hegarty,et al.  Graphs as aids to knowledge construction: Signaling techniques for guiding the process of graph comprehension. , 1999 .

[39]  Hermann G. Ebner,et al.  Improving cross-content transfer in text processing by means of active graphical representation , 2003 .

[40]  G. Loewenstein The psychology of curiosity: A review and reinterpretation. , 1994 .

[41]  M. Malbrán The Cambridge Handbook of Multimedia Learning , 2007 .

[42]  S. Kosslyn Understanding charts and graphs , 1989 .

[43]  J. Klayman,et al.  Confirmation, Disconfirmation, and Informa-tion in Hypothesis Testing , 1987 .

[44]  Richard E. Mayer,et al.  Cognitive Theory of Multimedia Learning , 2021, The Cambridge Handbook of Multimedia Learning.

[45]  Michelene T. H. Chi,et al.  The Cambridge Handbook of Multimedia Learning: The Self-Explanation Principle in Multimedia Learning , 2005 .

[46]  Richard Lowe,et al.  Learning with Animation: Research Implications for Design , 2007 .

[47]  Mary Hegarty,et al.  The Roles of Mental Animations and External Animations in Understanding Mechanical Systems , 2003 .

[48]  Jon Oberlander,et al.  A Cognitive Theory of Graphical and Linguistic Reasoning: Logic and Implementation , 1995, Cogn. Sci..

[49]  Vincent Aleven,et al.  Towards Tutorial Dialog to Support Self- Explanation: Adding Natural Language Understanding to a Cognitive Tutor * , 2001 .

[50]  Eytan Adar,et al.  The impact of social information on visual judgments , 2011, CHI.