What Makes a Visualization Memorable?

An ongoing debate in the Visualization community concerns the role that visualization types play in data understanding. In human cognition, understanding and memorability are intertwined. As a first step towards being able to ask questions about impact and effectiveness, here we ask: 'What makes a visualization memorable?' We ran the largest scale visualization study to date using 2,070 single-panel visualizations, categorized with visualization type (e.g., bar chart, line graph, etc.), collected from news media sites, government reports, scientific journals, and infographic sources. Each visualization was annotated with additional attributes, including ratings for data-ink ratios and visual densities. Using Amazon's Mechanical Turk, we collected memorability scores for hundreds of these visualizations, and discovered that observers are consistent in which visualizations they find memorable and forgettable. We find intuitive results (e.g., attributes like color and the inclusion of a human recognizable object enhance memorability) and less intuitive results (e.g., common graphs are less memorable than unique visualization types). Altogether our findings suggest that quantifying memorability is a general metric of the utility of information, an essential step towards determining how to design effective visualizations.

[1]  Jeffrey R. Sampson,et al.  Free Recall of Verbal and Non-Verbal Stimuli , 1970 .

[2]  Richard C. Anderson,et al.  Recall of Previously Unrecallable Information Following a Shift in Perspective. Technical Report No. 41. , 1977 .

[3]  Nigel Holmes Designer's Guide to Creating Charts and Diagrams , 1984 .

[4]  W. Cleveland,et al.  Graphical Perception: Theory, Experimentation, and Application to the Development of Graphical Methods , 1984 .

[5]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[6]  Gloria E. Miller,et al.  Effects of Illustrations on Children’s Listening Comprehension and Oral Prose Memory , 1987 .

[7]  James D. Kelly The Data-Ink Ratio and Accuracy of Newspaper Graphs , 1989 .

[8]  S. Kosslyn Understanding charts and graphs , 1989 .

[9]  Roy O. Freedle,et al.  Artificial Intelligence and the Future of Testing , 1990 .

[10]  I. Spence Visual psychophysics of simple graphical elements. , 1990, Journal of experimental psychology. Human perception and performance.

[11]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[12]  Steven Pinker,et al.  A theory of graph comprehension. , 1990 .

[13]  P. Fayers,et al.  The Visual Display of Quantitative Information , 1990 .

[14]  Linda B. Gambrell,et al.  Mental imagery, text illustrations, and children's story comprehension and recall. , 1993 .

[15]  M. McDaniel,et al.  Chapter 11 The Mnemonic Benefit of Pictures in Text: Selective Enrichment for Differentially Skilled Readers , 1994 .

[16]  Douglas J. Gillan,et al.  Minimalism and the Syntax of Graphs , 1994 .

[17]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[18]  Michael Siegrist,et al.  The use or misuse of three-dimensional graphs to represent lower-dimensional data , 1996, Behav. Inf. Technol..

[19]  Barbara Tversky,et al.  Gratuitous graphics? Putting preferences in perspective , 1996, CHI.

[20]  Robert L. Harris,et al.  Information Graphics: A Comprehensive Illustrated Reference , 1996 .

[21]  Joachim Meyer,et al.  Chartjunk or Goldgraph? Effects of Presentation Objectives and Content Desirability on Information Presentation , 1999, MIS Q..

[22]  Alan F. Blackwell,et al.  Does metaphor increase visual language usability? , 1999, Proceedings 1999 IEEE Symposium on Visual Languages.

[23]  Jonathan C. Roberts Display models: ways to classify visual representations , 2000 .

[24]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[25]  Barbara Tversky,et al.  Graphs in Print , 2002, Diagrammatic Representation and Reasoning.

[26]  Yuri Engelhardt,et al.  The Language of Graphics: A Framework for the Analysis of Syntax and Meaning in Maps, Charts and Diagrams , 2002, ILLC dissertation series.

[27]  Ann M. Bisantz,et al.  A comparison of the effects of data–ink ratio on performance with dynamic displays in a monitoring task , 2002 .

[28]  Katie E. Cherry,et al.  Pictorial Illustrations Enhance Memory for Sentences in Younger and Older Adults , 2003, Experimental aging research.

[29]  Melanie Tory,et al.  Rethinking Visualization: A High-Level Taxonomy , 2004, IEEE Symposium on Information Visualization.

[30]  N. Schwarz,et al.  Processing Fluency and Aesthetic Pleasure: Is Beauty in the Perceiver's Processing Experience? , 2004, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[31]  Issei Fujishiro,et al.  The elements of graphing data , 2005, The Visual Computer.

[32]  José Fernando Rodrigues,et al.  Reviewing Data Visualization: an Analytical Taxonomical Study , 2006, Tenth International Conference on Information Visualisation (IV'06).

[33]  M. Bar,et al.  Humans Prefer Curved Visual Objects , 2006, Psychological science.

[34]  Steven Heller,et al.  Nigel Holmes On Information Design , 2006 .

[35]  Joachim Meyer,et al.  Minimalism in information visualization: attitudes towards maximizing the data-ink ratio , 2007, ECCE '07.

[36]  Julia Kulla-Mader,et al.  Graphs via Ink: Understanding How the Amount of Non-data Ink in a Graph Affects Perception and Learning , 2007 .

[37]  Martin J. Eppler,et al.  Towards a periodic table of visualization methods of management , 2007 .

[38]  William E Hockley,et al.  The picture superiority effect in associative recognition , 2008, Memory & cognition.

[39]  Mara Mather,et al.  Arousal-Enhanced Location Memory for Pictures. , 2008, Journal of memory and language.

[40]  Aude Oliva,et al.  Visual long-term memory has a massive storage capacity for object details , 2008, Proceedings of the National Academy of Sciences.

[41]  Ellen Peters,et al.  Graph Comprehension: An Experiment in Displaying Data as Bar Charts, Pie Charts and Tables With and Without the Gratuitous 3rd Dimension , 2008 .

[42]  Jacques Bertin,et al.  Semiology of Graphics - Diagrams, Networks, Maps , 2010 .

[43]  Bill Tomlinson,et al.  Who are the crowdworkers?: shifting demographics in mechanical turk , 2010, CHI Extended Abstracts.

[44]  Timothy F. Brady,et al.  Conceptual Distinctiveness Supports Detailed Visual Long-term Memory for Real-world Objects the Fidelity of Long-term Memory for Visual Information , 2022 .

[45]  Jeffrey Heer,et al.  A tour through the visualization zoo , 2010, ACM Queue.

[46]  Christopher A. Brooks,et al.  Useful junk?: the effects of visual embellishment on comprehension and memorability of charts , 2010, CHI.

[47]  Timothy F. Brady,et al.  Scene Memory Is More Detailed Than You Think : The Role of Categories in Visual Long-Term Memory , 2010 .

[48]  O. Neurath,et al.  From Hieroglyphics to Isotype: A Visual Autobiography , 2010 .

[49]  Antonio Torralba,et al.  Understanding the Intrinsic Memorability of Images , 2011, NIPS.

[50]  Jianxiong Xiao,et al.  What makes an image memorable? , 2011, CVPR 2011.

[51]  Eytan Adar,et al.  Benefitting InfoVis with Visual Difficulties , 2011, IEEE Transactions on Visualization and Computer Graphics.

[52]  B. Shneiderman,et al.  Interactive Dynamics for Visual Analysis , 2012 .

[53]  Kim Marriott,et al.  Memorability of Visual Features in Network Diagrams , 2012, IEEE Transactions on Visualization and Computer Graphics.

[54]  Irene Reppa,et al.  An Empirical Study on Using Visual Embellishments in Visualization , 2012, IEEE Transactions on Visualization and Computer Graphics.

[55]  Siddharth Suri,et al.  Conducting behavioral research on Amazon’s Mechanical Turk , 2010, Behavior research methods.

[56]  Thomas Grechenig,et al.  Evaluating the Effect of Style in Information Visualization , 2012, IEEE Transactions on Visualization and Computer Graphics.

[57]  Alberto Cairo,et al.  The Functional Art: An introduction to information graphics and visualization , 2012 .

[58]  Wilma A. Bainbridge,et al.  The intrinsic memorability of face photographs. , 2013, Journal of experimental psychology. General.