The Deceptive Potential of Common Design Tactics Used in Data Visualizations

Visualizations effectively communicate data about important political, social, environmental, and health topics to a wide range of audiences; however, longstanding trust of graphs as conveyors of factual data makes them an easy means for spreading misinformation. Scholars in technical and professional communication have not yet conducted needed empirical research into people's perception and comprehension of data visualizations, especially when part of larger information texts [1]. Our study investigated the extent to which people exaggerated the differences between data points when reading graphs about non-controversial topics that used deceptive techniques and/or exaggerated titles. Participants (n=329) were randomly assigned to view one of four treatments for four different graph types (bar, line, pie, and bubble) and then asked to answer a question about each graph. Results show that deceptive techniques used in the graphs (including truncated axes, 3-D exaggeration, and arbitrary sizing), caused participants to misinterpret information in the deceptive vs. control visualizations for all of the graphs regardless of graph type, previous visualization coursework or comfort level with reading graphs. Results also showed that the presence of exaggerated vs. control titles that accompanied each graph did not significantly influence the extent of the misinterpretation. We will discuss the implication of these findings for technical communication as well as avenues of future research already underway that investigate these topics further.

[1]  Alex Endert,et al.  Four Perspectives on Human Bias in Visual Analytics , 2018, Cognitive Biases in Visualizations.

[2]  Karrie Karahalios,et al.  Frames and Slants in Titles of Visualizations on Controversial Topics , 2018, CHI.

[3]  Hanspeter Pfister,et al.  Beyond Memorability: Visualization Recognition and Recall , 2016, IEEE Transactions on Visualization and Computer Graphics.

[4]  Jeffrey Heer,et al.  Black Hat Visualization , 2017 .

[5]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[6]  Oded Nov,et al.  How Deceptive are Deceptive Visualizations?: An Empirical Analysis of Common Distortion Techniques , 2015, CHI.

[7]  Steven Pinker,et al.  A theory of graph comprehension. , 1990 .

[8]  Oded Nov,et al.  The Persuasive Power of Data Visualization , 2014, IEEE Transactions on Visualization and Computer Graphics.

[9]  André Calero Valdez,et al.  Priming and Anchoring Effects in Visualization , 2018, IEEE Transactions on Visualization and Computer Graphics.

[10]  Lisa Meloncon,et al.  Data visualizations: A literature review and opportunities for technical and professional communication , 2017, 2017 IEEE International Professional Communication Conference (ProComm).

[11]  Roy O. Freedle,et al.  Artificial Intelligence and the Future of Testing , 1990 .

[12]  Daniel J. Wigdor,et al.  A Lie Reveals the Truth: Quasimodes for Task-Aligned Data Presentation , 2019, CHI.

[13]  Vidya Setlur,et al.  Four Experiments on the Perception of Bar Charts , 2014, IEEE Transactions on Visualization and Computer Graphics.

[14]  Gerald E. Jones How to Lie with Charts , 1995 .

[15]  Wg.Cdr. Pongphet Congpuong How to lie With Statistics , 2013 .

[16]  Alberto Cairo,et al.  Graphics Lies, Misleading Visuals , 2015 .

[17]  Claire Lauer,et al.  Testing the Susceptibility of Users to Deceptive Data Visualizations When Paired with Explanatory Text , 2018, SIGDOC.

[18]  Karen A. Schriver Dynamics in Document Design: Creating Text for Readers , 1996 .

[19]  Karrie Karahalios,et al.  Trust and Recall of Information across Varying Degrees of Title-Visualization Misalignment , 2019, CHI.