Data Through Others' Eyes: The Impact of Visualizing Others' Expectations on Visualization Interpretation

In addition to visualizing input data, interactive visualizations have the potential to be social artifacts that reveal other people's perspectives on the data. However, how such social information embedded in a visualization impacts a viewer's interpretation of the data remains unknown. Inspired by recent interactive visualizations that display people's expectations of data against the data, we conducted a controlled experiment to evaluate the effect of showing social information in the form of other people's expectations on people's ability to recall the data, the degree to which they adjust their expectations to align with the data, and their trust in the accuracy of the data. We found that social information that exhibits a high degree of consensus lead participants to recall the data more accurately relative to participants who were exposed to the data alone. Additionally, participants trusted the accuracy of the data less and were more likely to maintain their initial expectations when other people's expectations aligned with their own initial expectations but not with the data. We conclude by characterizing the design space for visualizing others' expectations alongside data.

[1]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[2]  S. Asch.  Effects of Group Pressure Upon the Modification and Distortion of Judgments , 1951 .

[3]  Vimla L. Patel,et al.  Viewpoint: Science and Practice: A Case for Medical Informatics as a Local Science of Design , 1998, J. Am. Medical Informatics Assoc..

[4]  M. Hegarty,et al.  Graphs as aids to knowledge construction: Signaling techniques for guiding the process of graph comprehension. , 1999 .

[5]  M. Deutsch,et al.  A study of normative and informational social influences upon individual judgement. , 1955, Journal of abnormal psychology.

[6]  C. Nemeth,et al.  Creative problem solving as a result of majority vs minority influence , 1983 .

[7]  Mary Hegarty,et al.  Individual differences in use of diagrams as external memory in mechanical reasoning , 1997 .

[8]  Katharina Reinecke,et al.  LabintheWild: Conducting Large-Scale Online Experiments With Uncompensated Samples , 2015, CSCW.

[9]  Danah Boyd,et al.  Vizster: visualizing online social networks , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[10]  Jeffrey Heer,et al.  CommentSpace: structured support for collaborative visual analysis , 2011, CHI.

[11]  Nicholas Diakopoulos,et al.  Visualization Rhetoric: Framing Effects in Narrative Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[12]  Mary Hegarty,et al.  The Roles of Mental Animations and External Animations in Understanding Mechanical Systems , 2003 .

[13]  J. R. French,et al.  The bases of social power. , 1959 .

[14]  Martin Wattenberg,et al.  Designing for social data analysis , 2006, IEEE Transactions on Visualization and Computer Graphics.

[15]  Martin Wattenberg.  Baby names, visualization, and social data analysis , 2005 .

[16]  L. Festinger.  A Theory of Social Comparison Processes , 1954 .

[17]  P. Klaczynski,et al.  Motivated scientific reasoning biases, epistemological beliefs, and theory polarization: a two-process approach to adolescent cognition. , 2000, Child development.

[18]  Jeffrey Heer,et al.  Design Considerations for Collaborative Visual Analytics , 2008, Inf. Vis..

[19]  Martin Wattenberg,et al.  Voyagers and voyeurs: supporting asynchronous collaborative information visualization , 2007, CHI.

[20]  Sirkka L. Jarvenpaa,et al.  Graphic displays in decision making — the visual salience effect , 1990 .

[21]  Jonathan Evans,et al.  Rapid responding increases belief bias: Evidence for the dual-process theory of reasoning , 2005 .

[22]  Martin Wattenberg,et al.  ManyEyes: a Site for Visualization at Internet Scale , 2007, IEEE Transactions on Visualization and Computer Graphics.

[23]  Katharina Reinecke,et al.  Explaining the Gap: Visualizing One's Predictions Improves Recall and Comprehension of Data , 2017, CHI.

[24]  C. Melody Carswell,et al.  Stimulus complexity and information integration in the spontaneous interpretations of line graphs , 1993 .

[25]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[26]  Aaron D. Shaw,et al.  Designing incentives for inexpert human raters , 2011, CSCW.

[27]  Jeffrey Heer,et al.  Scented Widgets: Improving Navigation Cues with Embedded Visualizations , 2007, IEEE Transactions on Visualization and Computer Graphics.

[28]  Eytan Adar,et al.  The impact of social information on visual judgments , 2011, CHI.

[29]  Mary Hegarty,et al.  Diagrams in the Mind and in the World: Relations between Internal and External Visualizations , 2004, Diagrams.

[30]  R. Nickerson.  Confirmation Bias: A Ubiquitous Phenomenon in Many Guises , 1998 .

[31]  Jeffery. M. Zacks,et al.  Bars and lines: A study of graphic communication , 1999, Memory & cognition.

[32]  K. Stanovich,et al.  The domain specificity and generality of belief bias: Searching for a generalizable critical thinking skill. , 1999 .

[33]  Susan Bell Trickett,et al.  Connecting Internal and External Representations: Spatial Transformations of Scientific Visualizations , 2005 .

[34]  John T. Stasko,et al.  Mental Models, Visual Reasoning and Interaction in Information Visualization: A Top-down Perspective , 2010, IEEE Transactions on Visualization and Computer Graphics.

[35]  I. Gal.  Adults' Statistical Literacy: Meanings, Components, Responsibilities , 2002 .

[36]  D. Kandel.  Homophily, Selection, and Socialization in Adolescent Friendships , 1978, American Journal of Sociology.

[37]  L. Festinger.  Informal social communication. , 1950, Psychological review.

[38]  Oded Nov,et al.  The Persuasive Power of Data Visualization , 2014, IEEE Transactions on Visualization and Computer Graphics.

[39]  A. Gelman,et al.  Deep Interactions with MRP: Election Turnout and Voting Patterns Among Small Electoral Subgroups , 2013 .