The impact of social information on visual judgments

Social visualization systems have emerged to support collective intelligence-driven analysis of a growing influx of open data. As with many other online systems, social signals (e.g., forums, polls) are commonly integrated to drive use. Unfortunately, the same social features that can provide rapid, high-accuracy analysis are coupled with the pitfalls of any social system. Through an experiment involving over 300 subjects, we address how social information signals (social proof) affect quantitative judgments in the context of graphical perception. We identify how unbiased social signals lead to fewer errors over non-social settings and conversely, how biased signals lead to more errors. We further reflect on how systematic bias nullifies certain collective intelligence benefits, and we provide evidence of the formation of information cascades. We describe how these findings can be applied to collaborative visualization systems to produce more accurate individual interpretations in social contexts.

[1]  Martin Wattenberg,et al.  Voyagers and voyeurs: Supporting asynchronous collaborative visualization , 2009, CACM.

[2]  Martin J. Eppler,et al.  A Collaborative Dimensions Framework: Understanding the Mediating Role of Conceptual Visualizations in Collaborative Knowledge Work , 2008, Proceedings of the 41st Annual Hawaii International Conference on System Sciences (HICSS 2008).

[3]  Jeffrey Heer,et al.  Design Considerations for Collaborative Visual Analytics , 2008, Inf. Vis..

[4]  Aniket Kittur,et al.  Can you ever trust a wiki?: impacting perceived trustworthiness in wikipedia , 2008, CSCW.

[5]  Michael E. Doherty,et al.  Probabilistically Valid Inference of Covariation From a Single x, y Observation When Univariate Characteristics Are Known , 2009, Cogn. Sci..

[6]  Daniel M. Oppenheimer,et al.  Overcoming intuition: metacognitive difficulty activates analytic reasoning. , 2007, Journal of experimental psychology. General.

[7]  Richard P. Larrick,et al.  Strategies for revising judgment: how (and how well) people use others' opinions. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[8]  Matthew J. Salganik,et al.  Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market , 2006, Science.

[9]  C. Sunstein Infotopia: How Many Minds Produce Knowledge , 2006 .

[10]  M. Deutsch,et al.  A study of normative and informational social influences upon individual judgement. , 1955, Journal of abnormal psychology.

[11]  Robert Kosara,et al.  Do Mechanical Turks dream of square pie charts? , 2010, BELIV '10.

[12]  Gary Klein,et al.  Streetlights and Shadows: Searching for the Keys to Adaptive Decision Making , 2009 .

[13]  Bernardo A. Huberman,et al.  Usage patterns of collaborative tagging systems , 2006, J. Inf. Sci..

[14]  Duncan J. Watts,et al.  Financial incentives and the "performance of crowds" , 2009, HCOMP '09.

[15]  Lydia B. Chilton,et al.  TurKit: Tools for iterative tasks on mechanical turk , 2009, 2009 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[16]  R. Cialdini Influence: Science and Practice , 1984 .

[17]  S. Bikhchandani,et al.  You have printed the following article : A Theory of Fads , Fashion , Custom , and Cultural Change as Informational Cascades , 2007 .

[18]  John Riedl,et al.  Is seeing believing?: how recommender system interfaces affect users' opinions , 2003, CHI '03.

[19]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[20]  Joachim Meyer,et al.  Correlation estimates as perceptual judgments. , 1997 .

[21]  Noah J. Goldstein,et al.  Social influence: compliance and conformity. , 2004, Annual review of psychology.

[22]  Ronald A. Rensink,et al.  The Perception of Correlation in Scatterplots , 2010, Comput. Graph. Forum.

[23]  B. Marx The Visual Display of Quantitative Information , 1985 .

[24]  T. Postmes,et al.  Social Influence in Computer-Mediated Communication: The Effects of Anonymity on Group Behavior , 2001 .

[25]  Priti Shah,et al.  The Comprehension of Quantitative Information in Graphical Displays. , 2005 .

[26]  J. O. Whittaker,et al.  A Repetition of Asch's “Effects of Group Pressure upon the Modification and Distortion of Judgment” , 1957 .

[27]  Martin Wattenberg,et al.  Harry Potter and the Meat-Filled Freezer: A Case Study of Spontaneous Usage  of Visualization Tools , 2008, Proceedings of the 41st Annual Hawaii International Conference on System Sciences (HICSS 2008).

[28]  T. Postmes,et al.  A Social Identity Model of Deindividuation Phenomena , 1995 .

[29]  John C. Turner,et al.  Majority and minority influence: A single process self-categorization analysis. , 2001 .

[30]  A. Miyake,et al.  The Cambridge Handbook of Visuospatial Thinking , 2005 .

[31]  Jeffrey Heer,et al.  Scented Widgets: Improving Navigation Cues with Embedded Visualizations , 2007, IEEE Transactions on Visualization and Computer Graphics.

[32]  W. Cleveland,et al.  Variables on Scatterplots Look More Highly Correlated When the Scales Are Increased , 1982, Science.

[33]  H. Guetzkow,et al.  Groups, Leadership, and Men , 1952 .

[34]  S. Asch Effects of Group Pressure Upon the Modification and Distortion of Judgments , 1951 .

[35]  Martin Wattenberg,et al.  ManyEyes: a Site for Visualization at Internet Scale , 2007, IEEE Transactions on Visualization and Computer Graphics.

[36]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[37]  R. Bond,et al.  Culture and conformity: A meta-analysis of studies using Asch's (1952b, 1956) line judgment task. , 1996 .

[38]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.

[39]  Jeffrey Heer,et al.  Crowdsourcing graphical perception: using mechanical turk to assess visualization design , 2010, CHI.

[40]  Daniel Lemire,et al.  On the Challenges of Collaborative Data Processing , 2009, ArXiv.

[41]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[42]  J. Henrich,et al.  The weirdest people in the world? , 2010, Behavioral and Brain Sciences.

[43]  W. Cleveland,et al.  Graphical Perception: Theory, Experimentation, and Application to the Development of Graphical Methods , 1984 .

[44]  Edward R. Tufte,et al.  The Visual Display of Quantitative Information , 1986 .

[45]  C. B. Colby The weirdest people in the world , 1973 .

[46]  I. Spence Visual psychophysics of simple graphical elements. , 1990, Journal of experimental psychology. Human perception and performance.

[47]  Bill Tomlinson,et al.  Who are the crowdworkers?: shifting demographics in mechanical turk , 2010, CHI Extended Abstracts.

[48]  Fan Chung Graham,et al.  Internet and Network Economics, Third International Workshop, WINE 2007, San Diego, CA, USA, December 12-14, 2007, Proceedings , 2007, WINE.

[49]  Martin Wattenberg,et al.  Designing for social data analysis , 2006, IEEE Transactions on Visualization and Computer Graphics.

[50]  Fang Wu,et al.  How Public Opinion Forms , 2008, WINE.

[51]  A. Banerjee,et al.  A Simple Model of Herd Behavior , 1992 .

[52]  D. Moore,et al.  Effects of Task Difficulty on Use of Advice , 2007 .

[53]  Priti Shah,et al.  Bar and Line Graph Comprehension: An Interaction of Top-Down and Bottom-Up Processes , 2011, Top. Cogn. Sci..