The Attraction Effect in Information Visualization

The attraction effect is a well-studied cognitive bias in decision making research, where one's choice between two alternatives is influenced by the presence of an irrelevant (dominated) third alternative. We examine whether this cognitive bias, so far only tested with three alternatives and simple presentation formats such as numerical tables, text and pictures, also appears in visualizations. Since visualizations can be used to support decision making - e.g., when choosing a house to buy or an employee to hire - a systematic bias could have important implications. In a first crowdsource experiment, we indeed partially replicated the attraction effect with three alternatives presented as a numerical table, and observed similar effects when they were presented as a scatterplot. In a second experiment, we investigated if the effect extends to larger sets of alternatives, where the number of alternatives is too large for numerical tables to be practical. Our findings indicate that the bias persists for larger sets of alternatives presented as scatterplots. We discuss implications for future research on how to further study and possibly alleviate the attraction effect.

[1]  D. Kahneman.  Thinking, Fast and Slow , 2011 .

[2]  S. Shafir,et al.  Context-dependent violations of rational choice in honeybees (Apis mellifera) and gray jays (Perisoreus canadensis) , 2001, Behavioral Ecology and Sociobiology.

[3]  Tamara Munzner,et al.  Visualization Analysis and Design , 2014, A.K. Peters visualization series.

[4]  Michael Gleicher,et al.  Error Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error , 2014, IEEE Transactions on Visualization and Computer Graphics.

[5]  I. Simonson,et al.  Choice Based on Reasons: The Case of Attraction and Compromise Effects , 1989 .

[6]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[7]  A. Tversky,et al.  Choice in Context: Tradeoff Contrast and Extremeness Aversion , 1992 .

[8]  Rachel K. E. Bellamy,et al.  Designing Information for Remediating Cognitive Biases in Decision-Making , 2015, CHI.

[9]  Ji Soo Yi.  Visualized decision making: development and application of information visualization techniques to improve decision quality of nursing home choice , 2008 .

[10]  Scott D. Brown,et al.  Not Just for Consumers , 2013, Psychological science.

[11]  M. Sheelagh T. Carpendale,et al.  Visualization of Uncertainty and Reasoning , 2007, Smart Graphics.

[12]  Pierre Dragicevic,et al.  Testing the Attraction Effect on Two Information Visualization Datasets , 2016 .

[13]  A. Kalra,et al.  When Trade-Offs Matter: The Effect of Choice Construal on Context Effects , 2011 .

[14]  Robert Kosara,et al.  Laws of Attraction: From Perceptual Forces to Conceptual Similarity , 2010, IEEE Transactions on Visualization and Computer Graphics.

[15]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[16]  Christopher P. Puto,et al.  Adding Asymmetrically Dominated Alternatives: Violations of Regularity & the Similarity Hypothesis. , 1981 .

[17]  M. F. Luce,et al.  Constructive Consumer Choice Processes , 1998 .

[18]  Sankar Sen.  Knowledge, Information Mode, and the Attraction Effect , 1998 .

[19]  S. Frederick,et al.  The Limits of Attraction , 2014 .

[20]  Inderpal Singh Mumick,et al.  The Dynamic Homefinder: Evaluating Dynamic Queries In A Real-Estate Information Exploration System , 1999 .

[21]  M. Beekman,et al.  Irrational decision-making in an amoeboid organism: transitivity and context-dependent preferences , 2011, Proceedings of the Royal Society B: Biological Sciences.

[22]  Nancy F. Lenfestey,et al.  Cognitive interventions to reduce diagnostic error: a narrative review , 2012, BMJ quality & safety.

[23]  Dan Ariely,et al.  Seeking Subjective Dominance in Multidimensional Space: An Explanation of the Asymmetric Dominance Effect , 1995 .

[24]  Simon Breslav,et al.  Benefits of visualization in the Mammography Problem , 2015, Int. J. Hum. Comput. Stud..

[25]  J. Pettibone.  Testing the effect of time pressure on asymmetric dominance and compromise decoys in choice , 2012 .

[26]  S. Mishra,et al.  Antecedents of the Attraction Effect: An Information-Processing Approach , 1993 .

[27]  J. Payne,et al.  Let's be Honest about the Attraction Effect , 2014 .

[28]  Yigang Pan Sue O’Curry,et al.  The Attraction Effect and Political Choice in Two Elections , 1995 .

[29]  William M. Hedgcock,et al.  Trade-Off Aversion as an Explanation for the Attraction Effect: A Functional Magnetic Resonance Imaging Study , 2009 .

[30]  Jennifer S Trueblood,et al.  Multialternative context effects obtained using an inference task , 2012, Psychonomic bulletin & review.

[31]  Jeffrey Heer,et al.  Crowdsourcing graphical perception: using mechanical turk to assess visualization design , 2010, CHI.

[32]  Pierre Dragicevic,et al.  Fair Statistical Communication in HCI , 2016 .

[33]  Clare Churcher,et al.  Supporting Informed Decision-Making under Uncertainty and Risk through Interactive Visualisation , 2013, AUIC.

[34]  Ben Shneiderman,et al.  Using Treemaps to Visualize the Analytic Hierarchy Process , 1995, Inf. Syst. Res..

[35]  Giuseppe Carenini,et al.  An empirical evaluation of interactive visualizations for preferential choice , 2008, AVI '08.

[36]  W. M. Bolstad.  Introduction to Bayesian Statistics , 2004 .

[37]  David S. Ebert,et al.  Applied visual analytics for economic decision-making , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[38]  Angela Shen-Hsieh,et al.  Data visualization for strategic decision making , 2002, CHI '02.

[39]  G. Cumming,et al.  Inference by eye: confidence intervals and how to read pictures of data. , 2005, The American psychologist.

[40]  Scott Highhouse,et al.  Context-Dependent Selection: The Effects of Decoy and Phantom Job Candidates , 1996 .

[41]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[42]  M. Sheelagh T. Carpendale,et al.  STRATOS: Using Visualization to Support Decisions in Strategic Software Release Planning , 2015, CHI.

[43]  Allan D. Shocker,et al.  Toward understanding the attraction effect: The implications of product stimulus meaningfulness and familiarity. , 1987 .

[44]  I. Simonson.  Vices and Virtues of Misguided Replications: The Case of Asymmetric Dominance , 2014 .

[45]  Jean-Daniel Fekete,et al.  A Principled Way of Assessing Visualization Literacy , 2014, IEEE Transactions on Visualization and Computer Graphics.

[46]  David S. Ebert,et al.  FinVis: Applied visual analytics for personal financial planning , 2009, 2009 IEEE Symposium on Visual Analytics Science and Technology.

[47]  Timothy B. Heath,et al.  Asymmetric Decoy Effects on Lower-Quality versus Higher-Quality Brands: Meta-analytic and Experimental Evidence , 1995 .

[48]  Michael C. Frank,et al.  Estimating the reproducibility of psychological science , 2015, Science.

[49]  Joel Huber,et al.  Market Boundaries and Product Choice: Illustrating Attraction and Substitution Effects , 1983 .

[50]  D. H. Wedell,et al.  Distinguishing Among Models of Contextually Induced Preference Reversals , 1991 .

[51]  Pierre Dragicevic,et al.  Assessing the Effect of Visualizations on Bayesian Reasoning through Crowdsourcing , 2012, IEEE Transactions on Visualization and Computer Graphics.

[52]  A. Rao,et al.  Could Ralph Nader's Entrance and Exit Have Helped Al Gore? The Impact of Decoy Dynamics on Consumer Choice , 2009 .

[53]  Gerd Gigerenzer,et al.  Why Heuristics Work , 2008, Perspectives on psychological science : a journal of the Association for Psychological Science.

[54]  T. A. Hurly,et al.  Irrational choices in hummingbird foraging behaviour , 2002, Animal Behaviour.

[55]  Jennifer Tsai,et al.  Supporting Joint Human-Computer Judgment Under Uncertainty , 2008 .

[56]  M. Lynn,et al.  More Evidence Challenging the Robustness and Usefulness of the Attraction Effect , 2014 .

[57]  Pierre Dragicevic,et al.  Rolling the Dice: Multidimensional Visual Exploration using Scatterplot Matrix Navigation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[58]  Jessica M. Choplin,et al.  Comparison-induced decoy effects , 2005, Memory & cognition.

[59]  Andrew Howes,et al.  Informing decisions: how people use online rating information to make choices , 2011, CHI.

[60]  John T. Stasko,et al.  Dust & Magnet: Multivariate Information Visualization Using a Magnet Metaphor , 2005, Inf. Vis..

[61]  Selin A. Malkoc,et al.  Between a rock and a hard place: The failure of the attraction effect among unattractive alternatives , 2013 .