Visualizing Sets: An Empirical Comparison of Diagram Types

There are a range of diagram types that can be used to visualize sets. However, there is a significant lack of insight into which is the most effective visualization. To address this knowledge gap, this paper empirically evaluates four diagram types: Venn diagrams, Euler diagrams with shading, Euler diagrams without shading, and the less well-known linear diagrams. By collecting performance data (time to complete tasks and error rate), through crowdsourcing, we establish that linear diagrams outperform the other three diagram types in terms of both task completion time and number of errors. Venn diagrams perform worst from both perspectives. Thus, we provide evidence that linear diagrams are the most effective of these four diagram types for representing sets.

[1]  S. Palmer,et al.  A century of Gestalt psychology in visual perception: I. Perceptual grouping and figure-ground organization. , 2012, Psychological bulletin.

[2]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[3]  Gem Stapleton,et al.  Properties of Euler Diagrams , 2007, Electron. Commun. Eur. Assoc. Softw. Sci. Technol..

[4]  John J. Bertin,et al.  The semiology of graphics , 1983 .

[5]  J. R. Pomerantz,et al.  A century of Gestalt psychology in visual perception: II. Conceptual and theoretical foundations. , 2012, Psychological bulletin.

[6]  Heike Hofmann,et al.  Visualizing association rules with interactive mosaic plots , 2000, KDD '00.

[7]  Pierre Dragicevic,et al.  Assessing the Effect of Visualizations on Bayesian Reasoning through Crowdsourcing , 2012, IEEE Transactions on Visualization and Computer Graphics.

[8]  Daniel M. Oppenheimer,et al.  Instructional Manipulation Checks: Detecting Satisficing to Increase Statistical Power , 2009 .

[9]  Peter Rodgers,et al.  Wellformedness Properties in Euler Diagrams: Which Should Be Used? , 2012, IEEE Transactions on Visualization and Computer Graphics.

[10]  Helen C. Purchase,et al.  Which Aesthetic has the Greatest Effect on Human Understanding? , 1997, GD.

[11]  Jenny Chen,et al.  Opportunities for Crowdsourcing Research on Amazon Mechanical Turk , 2011 .

[12]  Koji Mineshima,et al.  The Efficacy of Euler and Venn Diagrams in Deductive Reasoning: Empirical Findings , 2010, Diagrams.

[13]  Corin A. Gurr,et al.  Effective Diagrammatic Communication: Syntactic, Semantic and Pragmatic Issues , 1999, J. Vis. Lang. Comput..

[14]  Beate Grawemeyer,et al.  Evaluation of ERST - An External Representation Selection Tutor , 2006, Diagrams.

[15]  Peter Rodgers,et al.  Evaluating the Comprehension of Euler Diagrams , 2007, 2007 11th International Conference Information Visualization (IV '07).

[16]  Ross Ihaka,et al.  Colour for Presentation Graphics , 2003 .

[17]  Koji Mineshima,et al.  The Efficacy of Diagrams in Syllogistic Reasoning: A Case of Linear Diagrams , 2012, Diagrams.

[18]  Samuel S. Silva,et al.  There is More to Color Scales than Meets the Eye: A Review on the Use of Color in Visualization , 2007, 2007 11th International Conference Information Visualization (IV '07).

[19]  Tim Dwyer,et al.  Untangling Euler Diagrams , 2010, IEEE Transactions on Visualization and Computer Graphics.

[20]  Pierre Dragicevic,et al.  A Study on Dual-Scale Data Charts , 2011, IEEE Transactions on Visualization and Computer Graphics.

[21]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[22]  Cynthia A. Brewer,et al.  ColorBrewer.org: An Online Tool for Selecting Colour Schemes for Maps , 2003 .

[23]  Tom Lanning,et al.  Parallel bargrams for consumer-based information exploration and choice , 2001, UIST '01.

[24]  Anne Treisman,et al.  Preattentive processing in vision , 1985, Computer Vision Graphics and Image Processing.

[25]  Jacob Feldman,et al.  Formation of visual “objects” in the early computation of spatial relations , 2007, Perception & psychophysics.

[26]  L. Couturat,et al.  Opuscules et Fragments Inédits de Leibniz : Extraits des manuscrits de la Bibliothèque royale de Hanovre , 1903 .

[27]  Jacques D. Fleuriot,et al.  Diagrammatically-Driven Formal Verification of Web-Services Composition , 2012, Diagrams.

[28]  Jeffrey Heer,et al.  Crowdsourcing graphical perception: using mechanical turk to assess visualization design , 2010, CHI.

[29]  K. Koffka.  Principles Of Gestalt Psychology , 1936 .

[30]  Gem Stapleton,et al.  Does the Orientation of an Euler Diagram Affect User Comprehension? , 2012, DMS.

[31]  Marina Daecher,et al.  Experimental Human Computer Interaction A Practical Guide With Visual Examples , 2016 .

[32]  Daniel L. Moody,et al.  The “Physics” of Notations: Toward a Scientific Basis for Constructing Visual Notations in Software Engineering , 2009, IEEE Transactions on Software Engineering.