Semantic Discriminability for Visual Communication

To interpret information visualizations, observers must determine how visual features map onto concepts. First and foremost, this ability depends on perceptual discriminability; observers must be able to see the difference between different colors for those colors to communicate different meanings. However, the ability to interpret visualizations also depends on semantic discriminability, the degree to which observers can infer a unique mapping between visual features and concepts, based on the visual features and concepts alone (i.e., without help from verbal cues such as legends or labels). Previous evidence suggested that observers were better at interpreting encoding systems that maximized semantic discriminability (maximizing association strength between assigned colors and concepts while minimizing association strength between unassigned colors and concepts), compared to a system that only maximized color-concept association strength. However, increasing semantic discriminability also resulted in increased perceptual distance, so it is unclear which factor was responsible for improved performance. In the present study, we conducted two experiments that tested for independent effects of semantic distance and perceptual distance on semantic discriminability of bar graph data visualizations. Perceptual distance was large enough to ensure colors were more than just noticeably different. We found that increasing semantic distance improved performance, independent of variation in perceptual distance, and when these two factors were uncorrelated, responses were dominated by semantic distance. These results have implications for navigating trade-offs in color palette design optimization for visual communication.

[1]  Sabine Süsstrunk,et al.  What is the Color of Chocolate? - Extracting Color Values of Semantic Expressions , 2012, CGIV.

[2]  J. Wolfe,et al.  Five factors that guide attention in visual search , 2017, Nature Human Behaviour.

[3]  Steven Franconeri,et al.  The Curse of Knowledge in Visual Data Communication , 2019, IEEE Transactions on Visualization and Computer Graphics.

[4]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[5]  D. Norman The Design of Everyday Things: Revised and Expanded Edition , 2013 .

[6]  P. Shah,et al.  Review of Graph Comprehension Research: Implications for Instruction , 2002 .

[7]  Matthew McGranaghan,et al.  Ordering Choropleth Map Symbols: The Effect of Background , 1989 .

[8]  David Whitney,et al.  How Capacity Limits of Attention Influence Information Visualization Effectiveness , 2012, IEEE Transactions on Visualization and Computer Graphics.

[9]  Catherine Havasi,et al.  Automated Color Selection Using Semantic Knowledge , 2010, AAAI Fall Symposium: Commonsense Knowledge.

[10]  Robert McGill,et al.  Graphical Perception: The Visual Decoding of Quantitative Information on Graphical Displays of Data , 1987 .

[11]  Barbara Tversky,et al.  Animation: can it facilitate? , 2002, Int. J. Hum. Comput. Stud..

[12]  Jeffrey Heer,et al.  Color naming models for color selection, image editing and palette design , 2012, CHI.

[13]  Karen B. Schloss,et al.  Color inference in visual communication: the meaning of colors in recycling , 2018, Cognitive research: principles and implications.

[14]  Dedre Gentner,et al.  Systematicity and Surface Similarity in the Development of Analogy , 1986, Cogn. Sci..

[15]  Karen B. Schloss,et al.  Visual aesthetics and human preference. , 2013, Annual review of psychology.

[16]  J. Munkres ALGORITHMS FOR THE ASSIGNMENT AND TRANSIORTATION tROBLEMS* , 1957 .

[17]  Stephen Michael Kosslyn,et al.  Graph Design for the Eye and Mind , 2006 .

[18]  Christopher G. Healey,et al.  Choosing effective colours for data visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[19]  M. Wood,et al.  Visual Perception and Map Design , 1968 .

[20]  Barbara Tversky,et al.  Visualizing Thought , 2011, Top. Cogn. Sci..

[21]  Cynthia A. Brewer,et al.  Color Use Guidelines for Mapping and Visualization , 1994 .

[22]  Michael Gleicher,et al.  Task-driven evaluation of aggregation in time series visualization , 2014, CHI.

[23]  Jeffrey Heer,et al.  Sizing the horizon: the effects of chart size and layering on the graphical perception of time series visualizations , 2009, CHI.

[24]  David H. Laidlaw,et al.  The relation between visualization size, grouping, and user performance , 2014, IEEE Transactions on Visualization and Computer Graphics.

[25]  Donald H. House,et al.  Non-expert interpretations of hurricane forecast uncertainty visualizations , 2016, CogSci.

[26]  David J. Cuff,et al.  Colour on Temperature Maps , 1973 .

[27]  Denis Cousineau,et al.  Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method , 2005 .

[28]  Danielle Albers Szafir,et al.  Modeling Color Difference for Visualization Design , 2018, IEEE Transactions on Visualization and Computer Graphics.

[29]  Maureen C. Stone,et al.  Affective Color in Visualization , 2017, CHI.

[30]  Vidya Setlur,et al.  An Engineering Model for Color Difference as a Function of Size , 2014, CIC.

[31]  Karen B. Schloss,et al.  Estimating Color-Concept Associations from Image Statistics , 2019, IEEE Transactions on Visualization and Computer Graphics.

[32]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[33]  Karen B. Schloss,et al.  Mapping Color to Meaning in Colormap Data Visualizations , 2019, IEEE Transactions on Visualization and Computer Graphics.

[34]  David H. Laidlaw,et al.  Colorgorical: Creating discriminable and preferable color palettes for information visualization , 2017, IEEE Transactions on Visualization and Computer Graphics.

[35]  R. Ratcliff Methods for dealing with reaction time outliers. , 1993, Psychological bulletin.

[36]  Jeffery. M. Zacks,et al.  Bars and lines: A study of graphic communication , 1999, Memory & cognition.

[37]  Cynthia A. Brewer,et al.  ColorBrewer.org: An Online Tool for Selecting Colour Schemes for Maps , 2003 .

[38]  Vidya Setlur,et al.  A Linguistic Approach to Categorical Color Assignment for Data Visualization , 2016, IEEE Transactions on Visualization and Computer Graphics.

[39]  Mary Hegarty,et al.  The Cognitive Science of Visual-Spatial Displays: Implications for Design , 2011, Top. Cogn. Sci..

[40]  Jeffrey Heer,et al.  Selecting Semantically‐Resonant Colors for Data Visualization , 2013, Comput. Graph. Forum.