Design and evaluation of line symbolizations for origin–destination flow maps

We present the results of a user study comparing variants of commonly used line symbolizations for directed origin–destination flow maps. Our design and evaluation consisted of five line symbolizations that employ a combination of following visual variables: arrowheads, origin–destination coloring (color hue, and value), line shortening, line width, tapered edges (varying width from wide to narrow, and narrow to wide), and curvature asymmetry and strength. To guide our evaluation, we used a task-by-type typology and chose four representative tasks that are commonly used in flow map reading: identifying dominant direction of flows, flows with the highest magnitude (volume), spatial focusing of long flows toward a destination, and clusters of high net-exports (net-outflow). We systematically analyzed user responses and task performance which we measured by task completion time and accuracy. We designed a web-based flow mapping and testing framework and recruited the participants from Amazon Mechanical Turk. To demonstrate the application and user experiment, we used 16 commodity flow data sets in the United States from 2007 and systematically rotated the layouts to evaluate the effect of layout orientation. From this study, we can conclude that there is potential usefulness for all of the five symbolizations we tested; however, the influence of the design on performance and perception depends on the type of the task. Also, we found that data and layout orientation have significant effects on performance and perception of patterns in flow maps which we attribute to the change in visual saliency of node and flow patterns in relation to the way users scan the map. We recommend that the choice of line symbolization should be guided by a task taxonomy which end users are expected to perform. We discuss various design trade-offs and recommendations and potential future work for designing and evaluating line symbolizations for flow mapping.

[1]  Jean-Daniel Fekete,et al.  Overlaying Graph Links on Treemaps , 2003 .

[2]  Graham A Gill Experiments In The Ordered Perception Of Coloured Cartographic Line Symbols , 1988 .

[3]  Colin Ware,et al.  Motion to support rapid interactive queries on node--link diagrams , 2004, TAP.

[4]  David A. Carrington,et al.  Empirical Evaluation of Aesthetics-based Graph Layout , 2002, Empirical Software Engineering.

[5]  Stephen G. Kobourov,et al.  Group-Level Graph Visualization Taxonomy , 2014, EuroVis.

[6]  M. Sheelagh T. Carpendale,et al.  Bubble Sets: Revealing Set Relations with Isocontours over Existing Visualizations , 2009, IEEE Transactions on Visualization and Computer Graphics.

[7]  Yifan Hu,et al.  Visualizing Graphs and Clusters as Maps , 2010, IEEE Computer Graphics and Applications.

[8]  Adrian Rusu,et al.  Using the Gestalt Principle of Closure to Alleviate the Edge Crossing Problem in Graph Drawings , 2011, 2011 15th International Conference on Information Visualisation.

[9]  C. Körner Eye movements reveal distinct search and reasoning processes in comprehension of complex graphs , 2011 .

[10]  Jeffrey Heer,et al.  Strategies for crowdsourcing social data analysis , 2012, CHI.

[11]  Slava Kisilevich,et al.  A conceptual framework and taxonomy of techniques for analyzing movement , 2011, J. Vis. Lang. Comput..

[12]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[13]  M. Corbetta,et al.  Selective and divided attention during visual discriminations of shape, color, and speed: functional anatomy by positron emission tomography , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  Siddharth Suri,et al.  Conducting behavioral research on Amazon’s Mechanical Turk , 2010, Behavior research methods.

[15]  Jean-Daniel Fekete,et al.  Performance Evaluation of Tapered, Curved, and Animated Directed-Edge Representations in Node-Link Graphs , 2010 .

[16]  Stephen G. Kobourov,et al.  On the Usability of Lombardi Graph Drawings , 2012, Graph Drawing.

[17]  Larry Long,et al.  Migration distances: An international comparison , 1988, Demography.

[18]  M. Bar,et al.  Humans Prefer Curved Visual Objects , 2006, Psychological science.

[19]  Mary Czerwinski,et al.  Design Study of LineSets, a Novel Set Visualization Technique , 2011, IEEE Transactions on Visualization and Computer Graphics.

[20]  Pradeep Pundir,et al.  ATTACK VECTORS USED IN FRAUDULENCE CONNECTION DURING ONLINE TRANSACTIONS , 2011 .

[21]  Robert E. Roth,et al.  Cartographic Interaction Primitives: Framework and Synthesis , 2012 .

[22]  Tamara Munzner,et al.  A Multi-Level Typology of Abstract Visualization Tasks , 2013, IEEE Transactions on Visualization and Computer Graphics.

[23]  Stephen G. Kobourov,et al.  Node, Node-Link, and Node-Link-Group Diagrams: An Evaluation , 2014, IEEE Transactions on Visualization and Computer Graphics.

[24]  Jason Dykes,et al.  Visualizing the Dynamics of London's Bicycle-Hire Scheme , 2011, Cartogr. Int. J. Geogr. Inf. Geovisualization.

[25]  John P. McIntire,et al.  Visualizing weighted networks: a performance comparison of adjacency matrices versus node-link diagrams , 2012, Defense + Commercial Sensing.

[26]  Robert F. Cohen,et al.  An experimental study of the basis for graph drawing algorithms , 1997, JEAL.

[27]  Colin Ware,et al.  Improving the Display of Wind Patterns and Ocean Currents , 2014 .

[28]  Romain Bourqui,et al.  Winding Roads: Routing edges into bundles , 2010, Comput. Graph. Forum.

[29]  Jim Blythe,et al.  The effect of spatial arrangement on judgments and errors in interpreting graphs , 1997 .

[30]  Jean-Daniel Fekete,et al.  An extended evaluation of the readability of tapered, animated, and textured directed-edge representations in node-link graphs , 2011, 2011 IEEE Pacific Visualization Symposium.

[31]  Michael Burch,et al.  Evaluating Partially Drawn Links for Directed Graph Edges , 2011, GD.

[32]  Andreas Buja,et al.  Interactive High-Dimensional Data Visualization , 1996 .

[33]  Michael Burch,et al.  Comparative Eye Tracking Study on Node-Link Visualizations of Trajectories , 2014, IEEE Transactions on Visualization and Computer Graphics.

[34]  Allan R. Wilks,et al.  Visualizing Network Data , 1995, IEEE Trans. Vis. Comput. Graph..

[35]  Jarke J. van Wijk,et al.  Force‐Directed Edge Bundling for Graph Visualization , 2009, Comput. Graph. Forum.

[36]  Peter J. Passmore,et al.  A User Study on Curved Edges in Graph Visualization , 2012, IEEE Transactions on Visualization and Computer Graphics.

[37]  Terry A. Slocum,et al.  Thematic cartography and geovisualization, 3rd Edition , 2008 .

[38]  Colin Ware,et al.  Strokes for Representing Univariate Vector Field Maps , 1989 .

[39]  Philippe Castagliola,et al.  On the Readability of Graphs Using Node-Link and Matrix-Based Representations: A Controlled Experiment and Statistical Analysis , 2005, Inf. Vis..

[40]  Alexander Klippel,et al.  Assessing the Impact of Design Decisions on the Usability of Uncertainty Visualization: Noise Annotation Lines for the Visual Representation of Attribute Uncertainty , 2013 .

[41]  Jakob Nielsen,et al.  Prioritizing Web Usability , 2006 .

[42]  K. Pandit,et al.  Differentiating Between Subsystems and Typologies in the Analysis of Migration Regions: A U.S. Example* , 1994 .

[43]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[44]  B.M.F.J. van de Ven Algorithms for flow maps , 2007 .

[45]  Terrence Masson,et al.  ACM SIGGRAPH 2016 Computer Animation Festival , 2006, SIGGRAPH 2006.

[46]  A. Rogers,et al.  Measuring the Spatial Focus of Migration Patterns , 1998 .

[47]  Waldo R. Tobler,et al.  Spatial Interaction Patterns , 1976 .

[48]  Aaron Koblin Flight patterns , 2009, SIGGRAPH ASIA Art Gallery & Emerging Technologies.

[49]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[50]  Tobias Isenberg,et al.  Weighted graph comparison techniques for brain connectivity analysis , 2013, CHI.

[51]  Robert Weibel,et al.  Towards a taxonomy of movement patterns , 2008, Inf. Vis..

[52]  Chris North,et al.  A Comparison of User-Generated and Automatic Graph Layouts , 2009, IEEE Transactions on Visualization and Computer Graphics.

[53]  P. Hanrahan,et al.  Flow map layout , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[54]  Diansheng Guo,et al.  Flow Mapping and Multivariate Visualization of Large Spatial Interaction Data , 2009, IEEE Transactions on Visualization and Computer Graphics.

[55]  Diansheng Guo,et al.  Origin-Destination Flow Data Smoothing and Mapping , 2014, IEEE Transactions on Visualization and Computer Graphics.

[56]  Weidong Huang,et al.  Using eye tracking to investigate graph layout effects , 2007, 2007 6th International Asia-Pacific Symposium on Visualization.

[57]  Alan M. MacEachren,et al.  Constructing knowledge from multivariate spatiotemporal data: integrating geographical visualization with knowledge discovery in database methods , 1999, Int. J. Geogr. Inf. Sci..

[58]  Weidong Huang,et al.  Exploring the Relative Importance of Number of Edge Crossings and Size of Crossing Angles: A Quantitative Perspective , 2011 .

[59]  Jacques Bertin,et al.  Graphics and graphic information-processing , 1981 .

[60]  Meredith Ringel Morris,et al.  What do you see when you're surfing?: using eye tracking to predict salient regions of web pages , 2009, CHI.

[61]  Caglar Koylu,et al.  Understanding geo-social network patterns: Computation, visualization, and usability , 2014 .