Exploring the Limits of Complexity: A Survey of Empirical Studies on Graph Visualisation

Abstract For decades, researchers in information visualisation and graph drawing have focused on developing techniques for the layout and display of very large and complex networks. Experiments involving human participants have also explored the readability of different styles of layout and representations for such networks. In both bodies of literature, networks are frequently referred to as being ‘large’ or ‘complex’, yet these terms are relative. From a human-centred, experiment point-of-view, what constitutes ‘large’ (for example) depends on several factors, such as data complexity, visual complexity, and the technology used. In this paper, we survey the literature on human-centred experiments to understand how, in practice, different features and characteristics of node–link diagrams affect visual complexity.

[1]  Silvia Miksch,et al.  Evaluation of Two Interaction Techniques for Visualization of Dynamic Graphs , 2016, Graph Drawing.

[2]  P. John Clarkson,et al.  Matrices or Node-Link Diagrams: Which Visual Representation is Better for Visualising Connectivity Models? , 2006, Inf. Vis..

[3]  Paul M. Thompson,et al.  Blockwise Human Brain Network Visual Comparison Using NodeTrix Representation , 2017, IEEE Transactions on Visualization and Computer Graphics.

[4]  M. Sheelagh T. Carpendale,et al.  Edgelens: an interactive method for managing edge congestion in graphs , 2003, IEEE Symposium on Information Visualization 2003 (IEEE Cat. No.03TH8714).

[5]  Dino Citraro On Visualization , 2013, Big Data.

[6]  Beryl Plimmer,et al.  Graph Drawing Aesthetics—Created by Users, Not Algorithms , 2012, IEEE Transactions on Visualization and Computer Graphics.

[7]  Yalong Yang,et al.  Many-to-Many Geographically-Embedded Flow Visualisation: An Evaluation , 2019, IEEE Transactions on Visualization and Computer Graphics.

[8]  John T. Stasko,et al.  Orko: Facilitating Multimodal Interaction for Visual Exploration and Analysis of Networks , 2018, IEEE Transactions on Visualization and Computer Graphics.

[9]  Ioannis G. Tollis,et al.  A Visualization Framework and User Studies for Overloaded Orthogonal Drawings , 2018, Comput. Graph. Forum.

[10]  Laura R. Novick,et al.  Interpreting Hierarchical Structure: Evidence from Cladograms in Biology , 2006, Diagrams.

[11]  Han-Wei Shen,et al.  Balloon Focus: a Seamless Multi-Focus+Context Method for Treemaps , 2008, IEEE Transactions on Visualization and Computer Graphics.

[12]  Kim Marriott,et al.  Memorability of Visual Features in Network Diagrams , 2012, IEEE Transactions on Visualization and Computer Graphics.

[13]  Stephen G. Kobourov,et al.  Node, Node-Link, and Node-Link-Group Diagrams: An Evaluation , 2014, IEEE Transactions on Visualization and Computer Graphics.

[14]  Karsten Klein,et al.  Graph Thumbnails: Identifying and Comparing Multiple Graphs at a Glance , 2018, IEEE Transactions on Visualization and Computer Graphics.

[15]  Jarke J. van Wijk,et al.  A user study on visualizing directed edges in graphs , 2009, CHI.

[16]  Tobias Isenberg,et al.  Weighted graph comparison techniques for brain connectivity analysis , 2013, CHI.

[17]  Philippe Castagliola,et al.  On the Readability of Graphs Using Node-Link and Matrix-Based Representations: A Controlled Experiment and Statistical Analysis , 2005, Inf. Vis..

[18]  Helen C. Purchase,et al.  Extremes Are Better: Investigating Mental Map Preservation in Dynamic Graphs , 2008, Diagrams.

[19]  Mary Czerwinski,et al.  Animated visualization of multiple intersecting hierarchies , 2002, Inf. Vis..

[20]  Maria Riveiro,et al.  Understanding Indirect Causal Relationships in Node‐Link Graphs , 2017, Comput. Graph. Forum.

[21]  Weidong Huang,et al.  Improving Force-Directed Graph Drawings by Making Compromises Between Aesthetics , 2010, 2010 IEEE Symposium on Visual Languages and Human-Centric Computing.

[22]  Robert F. Cohen,et al.  Validating Graph Drawing Aesthetics , 1995, GD.

[23]  Xiaoru Yuan,et al.  Social Media Visual Analytics , 2017, Comput. Graph. Forum.

[24]  Bongshin Lee,et al.  A comparative evaluation on tree visualization methods for hierarchical structures with large fan-outs , 2010, CHI.

[25]  Giuseppe Carenini,et al.  Interactive topic hierarchy revision for exploring a collection of online conversations , 2019, Inf. Vis..

[26]  Kwan-Liu Ma,et al.  A Study of Layout, Rendering, and Interaction Methods for Immersive Graph Visualization , 2016, IEEE Transactions on Visualization and Computer Graphics.

[27]  Edwin de Jonge,et al.  Tree Colors: Color Schemes for Tree-Structured Data , 2014, IEEE Transactions on Visualization and Computer Graphics.

[28]  Tamara Munzner,et al.  An evaluation of pan & zoom and rubber sheet navigation with and without an overview , 2006, CHI.

[29]  Wouter Meulemans,et al.  Experimental Analysis of the Accessibility of Drawings with Few Segments , 2017, GD.

[30]  Yifan Hu,et al.  How to Display Group Information on Node-Link Diagrams: An Evaluation , 2014, IEEE Transactions on Visualization and Computer Graphics.

[31]  Daniel W. Archambault,et al.  Difference Map Readability for Dynamic Graphs , 2010, GD.

[32]  Peter Eades,et al.  GION: Interactively Untangling Large Graphs on Wall-Sized Displays , 2014, Graph Drawing.

[33]  Daniel W. Archambault,et al.  Animation, Small Multiples, and the Effect of Mental Map Preservation in Dynamic Graphs , 2011, IEEE Transactions on Visualization and Computer Graphics.

[34]  Chen Wang,et al.  1.5D Egocentric Dynamic Network Visualization , 2015, IEEE Transactions on Visualization and Computer Graphics.

[35]  Achim Ebert,et al.  PerSoN-Vis: Visualizing Personal Social Networks (Ego Networks) , 2016, CHI Extended Abstracts.

[36]  Daniel W. Archambault,et al.  The Readability of Path‐Preserving Clusterings of Graphs , 2010, Comput. Graph. Forum.

[37]  Karin M. Verspoor,et al.  CommViz: Visualization of semantic patterns in large social communication networks , 2018, Inf. Vis..

[38]  Kwan-Liu Ma,et al.  What Would a Graph Look Like in this Layout? A Machine Learning Approach to Large Graph Visualization , 2017, IEEE Transactions on Visualization and Computer Graphics.

[39]  Philippe Castagliola,et al.  A Comparison of the Readability of Graphs Using Node-Link and Matrix-Based Representations , 2004, IEEE Symposium on Information Visualization.

[40]  Weidong Huang,et al.  Using eye tracking to investigate graph layout effects , 2007, 2007 6th International Asia-Pacific Symposium on Visualization.

[41]  David H. Laidlaw,et al.  Representing Uncertainty in Graph Edges: An Evaluation of Paired Visual Variables , 2015, IEEE Transactions on Visualization and Computer Graphics.

[42]  Diansheng Guo,et al.  Design and evaluation of line symbolizations for origin–destination flow maps , 2017, Inf. Vis..

[43]  Peter J. Passmore,et al.  A User Study on Curved Edges in Graph Visualization , 2012, IEEE Transactions on Visualization and Computer Graphics.

[44]  Michael J. McGuffin,et al.  DiffAni: Visualizing Dynamic Graphs with a Hybrid of Difference Maps and Animation , 2013, IEEE Transactions on Visualization and Computer Graphics.

[45]  Colin Ware,et al.  Supporting Visual Queries on Medium-Sized Node–Link Diagrams , 2005, Inf. Vis..

[46]  Kim Marriott,et al.  Evaluating Perceptually Complementary Views for Network Exploration Tasks , 2017, CHI.

[47]  Wouter Meulemans,et al.  A Tale of Two Communities: Assessing Homophily in Node-Link Diagrams , 2015, GD.

[48]  Jean-Daniel Fekete,et al.  Matrix Reordering Methods for Table and Network Visualization , 2016, Comput. Graph. Forum.

[49]  Martin Nöllenburg,et al.  On the Readability of Boundary Labeling , 2015, Graph Drawing.

[50]  Peter Eades,et al.  Effects of Crossing Angles , 2008, 2008 IEEE Pacific Visualization Symposium.

[51]  M. Sheelagh T. Carpendale,et al.  A Descriptive Framework for Temporal Data Visualizations Based on Generalized Space‐Time Cubes , 2017, Comput. Graph. Forum.

[52]  Stephen G. Kobourov,et al.  Comparing Node‐Link and Node‐Link‐Group Visualizations From An Enjoyment Perspective , 2016, Comput. Graph. Forum.

[53]  Daniel W. Archambault,et al.  The mental map and memorability in dynamic graphs , 2012, 2012 IEEE Pacific Visualization Symposium.

[54]  Henry Been-Lirn Duh,et al.  Effects of curves on graph perception , 2016, 2016 IEEE Pacific Visualization Symposium (PacificVis).

[55]  James R. Eagan,et al.  SchemeLens: A Content-Aware Vector-Based Fisheye Technique for Navigating Large Systems Diagrams , 2016, IEEE Transactions on Visualization and Computer Graphics.

[56]  Weidong Huang,et al.  Measuring Effectiveness of Graph Visualizations: A Cognitive Load Perspective , 2009, Inf. Vis..

[57]  Bernhard Preim,et al.  Visual Verification of Cancer Staging for Therapy Decision Support , 2017, Comput. Graph. Forum.

[58]  Eve E. Hoggan,et al.  How Important Is the "Mental Map"? - An Empirical Investigation of a Dynamic Graph Layout Algorithm , 2006, GD.

[59]  Johannes Schwank,et al.  Multivariate Networks: A Novel Edge Visualization Approach for Graph-based Visual Analysis Tasks , 2016, CHI Extended Abstracts.

[60]  Wouter Meulemans,et al.  Experimental Analysis of the Accessibility of Drawings with Few Segments , 2017, Graph Drawing.

[61]  James Abello,et al.  ASK-GraphView: A Large Scale Graph Visualization System , 2006, IEEE Transactions on Visualization and Computer Graphics.

[62]  Chris North,et al.  A comparison of benchmark task and insight evaluation methods for information visualization , 2011, Inf. Vis..

[63]  N. Hari Narayanan,et al.  Exploring the Effect of Animation and Progressive Revealing on Diagrammatic Problem Solving , 2006, Diagrams.

[64]  Daniel W. Archambault,et al.  Communities Found by Users -- not Algorithms: Comparing Human and Algorithmically Generated Communities , 2016, CHI.

[65]  Ivan Herman,et al.  Graph Visualization and Navigation in Information Visualization: A Survey , 2000, IEEE Trans. Vis. Comput. Graph..

[66]  Arjan Kuijper,et al.  Visual Analysis of Large Graphs , 2010, Eurographics.

[67]  Pak Chung Wong,et al.  Dynamic visualization of graphs with extended labels , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[68]  Jean-Daniel Fekete,et al.  GraphDiaries: Animated Transitions andTemporal Navigation for Dynamic Networks , 2014, IEEE Transactions on Visualization and Computer Graphics.

[69]  Daniel W. Archambault,et al.  On the effective visualisation of dynamic attribute cascades , 2016, Inf. Vis..

[70]  Stephen G. Kobourov,et al.  On the Usability of Lombardi Graph Drawings , 2012, Graph Drawing.

[71]  Colin Ware,et al.  Visual Thinking with an Interactive Diagram , 2008, Diagrams.

[72]  Fabian Beck,et al.  The State of the Art in Visualizing Group Structures in Graphs , 2015, EuroVis.

[73]  Christophe Hurter,et al.  Scalability Considerations for Multivariate Graph Visualization , 2013, Multivariate Network Visualization.

[74]  John T. Stasko,et al.  Toward a Deeper Understanding of the Role of Interaction in Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[75]  Heidrun Schumann,et al.  A Survey of Multi-faceted Graph Visualization , 2015, EuroVis.

[76]  Daniel W. Archambault,et al.  Can animation support the visualisation of dynamic graphs? , 2016, Inf. Sci..

[77]  Tobias Höllerer,et al.  Structuring the space: a study on enriching node-link diagrams with visual references , 2014, CHI.

[78]  Tamara Munzner,et al.  GrouseFlocks: Steerable Exploration of Graph Hierarchy Space , 2008, IEEE Transactions on Visualization and Computer Graphics.

[79]  Jim Blythe,et al.  The Effect of Graph Layout on Inference from Social Network Data , 1995, GD.

[80]  Ioannis G. Tollis,et al.  Exploring Complex Drawings via Edge Stratification , 2013, GD.

[81]  Ye Zhao,et al.  TrajGraph: A Graph-Based Visual Analytics Approach to Studying Urban Network Centralities Using Taxi Trajectory Data , 2016, IEEE Transactions on Visualization and Computer Graphics.

[82]  Bruce H. Thomas,et al.  Immersive Collaborative Analysis of Network Connectivity: CAVE-style or Head-Mounted Display? , 2017, IEEE Transactions on Visualization and Computer Graphics.

[83]  Michael Farrugia,et al.  Effective Temporal Graph Layout: A Comparative Study of Animation versus Static Display Methods , 2011, Inf. Vis..

[84]  Niklas Elmqvist,et al.  Perception of Animated Node‐Link Diagrams for Dynamic Graphs , 2012, Comput. Graph. Forum.

[85]  Radu Jianu,et al.  Revisited Network Representations , 2017 .

[86]  Charles Perin,et al.  Active Reading of Visualizations , 2018, IEEE Transactions on Visualization and Computer Graphics.

[87]  Niklas Elmqvist,et al.  Dynamic Insets for Context‐Aware Graph Navigation , 2011, Comput. Graph. Forum.

[88]  Michael Burch,et al.  Evaluation of Traditional, Orthogonal, and Radial Tree Diagrams by an Eye Tracking Study , 2011, IEEE Transactions on Visualization and Computer Graphics.

[89]  Kim Marriott,et al.  Edge Compression Techniques for Visualization of Dense Directed Graphs , 2013, IEEE Transactions on Visualization and Computer Graphics.

[90]  Catherine Plaisant,et al.  TreePlus: Interactive Exploration of Networks with Enhanced Tree Layouts , 2006, IEEE Transactions on Visualization and Computer Graphics.

[91]  Radu Jianu,et al.  A Gaze‐enabled Graph Visualization to Improve Graph Reading Tasks , 2014, Comput. Graph. Forum.

[92]  Weidong Huang,et al.  Exploring the relative importance of crossing number and crossing angle , 2010, VINCI '10.

[93]  Daniel Chivers,et al.  Octilinear Force-Directed Layout with Mental Map Preservation for Schematic Diagrams , 2014, Diagrams.

[94]  Lei Shi,et al.  A Coloring Algorithm for Disambiguating Graph and Map Drawings , 2014, IEEE Transactions on Visualization and Computer Graphics.

[95]  Helen C. Purchase,et al.  Which Aesthetic has the Greatest Effect on Human Understanding? , 1997, GD.

[96]  Robert Kosara,et al.  The Shaping of Information by Visual Metaphors , 2008, IEEE Transactions on Visualization and Computer Graphics.

[97]  Desney S. Tan,et al.  AdaptiviTree: Adaptive Tree Visualization for Tournament-Style Brackets , 2007, IEEE Transactions on Visualization and Computer Graphics.

[98]  Fabien Picarougne,et al.  Visual Community Detection: An Evaluation of 2D, 3D Perspective and 3D Stereoscopic Displays , 2011, Graph Drawing.

[99]  Pourang Irani,et al.  Visualizing Causal Semantics Using Animations , 2007, IEEE Transactions on Visualization and Computer Graphics.

[100]  Arjan Kuijper,et al.  Visual Analysis of Large Graphs: State‐of‐the‐Art and Future Research Challenges , 2011, Eurographics.

[101]  Tamara Munzner,et al.  A search-set model of path tracing in graphs , 2015, Inf. Vis..

[102]  Daniel W. Archambault,et al.  The "Map" in the mental map: Experimental results in dynamic graph drawing , 2013, Int. J. Hum. Comput. Stud..

[103]  Michael Burch,et al.  A Taxonomy and Survey of Dynamic Graph Visualization , 2017, Comput. Graph. Forum.

[104]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[105]  Andreas Kerren,et al.  Displaying User Behavior in the Collaborative Graph Visualization System OnGraX , 2015, GD.

[106]  Michael Burch,et al.  Visual task solution strategies in tree diagrams , 2013, 2013 IEEE Pacific Visualization Symposium (PacificVis).

[107]  Jean-Daniel Fekete,et al.  Improving the Readability of Clustered Social Networks using Node Duplication , 2008, IEEE Transactions on Visualization and Computer Graphics.

[108]  Randall P. White TOWARD A DEEPER UNDERSTANDING OF THE ROLE OF TRUSTED LEADERSHIP ADVISOR, AND KNOWING IF YOU ARE READY FOR IT , 2017 .

[109]  Tobias Höllerer,et al.  Stereoscopic Highlighting: 2D Graph Visualization on Stereo Displays , 2011, IEEE Transactions on Visualization and Computer Graphics.

[110]  Guy Melançon,et al.  Just how dense are dense graphs in the real world?: a methodological note , 2006, BELIV '06.

[111]  Chris North,et al.  The Perceptual Scalability of Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[112]  Weidong Huang,et al.  A graph reading behavior: Geodesic-path tendency , 2009, 2009 IEEE Pacific Visualization Symposium.

[113]  David A. Carrington,et al.  User Preference of Graph Layout Aesthetics: A UML Study , 2000, GD.

[114]  Robert Kosara,et al.  Preconceptions and Individual Differences in Understanding Visual Metaphors , 2009, Comput. Graph. Forum.

[115]  Weidong Huang,et al.  Layout Effects on Sociogram Perception , 2005, GD.

[116]  JungHyun Han,et al.  Tablorer – An Interactive Tree Visualization System for Tablet PCs , 2011, Comput. Graph. Forum.

[117]  Dongyu Liu,et al.  egoComp: A node-link-based technique for visual comparison of ego-networks , 2017, Inf. Vis..

[118]  Fabian Beck,et al.  Visualizing Group Structures in Graphs: A Survey , 2017, Comput. Graph. Forum.

[119]  Jean-Daniel Fekete,et al.  Author Manuscript, Published in "sigchi Conference on Human Factors in Computing Systems Topology-aware Navigation in Large Networks , 2022 .

[120]  Jean-Daniel Fekete,et al.  Task taxonomy for graph visualization , 2006, BELIV '06.

[121]  Benjamin Watson,et al.  Developing and Evaluating Quilts for the Depiction of Large Layered Graphs , 2011, IEEE Transactions on Visualization and Computer Graphics.

[122]  Peter Eades,et al.  Shape-Based Quality Metrics for Large Graph Visualization , 2015, J. Graph Algorithms Appl..

[123]  Radu Jianu,et al.  GraphUnit: Evaluating Interactive Graph Visualizations Using Crowdsourcing , 2015, Comput. Graph. Forum.

[124]  Peter J. Stuckey,et al.  Exploration of Networks using overview+detail with Constraint-based cooperative layout , 2008, IEEE Transactions on Visualization and Computer Graphics.

[125]  Xin Zhang,et al.  Intelligent Graph Layout Using Many Users' Input , 2012, IEEE Transactions on Visualization and Computer Graphics.

[126]  Michael Burch,et al.  Comparative Eye Tracking Study on Node-Link Visualizations of Trajectories , 2014, IEEE Transactions on Visualization and Computer Graphics.

[127]  Margit Pohl,et al.  Visual Similarity Perception of Directed Acyclic Graphs: A Study on Influencing Factors , 2017, GD.

[128]  Emilio Di Giacomo,et al.  Graph Visualization Techniques for Web Clustering Engines , 2007, IEEE Transactions on Visualization and Computer Graphics.

[129]  Frank van Ham,et al.  “Search, Show Context, Expand on Demand”: Supporting Large Graph Exploration with Degree-of-Interest , 2009, IEEE Transactions on Visualization and Computer Graphics.

[130]  Krzysztof Z. Gajos,et al.  Evaluation of Filesystem Provenance Visualization Tools , 2013, IEEE Transactions on Visualization and Computer Graphics.

[131]  Bernice E. Rogowitz,et al.  Perceptual Organization in User-Generated Graph Layouts , 2008, IEEE Transactions on Visualization and Computer Graphics.

[132]  Stephen G. Kobourov,et al.  Are Crossings Important for Drawing Large Graphs? , 2014, Graph Drawing.

[133]  Christophe Hurter,et al.  Towards Unambiguous Edge Bundling: Investigating Confluent Drawings for Network Visualization , 2017, IEEE Transactions on Visualization and Computer Graphics.

[134]  Jean-Daniel Fekete,et al.  Hierarchical Aggregation for Information Visualization: Overview, Techniques, and Design Guidelines , 2010, IEEE Transactions on Visualization and Computer Graphics.

[135]  Christophe Hurter,et al.  State of the Art in Edge and Trail Bundling Techniques , 2017, Comput. Graph. Forum.

[136]  Daniel W. Archambault,et al.  Mental Map Preservation Helps User Orientation in Dynamic Graphs , 2012, GD.

[137]  Stephen G. Kobourov,et al.  Map‐based Visualizations Increase Recall Accuracy of Data , 2015, Comput. Graph. Forum.

[138]  Michael Burch,et al.  Visual Adjacency Lists for Dynamic Graphs , 2014, IEEE Transactions on Visualization and Computer Graphics.

[139]  Colin Ware,et al.  Cognitive Measurements of Graph Aesthetics , 2002, Inf. Vis..

[140]  Jian Zhao,et al.  Supporting Handoff in Asynchronous Collaborative Sensemaking Using Knowledge-Transfer Graphs , 2018, IEEE Transactions on Visualization and Computer Graphics.

[141]  Pak Chung Wong,et al.  Graph Signatures for Visual Analytics , 2006, IEEE Transactions on Visualization and Computer Graphics.

[142]  Kim Marriott,et al.  HOLA: Human-like Orthogonal Network Layout , 2016, IEEE Transactions on Visualization and Computer Graphics.

[143]  A. Karr,et al.  Visual Scalability , 2002 .

[144]  Kwan-Liu Ma,et al.  A Study On Designing Effective Introductory Materials for Information Visualization , 2016, Comput. Graph. Forum.

[145]  Ben Shneiderman,et al.  Motif simplification: improving network visualization readability with fan, connector, and clique glyphs , 2013, CHI.

[146]  Chris North,et al.  A Comparison of User-Generated and Automatic Graph Layouts , 2009, IEEE Transactions on Visualization and Computer Graphics.

[147]  Roberto Tamassia,et al.  A User Study in Similarity Measures for Graph Drawing , 2000, J. Graph Algorithms Appl..

[148]  Mira Dontcheva,et al.  MatrixWave: Visual Comparison of Event Sequence Data , 2015, CHI.

[149]  Jean-Daniel Fekete,et al.  An extended evaluation of the readability of tapered, animated, and textured directed-edge representations in node-link graphs , 2011, 2011 IEEE Pacific Visualization Symposium.

[150]  Alex Endert,et al.  VIGOR: Interactive Visual Exploration of Graph Query Results , 2018, IEEE Transactions on Visualization and Computer Graphics.

[151]  Nan Cao,et al.  Evaluation of Graph Sampling: A Visualization Perspective , 2017, IEEE Transactions on Visualization and Computer Graphics.

[152]  Michael Burch,et al.  Evaluating Partially Drawn Links for Directed Graph Edges , 2011, GD.

[153]  Jian Zhao,et al.  Egocentric Analysis of Dynamic Networks with EgoLines , 2016, CHI.