The design space of construction tools for information visualization: A survey

Abstract Information visualization has been widely used to convey information from data and assist communication. There are enormous needs of efficient visualization design for users from diverse fields to leverage the power of data. As a result, emerging construction tools for information visualization focus on providing solutions with different aspects including expressiveness, accessibility, and efficiency. In this paper, we review existing works on declarative specifications and user interfaces for visualization construction. By summarizing their methods for producing information visualizations and efforts on improving usability, we express the design patterns in terms of a design space which describes the tools in several different aspects. We discuss how the design space can be applied to support further exploration of potential research topics in the future.

[1]  Martin Brown,et al.  The dataflow visualization pipeline as a problem solving environment , 1996 .

[2]  Jim Davies,et al.  Taxonomy-Based Glyph Design—with a Case Study on Visualizing Workflows of Biological Experiments , 2012, IEEE Transactions on Visualization and Computer Graphics.

[3]  John Riedl,et al.  An operator interaction framework for visualization systems , 1998, Proceedings IEEE Symposium on Information Visualization (Cat. No.98TB100258).

[4]  Maneesh Agrawala,et al.  Graphical Overlays: Using Layered Elements to Aid Chart Reading , 2012, IEEE Transactions on Visualization and Computer Graphics.

[5]  William E. Lorensen,et al.  The design and implementation of an object-oriented toolkit for 3D graphics and visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[6]  Jeffrey Heer,et al.  prefuse: a toolkit for interactive information visualization , 2005, CHI.

[7]  Uta Hinrichs,et al.  Bottom-up vs. Top-down: Trade-offs in Efficiency, Understanding, Freedom and Creativity with InfoVis Tools , 2017, CHI.

[8]  M. Sheelagh T. Carpendale,et al.  SketchInsight: Natural data exploration on interactive whiteboards leveraging pen and touch interaction , 2015, 2015 IEEE Pacific Visualization Symposium (PacificVis).

[9]  Jeffrey Heer,et al.  Software Design Patterns for Information Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[10]  Arvind Satyanarayan,et al.  Lyra: An Interactive Visualization Design Environment , 2014, Comput. Graph. Forum.

[11]  Bongshin Lee,et al.  SketchStory: Telling More Engaging Stories with Data through Freeform Sketching , 2013, IEEE Transactions on Visualization and Computer Graphics.

[12]  Kanit Wongsuphasawat,et al.  Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations , 2016, IEEE Transactions on Visualization and Computer Graphics.

[13]  James P. O'Connor,et al.  Reuse in Command-and-Control Systems , 1994, IEEE Software.

[14]  W. Cleveland,et al.  Graphical Perception: Theory, Experimentation, and Application to the Development of Graphical Methods , 1984 .

[15]  Arvind Satyanarayan,et al.  Vega-Lite: A Grammar of Interactive Graphics , 2018, IEEE Transactions on Visualization and Computer Graphics.

[16]  Jeffrey Heer,et al.  Declarative Language Design for Interactive Visualization , 2010, IEEE Transactions on Visualization and Computer Graphics.

[17]  Miguel A. Nacenta,et al.  iVoLVER: Interactive Visual Language for Visualization Extraction and Reconstruction , 2016, CHI.

[18]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[19]  Cláudio T. Silva,et al.  VisTrails: enabling interactive multiple-view visualizations , 2005, VIS 05. IEEE Visualization, 2005..

[20]  Niklas Elmqvist,et al.  Direct manipulation through surrogate objects , 2011, CHI.

[21]  John Riedl,et al.  A spreadsheet approach to information visualization , 1997, Proceedings of VIZ '97: Visualization Conference, Information Visualization Symposium and Parallel Rendering Symposium.

[22]  Wei Chen,et al.  A survey of network anomaly visualization , 2017, Science China Information Sciences.

[23]  Steven M. Drucker,et al.  Reflections on how designers design with data , 2014, AVI.

[24]  Jade Goldstein-Stewart,et al.  Interactive graphic design using automatic presentation knowledge , 1994, CHI '94.

[25]  Jeffrey Heer,et al.  Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[26]  T. J. Jankun-Kelly,et al.  Visualization Exploration and Encapsulation via a Spreadsheet-Like Interface , 2001, IEEE Trans. Vis. Comput. Graph..

[27]  Cláudio T. Silva,et al.  VisFlow - Web-based Visualization Framework for Tabular Data with a Subset Flow Model , 2017, IEEE Transactions on Visualization and Computer Graphics.

[28]  Niklas Elmqvist,et al.  DataMeadow: A Visual Canvas for Analysis of Large-Scale Multivariate Data , 2007 .

[29]  Stéphane Conversy,et al.  Augmenting the scope of interactions with implicit and explicit graphical structures , 2012, CHI.

[30]  Arvind Satyanarayan,et al.  Declarative interaction design for data visualization , 2014, UIST.

[31]  Mira Dontcheva,et al.  Data-Driven Guides: Supporting Expressive Design for Information Graphics , 2017, IEEE Transactions on Visualization and Computer Graphics.

[32]  M. Sheelagh T. Carpendale,et al.  Constructive visualization , 2014, Conference on Designing Interactive Systems.

[33]  Melanie Tory,et al.  How Information Visualization Novices Construct Visualizations , 2010, IEEE Trans. Vis. Comput. Graph..

[34]  Monica M. C. Schraefel,et al.  Graph sketcher: extending illustration to quantitative graphs , 2009, CHI.

[35]  Stefan Pietschmann,et al.  Context-aware Recommendation of Visualization Components , 2012 .

[36]  Yu Zhang,et al.  Interaction+: Interaction enhancement for web-based visualizations , 2017, 2017 IEEE Pacific Visualization Symposium (PacificVis).

[37]  Bongshin Lee,et al.  Timelines Revisited: A Design Space and Considerations for Expressive Storytelling , 2017, IEEE Transactions on Visualization and Computer Graphics.

[38]  Niklas Elmqvist,et al.  Exploring the design space of composite visualization , 2012, 2012 IEEE Pacific Visualization Symposium.

[39]  Jock D. Mackinlay,et al.  The structure of the information visualization design space , 1997, Proceedings of VIZ '97: Visualization Conference, Information Visualization Symposium and Parallel Rendering Symposium.

[40]  Paul Hudak,et al.  Event-Driven FRP , 2002, PADL.

[41]  Jeffrey Heer,et al.  Reverse‐Engineering Visualizations: Recovering Visual Encodings from Chart Images , 2017, Comput. Graph. Forum.

[42]  Pat Hanrahan,et al.  Polaris: A System for Query, Analysis, and Visualization of Multidimensional Relational Databases , 2002, IEEE Trans. Vis. Comput. Graph..

[43]  Niklas Elmqvist,et al.  ExPlates: Spatializing Interactive Analysis to Scaffold Visual Exploration , 2013, Comput. Graph. Forum.

[44]  Fan Zhang,et al.  Recent progress and trends in predictive visual analytics , 2017, Frontiers of Computer Science.

[45]  Melanie Tory,et al.  A Survey of Visualization Construction User Interfaces , 2013, EuroVis.

[46]  Tamara Munzner,et al.  Matches, Mismatches, and Methods: Multiple-View Workflows for Energy Portfolio Analysis , 2016, IEEE Transactions on Visualization and Computer Graphics.

[47]  M. Sheelagh T. Carpendale,et al.  Data analysis on interactive whiteboards through sketch-based interaction , 2011, ITS '11.

[48]  Leland Wilkinson.  The Grammar of Graphics , 1999 .

[49]  Hadley Wickham,et al.  A Layered Grammar of Graphics , 2010 .

[50]  Jeffrey Heer,et al.  Protovis: A Graphical Toolkit for Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[51]  Niklas Elmqvist,et al.  VisDock: A Toolkit for Cross-Cutting Interactions in Visualization , 2015, IEEE Transactions on Visualization and Computer Graphics.

[52]  M. Sheelagh T. Carpendale,et al.  Creation and Collaboration: Engaging New Audiences for Information Visualization , 2008, Information Visualization.

[53]  Gary Marchionini,et al.  Exploratory search , 2006, Commun. ACM.

[54]  Stephen M. Casner,et al.  Task-analytic approach to the automated design of graphic presentations , 1991, TOGS.

[55]  Arvind Satyanarayan,et al.  Visual Debugging Techniques for Reactive Data Visualization , 2016, Comput. Graph. Forum.

[56]  Clayton Lewis.  NoPumpG: Creating Interactive Graphics With Spreadsheet Machinery , 1987 .

[57]  Jeffrey Heer,et al.  ReVision: automated classification, analysis and redesign of chart images , 2011, UIST.

[58]  John T. Stasko,et al.  The Science of Interaction , 2009, Inf. Vis..

[59]  Wei Chen,et al.  A Survey of Visual Analytic Pipelines , 2016, Journal of Computer Science and Technology.

[60]  Martin Wattenberg,et al.  ManyEyes: a Site for Visualization at Internet Scale , 2007, IEEE Transactions on Visualization and Computer Graphics.

[61]  Alex Endert,et al.  Visualization by Demonstration: An Interaction Paradigm for Visual Data Exploration , 2017, IEEE Transactions on Visualization and Computer Graphics.

[62]  Steven K. Feiner,et al.  Relaxed selection techniques for querying time-series graphs , 2009, UIST '09.

[63]  Steven M. Drucker,et al.  Iterating between Tools to Create and Edit Visualizations , 2017, IEEE Transactions on Visualization and Computer Graphics.

[64]  Jean-Daniel Fekete.  The InfoVis Toolkit , 2004 .

[65]  Ryen W. White,et al.  Exploratory Search: Beyond the Query-Response Paradigm , 2009, Exploratory Search: Beyond the Query-Response Paradigm.

[66]  Pat Hanrahan,et al.  Show Me: Automatic Presentation for Visual Analysis , 2007, IEEE Transactions on Visualization and Computer Graphics.

[67]  Xiaoji Chen,et al.  Vis-à-vis: A Visual Language for Spreadsheet Visualizations , 2011 .

[68]  Chris Weaver.  Building Highly-Coordinated Visualizations in Improvise , 2004 .

[69]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[70]  Daniel F. Keefe,et al.  Visualization-by-Sketching: An Artist's Interface for Creating Multivariate Time-Varying Data Visualizations , 2016, IEEE Transactions on Visualization and Computer Graphics.

[71]  Jeffrey Heer,et al.  SpanningAspectRatioBank Easing FunctionS ArrayIn ColorIn Date Interpolator MatrixInterpola NumObjecPointI Rectang ISchedu Parallel Pause Scheduler Sequen Transition Transitioner Transiti Tween Co DelimGraphMLCon IData JSONCon DataField DataSc Dat DataSource Data DataUtil DirtySprite LineS RectSprite , 2011 .

[72]  Zhen Wen,et al.  Behavior-driven visualization recommendation , 2009, IUI.

[73]  Wolfgang De Meuter,et al.  A survey on reactive programming , 2013, CSUR.

[74]  Matthew Chalmers,et al.  A Visual Workspace for Constructing Hybrid Multidimensional Scaling Algorithms and Coordinating Multiple Views , 2003, Inf. Vis..

[75]  Ben Shneiderman,et al.  Dynamic queries for visual information seeking , 1994, IEEE Software.

[76]  John T. Stasko,et al.  Mental Models, Visual Reasoning and Interaction in Information Visualization: A Top-down Perspective , 2010, IEEE Transactions on Visualization and Computer Graphics.

[77]  Fei-Yue Wang,et al.  A Survey of Traffic Data Visualization , 2015, IEEE Transactions on Intelligent Transportation Systems.

[78]  Casey Reas,et al.  Processing.org: a networked context for learning computer programming , 2005, SIGGRAPH '05.

[79]  Niklas Elmqvist,et al.  Cognitive Stages in Visual Data Exploration , 2016, BELIV '16.

[80]  Ross Maciejewski,et al.  Visual Analytics of Mobility and Transportation: State of the Art and Further Research Directions , 2017, IEEE Transactions on Intelligent Transportation Systems.

[81]  Maneesh Agrawala,et al.  Converting Basic D3 Charts into Reusable Style Templates , 2016, IEEE Transactions on Visualization and Computer Graphics.

[82]  Bertjan Broeksema,et al.  Capturing the Design Space of Sequential Space-Filling Layouts , 2012, IEEE Transactions on Visualization and Computer Graphics.

[83]  Arvind Satyanarayan,et al.  Reactive Vega: A Streaming Dataflow Architecture for Declarative Interactive Visualization , 2016, IEEE Transactions on Visualization and Computer Graphics.

[84]  Jarke J. van Wijk,et al.  Flexible Linked Axes for Multivariate Data Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[85]  Ben Shneiderman,et al.  The Craft of Information Visualization: Readings and Reflections , 2003 .

[86]  Ed H. Chi,et al.  A taxonomy of visualization techniques using the data state reference model , 2000, IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings.

[87]  Tobias Höllerer,et al.  iVisDesigner: Expressive Interactive Design of Information Visualizations , 2014, IEEE Transactions on Visualization and Computer Graphics.