iVoLVER: Interactive Visual Language for Visualization Extraction and Reconstruction

We present the design and implementation of iVoLVER, a tool that allows users to create visualizations without textual programming. iVoLVER is designed to enable flexible acquisition of many types of data (text, colors, shapes, quantities, dates) from multiple source types (bitmap charts, webpages, photographs, SVGs, CSV files) and, within the same canvas, supports transformation of that data through simple widgets to construct interactive animated visuals. Aside from the tool, which is web-based and designed for pen and touch, we contribute the design of the interactive visual language and widgets for extraction, transformation, and representation of data. We demonstrate the flexibility and expressive power of the tool through a set of scenarios, and discuss some of the challenges encountered and how the tool fits within the current infovis tool landscape.

[1]  Maneesh Agrawala,et al.  Deconstructing and restyling D3 visualizations , 2014, UIST.

[2]  Daniel D. Hils,et al.  Visual languages and computing survey: Data flow visual programming languages , 1992, J. Vis. Lang. Comput..

[3]  Aniket Kittur,et al.  Kinetica: naturalistic multi-touch data visualization , 2014, CHI.

[4]  Jeffrey Heer,et al.  SpanningAspectRatioBank Easing FunctionS ArrayIn ColorIn Date Interpolator MatrixInterpola NumObjecPointI Rectang ISchedu Parallel Pause Scheduler Sequen Transition Transitioner Transiti Tween Co DelimGraphMLCon IData JSONCon DataField DataSc Dat DataSource Data DataUtil DirtySprite LineS RectSprite , 2011 .

[5]  E. Salas,et al.  Team cognition : understanding the factors that drive process and performance , 2004 .

[6]  Arvind Satyanarayan,et al.  Lyra: An Interactive Visualization Design Environment , 2014, Comput. Graph. Forum.

[7]  S. Greenberg,et al.  The Importance of Awareness for Team Cognition in Distributed Collaboration , 2001 .

[8]  Chew Lim Tan,et al.  A system for understanding imaged infographics and its applications , 2007, DocEng '07.

[9]  Jeffrey Heer,et al.  Crowdsourcing graphical perception: using mechanical turk to assess visualization design , 2010, CHI.

[10]  James D. Hollan,et al.  Pad++: a zooming graphical interface for exploring alternate interface physics , 1994, UIST '94.

[11]  Niklas Elmqvist,et al.  Towards Utilizing GPUs in Information Visualization: A Model and Implementation of Image-Space Operations , 2009, IEEE Transactions on Visualization and Computer Graphics.

[12]  Robert McGill,et al.  Graphical Perception: The Visual Decoding of Quantitative Information on Graphical Displays of Data , 1987 .

[13]  Alexander W. Skaburskis,et al.  The Sandbox for analysis: concepts and methods , 2006, CHI.

[14]  Niklas Elmqvist,et al.  Munin: A Peer-to-Peer Middleware for Ubiquitous Analytics and Visualization Spaces , 2015, IEEE Transactions on Visualization and Computer Graphics.

[15]  M. Sheelagh T. Carpendale,et al.  Lark: Coordinating Co-located Collaboration with Information Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[16]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[17]  W. Cleveland,et al.  Graphical Perception: Theory, Experimentation, and Application to the Development of Graphical Methods , 1984 .

[18]  M. Sheelagh T. Carpendale,et al.  Transmogrification: causal manipulation of visualizations , 2013, UIST.

[19]  Eric Rosenbaum,et al.  Scratch: programming for all , 2009, Commun. ACM.

[20]  Andrew M. Webb,et al.  Beyond Slideware: How a Free-form Presentation Medium Stimulates Free-form Thinking in the Classroom , 2015, Creativity & Cognition.

[21]  Jeffrey Heer,et al.  prefuse: a toolkit for interactive information visualization , 2005, CHI.

[22]  Martin Wattenberg,et al.  ManyEyes: a Site for Visualization at Internet Scale , 2007, IEEE Transactions on Visualization and Computer Graphics.

[23]  Matthew Chalmers,et al.  A Visual Workspace for Constructing Hybrid Multidimensional Scaling Algorithms and Coordinating Multiple Views , 2003, Inf. Vis..

[24]  Jacques Bertin,et al.  Semiology of Graphics - Diagrams, Networks, Maps , 2010 .

[25]  Benjamin B. Bederson,et al.  A review of overview+detail, zooming, and focus+context interfaces , 2009, CSUR.

[26]  Jeffrey Travis,et al.  LabVIEW for Everyone: Graphical Programming Made Easy and Fun , 2006 .

[27]  Melanie Tory,et al.  A Survey of Visualization Construction User Interfaces , 2013, EuroVis.

[28]  H. Theisel,et al.  ExPlates: Spatializing Interactive Analysis to Scaffold Visual Exploration , 2013, Comput. Graph. Forum.

[29]  Matthew Chalmers,et al.  A virtual workspace for hybrid multidimensional scaling algorithms , 2003, IEEE Symposium on Information Visualization 2003 (IEEE Cat. No.03TH8714).

[30]  S. Papert,et al.  Constructionism: Research Reports and Essays, 1985-1990 , 1991 .

[31]  Brad A. Myers,et al.  Taxonomies of visual programming and program visualization , 1990, J. Vis. Lang. Comput..

[32]  Chew Lim Tan,et al.  Extraction of Vectorized Graphical Information from Scientific Chart Images , 2007, Ninth International Conference on Document Analysis and Recognition (ICDAR 2007).

[33]  湯淺 太一,et al.  20世紀の名著名論:Seymour Papert: Mindstorms:Children Computers and Powerful Ideas Basic Books New York 1980 , 2005 .

[34]  Tobias Höllerer,et al.  iVisDesigner: Expressive Interactive Design of Information Visualizations , 2014, IEEE Transactions on Visualization and Computer Graphics.

[35]  M. Sheelagh T. Carpendale,et al.  ToCoPlay: Graphical Multi-touch Interaction for Composing and Playing Music , 2011, INTERACT.

[36]  Raimund Dachselt,et al.  Investigating multi-touch and pen gestures for diagram editing on interactive surfaces , 2009, ITS '09.

[37]  M. Sheelagh T. Carpendale,et al.  Data analysis on interactive whiteboards through sketch-based interaction , 2011, ITS '11.

[38]  Christophe Hurter,et al.  Transmogrification : Casual Manipulation of Visualizations , 2013 .

[39]  M. Sheelagh T. Carpendale,et al.  Constructive visualization , 2014, Conference on Designing Interactive Systems.

[40]  John T. Stasko,et al.  DataMeadow: A Visual Canvas for Analysis of Large-Scale Multivariate Data , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[41]  Yuriko Takeshima,et al.  GADGET/IV: a taxonomic approach to semi-automatic design of information visualization applications using modular visualization environment , 2000, IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings.

[42]  Seymour Papert,et al.  Mindstorms: Children, Computers, and Powerful Ideas , 1981 .

[43]  Bongshin Lee,et al.  SketchStory: Telling More Engaging Stories with Data through Freeform Sketching , 2013, IEEE Transactions on Visualization and Computer Graphics.

[44]  Yingcai Wu,et al.  A Survey of Visual Analytics Techniques and Applications: State-of-the-Art Research and Future Challenges , 2013, Journal of Computer Science and Technology.

[45]  Jaime Snyder,et al.  Image-Enabled Discourse: Investigating the Creation of Visual Information as Communicative Practice , 2012 .

[46]  M. Sheelagh T. Carpendale,et al.  A set of multi-touch graph interaction techniques , 2010, ITS '10.

[47]  Rick Kazman,et al.  Rapid prototyping of information visualizations using VANISH , 1996, Proceedings IEEE Symposium on Information Visualization '96.

[48]  HeerJeffrey,et al.  D3 Data-Driven Documents , 2011 .

[49]  Jeffrey Heer,et al.  ReVision: automated classification, analysis and redesign of chart images , 2011, UIST.

[50]  Casey Reas,et al.  Processing: a learning environment for creating interactive Web graphics , 2003, SIGGRAPH.