Sketch Based Interaction Techniques for Chart Creation and Manipulation

In a classroom environment, students are often required to extract descriptive statistics from charts, or find an appropriate graphical representation of the data they are given. On paper these drawings are static, but in an interactive learning environment, the exploration of data can be improved. To address this, we present a set of novel interaction techniques for the creation and manipulation of 12 chart types that leverage pen and touch in a prototype application, SketChart. We allow a user to sketch an appropriate chart type to visualize their data, after which, he or she can remove, merge, and filter data through direct manipulations. Data series and points are also managed through a pair of interactive legends. In a formative user study based on a set of typical statistics questions, we find that even with a chart recognition accuracy of only 81%, the overall system was still well received and can be used as a learning tool for descriptive statistics.

[1]  M. Sheelagh T. Carpendale,et al.  Data analysis on interactive whiteboards through sketch-based interaction , 2011, ITS '11.

[2]  Joseph J. LaViola,et al.  Revisiting ShortStraw: improving corner finding in sketch-based interfaces , 2009, SBIM '09.

[3]  Liqing Zhang,et al.  Free Hand-Drawn Sketch Segmentation , 2012, ECCV.

[4]  Bongshin Lee,et al.  SketchStory: Telling More Engaging Stories with Data through Freeform Sketching , 2013, IEEE Transactions on Visualization and Computer Graphics.

[5]  M. Sheelagh T. Carpendale,et al.  SketchInsight: Natural data exploration on interactive whiteboards leveraging pen and touch interaction , 2015, 2015 IEEE Pacific Visualization Symposium (PacificVis).

[6]  M. Sheelagh T. Carpendale,et al.  TouchWave: kinetic multi-touch manipulation for hierarchical stacked graphs , 2012, ITS.

[7]  Andries van Dam,et al.  Post-WIMP user interfaces , 1997, CACM.

[8]  John T. Stasko,et al.  Designing and implementing an interactive scatterplot visualization for a tablet computer , 2014, AVI.

[9]  Joseph J. LaViola,et al.  MathPad2: a system for the creation and exploration of mathematical sketches , 2004, SIGGRAPH 2004.

[10]  Emanuel Zgraggen,et al.  PanoramicData: Data Analysis through Pen & Touch , 2014, IEEE Transactions on Visualization and Computer Graphics.

[11]  Randall Davis,et al.  LADDER, a sketching language for user interface developers , 2005, Comput. Graph..

[12]  Marius Brade,et al.  OntoSketch: Towards Digital Sketching as a Tool for Creating and Extending Ontologies for Non-Experts , 2013 .

[13]  Lisa Anthony,et al.  A lightweight multistroke recognizer for user interface prototypes , 2010, Graphics Interface.

[14]  Beryl Plimmer,et al.  Sketching ER Diagrams , 2009, AUIC.

[15]  Aniket Kittur,et al.  TouchViz: (multi)touching multivariate data , 2013, CHI Extended Abstracts.

[16]  Christine Alvarado,et al.  SketchREAD: a multi-domain sketch recognition engine , 2004, UIST '04.

[17]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[18]  Joseph J. LaViola,et al.  PhysicsBook: a sketch-based interface for animating physics diagrams , 2012, IUI '12.

[19]  Joseph J. LaViola,et al.  Mathematical Sketching: A New Approach to Creating and Exploring Dynamic Illustrations , 2005 .

[20]  Ronald Chung,et al.  InkKit: a generic design tool for the tablet PC , 2005, CHINZ '05.

[21]  Robert L. Harris,et al.  Information Graphics: A Comprehensive Illustrated Reference , 1996 .

[22]  Paul Johns,et al.  Understanding Pen and Touch Interaction for Data Exploration on Interactive Whiteboards , 2012, IEEE Transactions on Visualization and Computer Graphics.

[23]  Aniket Kittur,et al.  Kinetica: naturalistic multi-touch data visualization , 2014, CHI.

[24]  Randall Davis,et al.  ChemInk: a natural real-time recognition system for chemical drawings , 2011, IUI '11.