Scribble query: fluid touch brushing for multivariate data visualization

The wide availability of touch-enabled devices is a unique opportunity for visualization research to invent novel techniques to fluently explore, analyse, and understand complex and large-scale data. In this paper, we introduce Scribble Query, a novel interaction technique for fluid freehand scribbling (casual drawing) on touch-enabled devices to support interactive querying in data visualizations. Inspired by the low-entry yet rich interaction of touch drawing applications, a Scribble Query can be created with a single touch stroke yet have the expressiveness of multiple brushes (a conventionally used interaction technique). We have applied the Scribble Query interaction technique in a multivariate visualization tool, deployed the tool with domain experts from five different domains, and conducted deployment studies with these domain experts on their utilization of multivariate visualization with Scribble Query. The studies suggest that Scribble Query has a low entry barrier facilitating easy adoption, casual and infrequent usage, and in one case, enabled live dissemination of findings by the domain expert to managers in the organization.

[1]  Michael C. Bartha,et al.  Shape Writing on Tablets: Better Performance or Better Experience? , 2012 .

[2]  Michel Beaudouin-Lafon,et al.  Instrumental interaction: an interaction model for designing post-WIMP user interfaces , 2000, CHI.

[3]  Bongshin Lee,et al.  SketchStory: Telling More Engaging Stories with Data through Freeform Sketching , 2013, IEEE Transactions on Visualization and Computer Graphics.

[4]  Shumin Zhai,et al.  Foundations for designing and evaluating user interfaces based on the crossing paradigm , 2010, TCHI.

[5]  Niklas Elmqvist,et al.  ExPlates: Spatializing Interactive Analysis to Scaffold Visual Exploration , 2013, Comput. Graph. Forum.

[6]  Feng Wang,et al.  Empirical evaluation for finger input properties in multi-touch interaction , 2009, CHI.

[7]  Pierre Dragicevic,et al.  Rolling the Dice: Multidimensional Visual Exploration using Scatterplot Matrix Navigation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[8]  Ben Shneiderman,et al.  Dynamic query tools for time series data sets: timebox widgets for interactive exploration , 2004 .

[9]  Christopher Collins,et al.  DimpVis: Exploring Time-varying Information Visualizations by Direct Manipulation , 2014, IEEE Transactions on Visualization and Computer Graphics.

[10]  Niklas Elmqvist,et al.  DataMeadow: A Visual Canvas for Analysis of Large-Scale Multivariate Data , 2007 .

[11]  Moira C. Norrie,et al.  jQMultiTouch: lightweight toolkit and development framework for multi-touch/multi-device web interfaces , 2012, EICS '12.

[12]  Kaj Grønbæk,et al.  PivotViz: Interactive Visual Analysis of Multidimensional Library Transaction Data , 2015, JCDL.

[13]  Anastasia Bezerianos,et al.  SketchSliders: Sketching Widgets for Visual Exploration on Wall Displays , 2015, CHI.

[14]  Robert Xiao,et al.  TouchTools: leveraging familiarity and skill with physical tools to augment touch interaction , 2014, CHI.

[15]  John T. Stasko,et al.  Designing and implementing an interactive scatterplot visualization for a tablet computer , 2014, AVI.

[16]  Jeffrey Heer,et al.  D³ Data-Driven Documents , 2011, IEEE Transactions on Visualization and Computer Graphics.

[17]  Niklas Elmqvist,et al.  Fluid interaction for information visualization , 2011, Inf. Vis..

[18]  Donald A. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[19]  Alfred Inselberg,et al.  Multidimensional detective , 1997, Proceedings of VIZ '97: Visualization Conference, Information Visualization Symposium and Parallel Rendering Symposium.

[20]  Steven K. Feiner,et al.  Relaxed selection techniques for querying time-series graphs , 2009, UIST '09.

[21]  M. Sheelagh T. Carpendale,et al.  Data analysis on interactive whiteboards through sketch-based interaction , 2011, ITS '11.

[22]  Emanuel Zgraggen,et al.  Evaluating Subjective Accuracy in Time Series Pattern-Matching Using Human-Annotated Rankings , 2015, IUI.

[23]  Aniket Kittur,et al.  Kinetica: naturalistic multi-touch data visualization , 2014, CHI.

[24]  William O. Chao.  NapkinVis: Rapid Pen-Centric Authoring of Improvisational Visualizations , 2009 .

[25]  Charles Perin,et al.  Crossets: manipulating multiple sliders by crossing , 2015, Graphics Interface.

[26]  M. Sheelagh T. Carpendale,et al.  TouchWave: kinetic multi-touch manipulation for hierarchical stacked graphs , 2012, ITS.

[27]  Monica M. C. Schraefel,et al.  TouchViz: a case study comparing two interfaces for data analytics on tablets , 2013, CHI.

[28]  J.C. Roberts,et al.  State of the Art: Coordinated & Multiple Views in Exploratory Visualization , 2007, Fifth International Conference on Coordinated and Multiple Views in Exploratory Visualization (CMV 2007).

[29]  Helwig Hauser,et al.  Parallel Sets: interactive exploration and visual analysis of categorical data , 2006, IEEE Transactions on Visualization and Computer Graphics.

[30]  M. Sheelagh T. Carpendale,et al.  Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions , 2012, IEEE Transactions on Visualization and Computer Graphics.

[31]  Bongshin Lee,et al.  GraphTrail: analyzing large multivariate, heterogeneous networks while supporting exploration history , 2012, CHI.

[32]  M. Sheelagh T. Carpendale,et al.  SketchInsight: Natural data exploration on interactive whiteboards leveraging pen and touch interaction , 2015, 2015 IEEE Pacific Visualization Symposium (PacificVis).

[33]  Robert Kosara.  Indirect multi-touch interaction for brushing in parallel coordinates , 2011, Electronic Imaging.

[34]  Jeffrey Heer,et al.  SpanningAspectRatioBank Easing FunctionS ArrayIn ColorIn Date Interpolator MatrixInterpola NumObjecPointI Rectang ISchedu Parallel Pause Scheduler Sequen Transition Transitioner Transiti Tween Co DelimGraphMLCon IData JSONCon DataField DataSc Dat DataSource Data DataUtil DirtySprite LineS RectSprite , 2011 .

[35]  Richard A. Becker,et al.  Brushing scatterplots , 1987 .

[36]  Shigeru Makino,et al.  QueryLines: approximate query for visual browsing , 2005, CHI 2005.

[37]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[38]  Donald A. Norman,et al.  User Centered System Design , 1986 .

[39]  M. Sheelagh T. Carpendale,et al.  A set of multi-touch graph interaction techniques , 2010, ITS '10.

[40]  Ben Shneiderman,et al.  Dynamic Query Tools for Time Series Data Sets: Timebox Widgets for Interactive Exploration , 2004, Inf. Vis..

[41]  HeerJeffrey,et al.  D3 Data-Driven Documents , 2011 .

[42]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[43]  Tobias Isenberg,et al.  Integrating 2D mouse emulation with 3D manipulation for visualizations on a multi-touch table , 2010, ITS '10.

[44]  Jan Gulliksen,et al.  User-centered System Design , 2011 .

[45]  Roberto Therón.  Visual Analytics of Paleoceanographic Conditions , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[46]  H. Theisel,et al.  ExPlates: Spatializing Interactive Analysis to Scaffold Visual Exploration , 2013, Comput. Graph. Forum.

[47]  Pierre Dragicevic,et al.  An Interaction Model for Visualizations Beyond The Desktop , 2013, IEEE Transactions on Visualization and Computer Graphics.

[48]  Martin Wattenberg,et al.  Sketching a graph to query a time-series database , 2001, CHI Extended Abstracts.