Combining Tablets with Smartphones for Data Analytics

While ubiquitous data analytics is a promising approach, analyzing spreadsheets data on tablets is a tedious task due to the limited display size and touch vocabulary. In this paper, we present the design and evaluation of novel interaction techniques relying on the combination of a tablet, holding the data, and a smartphone, used as a mediator between the user and the tablet. To this end, we propose to use stacking gestures, i.e. laying one edge of a smartphone on the tablet screen. Stacking is a cheap, easy to implement and effective way of employing always-available smartphones to improve data analysis on tablets, by augmenting the input vocabulary and extending the display surface. We first explore stacking gestures to delimitate the possible interaction vocabulary and present the manufacturing of a conductive smartphone case. Then, we propose novel stacking-based techniques to perform spreadsheet data analysis, i.e. pivot table creation and manipulation. We evaluate our stacking techniques against touch interaction as provided by current mobile spreadsheet apps. Our studies reveal that some of our interaction techniques perform 30% faster than touch for creating pivot tables.

[1]  Tobias Isenberg,et al.  Lightweight Relief Shearing for Enhanced Terrain Perception on Interactive Maps , 2015, CHI.

[2]  Bongshin Lee,et al.  Facilitating Spreadsheet Manipulation on Mobile Devices Leveraging Speech , 2018 .

[3]  Kanit Wongsuphasawat,et al.  Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations , 2016, IEEE Transactions on Visualization and Computer Graphics.

[4]  Niklas Elmqvist,et al.  When David Meets Goliath: Combining Smartwatches with a Large Vertical Display for Visual Data Exploration , 2018, CHI.

[5]  Morten Fjeld,et al.  Holy smartphones and tablets, Batman!: mobile interaction's dynamic duo , 2013, APCHI.

[6]  Geehyuk Lee,et al.  Expanding touch input vocabulary by using consecutive distant taps , 2014, CHI.

[7]  Stefanie Müller,et al.  CapStones and ZebraWidgets: sensing stacks of building blocks, dials and sliders on capacitive touch screens , 2012, CHI.

[8]  Michael Alexander,et al.  Pivot Table Data Crunching: Microsoft Excel 2010 , 2010 .

[9]  Dominik Schmidt,et al.  PhoneTouch: a technique for direct phone interaction on surfaces , 2010, UIST '10.

[10]  Pourang Irani,et al.  Ad-binning: leveraging around device space for storing, browsing and retrieving mobile device content , 2013, CHI.

[11]  Dominik Schmidt,et al.  A cross-device interaction style for mobiles and surfaces , 2012, DIS '12.

[12]  Marcos Serrano,et al.  Investigating the effects of splitting detailed views in Overview+Detail interfaces , 2016, MobileHCI.

[13]  Carl Gutwin,et al.  Rapid Command Selection on Multi-Touch Tablets with Single-Handed HandMark Menus , 2016, ISS.

[14]  Niklas Elmqvist,et al.  Ubiquitous Analytics: Interacting with Big Data Anywhere, Anytime , 2013, Computer.

[15]  Hiroshi Ishii,et al.  THAW: Tangible Interaction with See-Through Augmentation for Smartphones on Computer Screens , 2015, TEI.

[16]  Daniel Vogel,et al.  Adoiraccourcix: multi-touch command selection using finger identification , 2014, IHM.

[17]  Daniel J. Wigdor,et al.  A field study of multi-device workflows in distributed workspaces , 2013, UbiComp.

[18]  Beryl Plimmer,et al.  CapTUI: Geometric Drawing with Tangibles on a Capacitive Multi-touch Display , 2013, INTERACT.

[19]  Ted Selker,et al.  Multi-finger chords for hand-held tablets: recognizable and memorable , 2014, CHI.

[20]  Ricardo Langner,et al.  VisTiles: Coordinating and Combining Co-located Mobile Devices for Visual Data Exploration , 2018, IEEE Transactions on Visualization and Computer Graphics.

[21]  Martin Krzywinski,et al.  Points of Significance: Error bars , 2013, Nature Methods.

[22]  Sungjae Hwang,et al.  MagGetz: customizable passive tangible controllers on and around conventional mobile devices , 2013, UIST.

[23]  Koji Yatani,et al.  Design of unimanual multi-finger pie menu interaction , 2011, ITS '11.

[24]  Nicholas Chen,et al.  Graduate student use of a multi-slate reading system , 2013, CHI.

[25]  Geehyuk Lee,et al.  MelodicTap: fingering hotkey for touch tablets , 2016, OZCHI.

[26]  Patrick Baudisch,et al.  My new PC is a mobile phone , 2010, XRDS.

[27]  Ming Li,et al.  ACTUI: Using Commodity Mobile Devices to Build Active Tangible User Interfaces , 2015, MobileHCI Adjunct.

[28]  Bongshin Lee,et al.  TouchPivot: Blending WIMP & Post-WIMP Interfaces for Data Exploration on Tablet Devices , 2017, CHI.

[29]  Xiang 'Anthony' Chen,et al.  Duet: exploring joint interactions on a smart phone and a smart watch , 2014, CHI.

[30]  Morten Fjeld,et al.  RAMPARTS: Supporting Sensemaking with Spatially-Aware Mobile Interactions , 2016, CHI.

[31]  William Buxton,et al.  Thumb + Pen Interaction on Tablets , 2017, CHI.

[32]  Yvonne Rogers,et al.  CurationSpace: Cross-Device Content Curation Using Instrumental Interaction , 2016, ISS.

[33]  Daniel J. Wigdor,et al.  Conductor: enabling and understanding cross-device interaction , 2014, CHI.

[34]  Morten Fjeld,et al.  Thaddeus: a dual device interaction space for exploring information visualisation , 2014, NordiCHI.