D-SWIME: A Design Space for Smartwatch Interaction Techniques Supporting Mobility and Encumbrance

Smartwatches enable rapid access to information anytime and anywhere. However, current smartwatch content navigation techniques, for panning and zooming, were directly adopted from those used on smartphones. These techniques are cumbersome when performed on small smartwatch screens and have not been evaluated for their support in mobility and encumbrance contexts (when the user's hands are busy). We studied the effect of mobility and encumbrance on common content navigation techniques and found a significant decrease in performance as the pace of mobility increases or when the user was encumbered with busy hands. Based on these initial findings, we proposed a design space which would improve efficiency when navigation techniques, such as panning and zooming, are employed in mobility contexts. Our results reveal that our design space can effectively be used to create novel interaction techniques that improve smartwatch content navigation in mobility and encumbrance contexts.

[1]  Sriram Subramanian,et al.  Multi-flick: an evaluation of flick-based scrolling techniques for pen interfaces , 2008, CHI.

[2]  Ji Jung Lim,et al.  Visual search on a mobile device while walking , 2012, Mobile HCI.

[3]  Buntarou Shizuki,et al.  Evaluation of Callout Design for Ultra-small Touch Screen Devices , 2016, CHI Extended Abstracts.

[4]  Staffan Björk.  Hierarchical flip zooming: enabling parallel exploration of hierarchical visualizations , 2000, AVI '00.

[5]  Eric Lecolinet,et al.  Clutch-free panning and integrated pan-zoom control on touch-sensitive surfaces: the cyclostar approach , 2010, CHI.

[6]  Buntarou Shizuki,et al.  B2B-Swipe: Swipe Gesture for Rectangular Smartwatches from a Bezel to a Bezel , 2016, CHI.

[7]  Buntarou Shizuki,et al.  Watch Commander: A Gesture-based Invocation System for Rectangular Smartwatches using B2B-Swipe , 2016, UIST.

[8]  Xiang 'Anthony' Chen,et al.  The fat thumb: using the thumb's contact size for single-handed mobile interaction , 2012, Mobile HCI.

[9]  Stephen A. Brewster,et al.  Comparing evaluation methods for encumbrance and walking on interaction with touchscreen mobile devices , 2014, MobileHCI '14.

[10]  Stephen A. Brewster,et al.  The Impact of Encumbrance on Mobile Interactions , 2013, INTERACT.

[11]  Alessio Bellino.  Enhancing Pinch-Drag-Flick Paradigm with Two New Gestures: Two-Finger-Tap for Tablets and Tap&Tap for Smartphones , 2015, INTERACT.

[12]  Kori Inkpen Quinn,et al.  Walk 'n scroll: a comparison of software-based navigation techniques for different levels of mobility , 2005, Mobile HCI.

[13]  Stephen A. Brewster,et al.  The Effects of Encumbrance and Mobility on Touch-Based Gesture Interactions for Mobile Phones , 2015, MobileHCI.

[14]  Gierad Laput,et al.  Expanding the input expressivity of smartwatches with mechanical pan, twist, tilt and click , 2014, CHI.

[15]  Pierre Dragicevic,et al.  Earpod: eyes-free menu selection using touch input and reactive audio feedback , 2007, CHI.

[16]  Jacob O. Wobbrock,et al.  Getting off the treadmill: evaluating walking user interfaces for mobile devices in public spaces , 2008, Mobile HCI.

[17]  Jun Rekimoto,et al.  GraspZoom: zooming and scrolling control model for single-handed mobile interaction , 2009, Mobile HCI.

[18]  Daniel Vogel,et al.  Pinch-to-zoom-plus: an enhanced pinch-to-zoom that reduces clutching and panning , 2014, UIST.

[19]  Jesse M. Heines,et al.  Selecting While Walking: An Investigation of Aiming Performance in a Mobile Work Context , 2007, AMCIS.

[20]  Steven K. Feiner,et al.  Rubbing and tapping for precise and rapid selection on touch-screen displays , 2008, CHI.

[21]  Ken Hinckley,et al.  Sensor synaesthesia: touch in motion, and motion in touch , 2011, CHI.

[22]  Sen Wang,et al.  ContextZoom: A Single-Handed Partial Zooming Technique for Touch-Screen Mobile Devices , 2017, Int. J. Hum. Comput. Interact..

[23]  Stephen A. Brewster,et al.  Wrist rotation for interaction in mobile contexts , 2008, Mobile HCI.

[24]  Stephen A. Brewster,et al.  Investigating the effects of encumbrance on one- and two- handed interactions with mobile devices , 2014, CHI.

[25]  Stephen A. Brewster,et al.  Multimodal mobile interactions: usability studies in real world settings , 2011, ICMI '11.

[26]  Tim Paek,et al.  Exploring tilt for no-touch, wrist-only interactions on smartwatches , 2016, MobileHCI.

[27]  Stephen A. Brewster,et al.  Head tilting for interaction in mobile contexts , 2009, Mobile HCI.

[28]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[29]  Kent Lyons,et al.  Reading on-the-go: a comparison of audio and hand-held displays , 2006, Mobile HCI.

[30]  Shuping Yi,et al.  Adapting the Navigation Interface of Smart Watches to User Movements , 2017, Int. J. Hum. Comput. Interact..

[31]  Enrico Rukzio,et al.  Investigating selection and reading performance on a mobile phone while walking , 2010, Mobile HCI.

[32]  Jacob O. Wobbrock,et al.  WalkType: using accelerometer data to accomodate situational impairments in mobile touch screen text entry , 2012, CHI.

[33]  John C. Thomas,et al.  Exploring pinch and spread gestures on mobile devices , 2013, MobileHCI '13.

[34]  Yang Li,et al.  Experimental analysis of touch-screen gesture designs in mobile environments , 2011, CHI.

[35]  Benjamin B. Bederson,et al.  AppLens and launchTile: two designs for one-handed thumb use on small devices , 2005, CHI.

[36]  Yvonne Rogers,et al.  Fat Finger Worries: How Older and Younger Users Physically Interact with PDAs , 2005, INTERACT.

[37]  Alexander Ng.  The effects of encumbrance on mobile interactions , 2014, MobileHCI '14.

[38]  Stephen A. Brewster,et al.  The effects of walking speed on target acquisition on a touchscreen interface , 2011, Mobile HCI.

[39]  Eric Horvitz,et al.  ZoneZoom: map navigation for smartphones with recursive view segmentation , 2004, AVI.

[40]  Andrew Sears,et al.  An empirical comparison of use-in-motion evaluation scenarios for mobile computing devices , 2005, Int. J. Hum. Comput. Stud..

[41]  Jan Stage,et al.  New techniques for usability evaluation of mobile systems , 2004, Int. J. Hum. Comput. Stud..