Fingers and Angles

Smartwatches present a unique touch input context: small, fixed to one wrist and approachable from a limited range of angles by the touching hand. Techniques to expand their input expressivity often involve variations in how a watch must be touched, such as with different fingers, poses or from specific angles. While objective performance with such systems is commonly reported, subjective qualities such as comfort remain overlooked. We argue that techniques that involve uncomfortable input will be of limited value and contribute the first data on the comfort of input on smartwatches via two studies that combine subjective ratings of comfort with objective performance data. We examine both static and dynamic touches and three finger poses. Based on the study results, we contribute a set of design recommendations for comfortable, effective smartwatch input. We close by instantiating the recommendations in interface prototypes that we evaluate in a final qualitative study.

[1]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[2]  Antti Oulasvirta,et al.  Performance and Ergonomics of Touch Surfaces: A Comparative Study using Biomechanical Simulation , 2015, CHI.

[3]  Jonna Häkkilä,et al.  Exploring finger specific touch screen interaction for mobile phone user interfaces , 2014, OZCHI.

[4]  Niels Henze,et al.  Fingers' Range and Comfortable Area for One-Handed Smartphone Interaction Beyond the Touchscreen , 2018, CHI.

[5]  Hui-Shyong Yeo,et al.  WatchMI: applications of watch movement input on unmodified smartwatches , 2016, MobileHCI Adjunct.

[6]  Xiang Cao,et al.  Detecting and leveraging finger orientation for interaction with direct-touch surfaces , 2009, UIST '09.

[7]  Patrick Olivier,et al.  Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor , 2012, UIST.

[8]  Per Ola Kristensson,et al.  Multi-touch rotation gestures: performance and ergonomics , 2013, CHI.

[9]  Yvonne Rogers,et al.  Fat Finger Worries: How Older and Younger Users Physically Interact with PDAs , 2005, INTERACT.

[10]  Ian Oakley,et al.  The Flat Finger: Exploring Area Touches on Smartwatches , 2016, CHI.

[11]  Gierad Laput,et al.  Expanding the input expressivity of smartwatches with mechanical pan, twist, tilt and click , 2014, CHI.

[12]  Jan O. Borchers,et al.  Knobology Revisited: A Comparison of User Performance between Tangible and Virtual Rotary Knobs , 2015, ITS.

[13]  J. Evans Straightforward Statistics for the Behavioral Sciences , 1995 .

[14]  Xiang 'Anthony' Chen,et al.  Skin buttons: cheap, small, low-powered and clickable fixed-icon laser projectors , 2014, UIST.

[15]  G. Norman Likert scales, levels of measurement and the “laws” of statistics , 2010, Advances in health sciences education : theory and practice.

[16]  Xiang 'Anthony' Chen,et al.  Duet: exploring joint interactions on a smart phone and a smart watch , 2014, CHI.

[17]  Ian Oakley,et al.  TriTap: Identifying Finger Touches on Smartwatches , 2017, CHI.

[18]  G. Borg Psychophysical bases of perceived exertion. , 1982, Medicine and science in sports and exercise.

[19]  Jian Zhao,et al.  Exploring and modeling unimanual object manipulation on multi-touch displays , 2015, Int. J. Hum. Comput. Stud..

[20]  Niels Henze,et al.  Understanding the ergonomic constraints in designing for touch surfaces , 2017, MobileHCI.

[21]  Antti Oulasvirta,et al.  Investigating the Dexterity of Multi-Finger Input for Mid-Air Text Entry , 2015, CHI.

[22]  I. Scott MacKenzie,et al.  Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI , 2004, Int. J. Hum. Comput. Stud..

[23]  Eric Lecolinet,et al.  MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb , 2009, CHI.

[24]  Ian Oakley,et al.  Beats: Tapping Gestures for Smart Watches , 2015, CHI.

[25]  Buntarou Shizuki,et al.  B2B-Swipe: Swipe Gesture for Rectangular Smartwatches from a Bezel to a Bezel , 2016, CHI.

[26]  Yuanchun Shi,et al.  Float: One-Handed and Touch-Free Target Selection on Smartwatches , 2017, CHI.

[27]  Alireza Sahami Shirazi,et al.  Text Entry on Tiny QWERTY Soft Keyboards , 2015, CHI.

[28]  Carl Gutwin,et al.  Faster Command Selection on Touchscreen Watches , 2016, CHI.

[29]  Anind K. Dey,et al.  Serendipity: Finger Gesture Recognition using an Off-the-Shelf Smartwatch , 2016, CHI.

[30]  Ravin Balakrishnan,et al.  DualKey: Miniature Screen Text Entry via Finger Identification , 2016, CHI.

[31]  Xiang 'Anthony' Chen,et al.  The fat thumb: using the thumb's contact size for single-handed mobile interaction , 2012, Mobile HCI.

[32]  Pourang Irani,et al.  D-SWIME: A Design Space for Smartwatch Interaction Techniques Supporting Mobility and Encumbrance , 2018, CHI.

[33]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[34]  Hans-Werner Gellersen,et al.  Orbits: Gaze Interaction for Smart Watches using Smooth Pursuit Eye Movements , 2015, UIST.

[35]  Enrico Rukzio,et al.  The effects of mobility, encumbrance, and (non-)dominant hand on interaction with smartwatches , 2017, SEMWEB.

[36]  Simon Rogers,et al.  AnglePose: robust, precise capacitive touch tracking via 3d orientation estimation , 2011, CHI.

[37]  Robert Xiao,et al.  Estimating 3D Finger Angle on Commodity Touchscreens , 2015, ITS.

[38]  Michael Kipp,et al.  Orientation matters: efficiency of translation-rotation multitouch tasks , 2014, CHI.

[39]  Xiang 'Anthony' Chen,et al.  WrisText: One-handed Text Entry on Smartwatch using Wrist Gestures , 2018, CHI.

[40]  Senaka Buthpitiya,et al.  Bodyprint: Biometric User Identification on Mobile Devices Using the Capacitive Touchscreen to Scan Body Parts , 2015, CHI.

[41]  Niels Henze,et al.  Designing finger orientation input for mobile touchscreens , 2018, MobileHCI.

[42]  Niels Henze,et al.  Estimating the Finger Orientation on Capacitive Touchscreens Using Convolutional Neural Networks , 2017, ISS.

[43]  M. Sheelagh T. Carpendale,et al.  Rotation and translation mechanisms for tabletop interaction , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[44]  Antonio Krüger,et al.  Same-side Hand Interactions with Arm-placed Devices Using EMG , 2015, CHI Extended Abstracts.

[45]  Niels Henze,et al.  A smartphone prototype for touch interaction on the whole device surface , 2017, MobileHCI.