Float: One-Handed and Touch-Free Target Selection on Smartwatches

Touch interaction on smartwatches suffers from the awkwardness of having to use two hands and the "fat finger" problem. We present Float, a wrist-to-finger input approach that enables one-handed and touch-free target selection on smartwatches with high efficiency and precision using only commercially-available built-in sensors. With Float, a user tilts the wrist to point and performs an in-air finger tap to click. To realize Float, we first explore the appropriate motion space for wrist tilt and determine the clicking action (finger tap) through a user-elicitation study. We combine the photoplethysmogram (PPG) signal with accelerometer and gyroscope to detect finger taps with a recall of 97.9% and a false discovery rate of 0.4%. Experiments show that using just one hand, Float allows users to acquire targets with size ranging from 2mm to 10mm in less than 2s to 1s, meanwhile achieve much higher accuracy than direct touch in both stationary (>98.9%) and walking (>71.5%) contexts.

[1]  Teddy Seyed,et al.  User Elicitation on Single-hand Microgestures , 2016, CHI.

[2]  Carl Gutwin,et al.  Faster Command Selection on Touchscreen Watches , 2016, CHI.

[3]  Jun Gong,et al.  WristWhirl: One-handed Continuous Smartwatch Input using Wrist Gestures , 2016, UIST.

[4]  Sriram Subramanian,et al.  GesText: accelerometer-based gestural text-entry systems , 2010, CHI.

[5]  Tek-Jin Nam,et al.  M.Gesture: An Acceleration-Based Gesture Authoring System on Multiple Handheld and Wearable Devices , 2016, CHI.

[6]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[7]  Ian Oakley,et al.  Tilt to scroll: evaluating a motion based vibrotactile mobile interface , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[8]  Stéphane Huot,et al.  TapTap and MagStick: improving one-handed target acquisition on small touch-screens , 2008, AVI '08.

[9]  Ian Oakley,et al.  Beats: Tapping Gestures for Smart Watches , 2015, CHI.

[10]  Shahram Izadi,et al.  SideSight: multi-"touch" interaction around small devices , 2008, UIST '08.

[11]  Gierad Laput,et al.  Expanding the input expressivity of smartwatches with mechanical pan, twist, tilt and click , 2014, CHI.

[12]  Shumin Zhai,et al.  High precision touch screen interaction , 2003, CHI '03.

[13]  Sebastian Günther,et al.  ProxiWatch: Enhancing Smartwatch Interaction through Proximity-based Hand Input , 2016, CHI Extended Abstracts.

[14]  Michita Imai,et al.  SkinWatch: skin gesture interaction for smart watch , 2015, AH.

[15]  Anind K. Dey,et al.  Serendipity: Finger Gesture Recognition using an Off-the-Shelf Smartwatch , 2016, CHI.

[16]  Robert J. Teather,et al.  FittsTilt: the application of Fitts' law to tilt-based interaction , 2012, NordiCHI.

[17]  Anna Ostberg,et al.  Hover Cursor: Improving Touchscreen Acquisition Of Small Targets With Hover-enabled Pre-selection , 2015, CHI Extended Abstracts.

[18]  Chris Harrison,et al.  Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices , 2009, UIST '09.

[19]  Hui Ding,et al.  Querying and mining of time series data: experimental comparison of representations and distance measures , 2008, Proc. VLDB Endow..

[20]  Kent Lyons,et al.  An investigation into round touchscreen wristwatch interaction , 2008, Mobile HCI.

[21]  Daniel Vogel,et al.  Shift: a technique for operating pen-based interfaces using touch , 2007, CHI.

[22]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[23]  Amy Ogan,et al.  ZoomBoard: a diminutive qwerty soft keyboard using iterative zooming for ultra-small devices , 2013, CHI.

[24]  Wei Xiong,et al.  Investigating Effects of Post-Selection Feedback for Acquiring Ultra-Small Targets on Touchscreen , 2016, CHI.

[25]  Stephen A. Brewster,et al.  Wrist rotation for interaction in mobile contexts , 2008, Mobile HCI.

[26]  Lars Weberg,et al.  A piece of butter on the PDA display , 2001, CHI Extended Abstracts.

[27]  Robert J. Teather,et al.  Position vs. velocity control for tilt-based interaction , 2014, Graphics Interface.

[28]  Kent Lyons,et al.  The Gesture Watch: A Wireless Contact-free Gesture based Wrist Interface , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[29]  B. Shneiderman,et al.  Improving the accuracy of touch screens: an experimental evaluation of three strategies , 1988, CHI '88.

[30]  Patrick Baudisch,et al.  Back-of-device interaction allows creating very small touch devices , 2009, CHI.

[31]  Gierad Laput,et al.  SkinTrack: Using the Body as an Electrical Waveguide for Continuous Finger Tracking on the Skin , 2016, CHI.

[32]  Da-Yuan Huang,et al.  DigitSpace: Designing Thumb-to-Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions , 2016, CHI.

[33]  Sean Gustafson,et al.  PinchWatch: A Wearable Device for One-Handed Microinteractions , 2010 .

[34]  Ian Oakley,et al.  Interaction on the edge: offset sensing for small devices , 2014, CHI.

[35]  Jun Rekimoto,et al.  Tilting operations for small screen interfaces , 1996, UIST '96.

[36]  Patrick Baudisch,et al.  Lucid touch: a see-through mobile device , 2007, UIST.

[37]  Buntarou Shizuki,et al.  Investigating Accuracy of Tilting Operation on Wrist-worn Devices with Touchscreens , 2016, CHI Extended Abstracts.

[38]  Tovi Grossman,et al.  NanoStylus: Enhancing Input on Ultra-Small Displays with a Finger-Mounted Stylus , 2015, UIST.

[39]  Vibha Sazawal,et al.  TiltType: accelerometer-supported text entry for very small devices , 2002, UIST '02.

[40]  Shumin Zhai,et al.  FFitts law: modeling finger touch with fitts' law , 2013, CHI.

[41]  Joseph A. Paradiso,et al.  WristFlex: low-power gesture input with wrist-worn pressure sensors , 2014, UIST.

[42]  Tim Paek,et al.  Exploring tilt for no-touch, wrist-only interactions on smartwatches , 2016, MobileHCI.

[43]  Xiang 'Anthony' Chen,et al.  Skin buttons: cheap, small, low-powered and clickable fixed-icon laser projectors , 2014, UIST.

[44]  Jun Rekimoto,et al.  GestureWrist and GesturePad: unobtrusive wearable interaction devices , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[45]  Daniel J. Wigdor,et al.  TiltText: using tilt for text input to mobile phones , 2003, UIST '03.

[46]  Christina Boucher,et al.  Exploring Non-touchscreen Gestures for Smartwatches , 2016, CHI.

[47]  Roderick Murray-Smith,et al.  Variability in Wrist-Tilt Accelerometer Based Gesture Interfaces , 2004, Mobile HCI.

[48]  Jinwook Seo,et al.  Understanding Users' Touch Behavior on Large Mobile Touch-Screens and Assisted Targeting by Tilting Gesture , 2015, CHI.