WristDial: An Eyes-Free Integer-Value Input Method by Quantizing the Wrist Rotation

ABSTRACT Smartwatches are a convenient substitute for smartphones in hand-busy situations, but there is limited interactivity to one-handed use of wrist-worn devices. In this paper, we propose WristDial, a one-handed integer input technique which uses quantization of the angular distance of the wrist rotation with nonvisual feedback. Using tactile feedback, we present four techniques based on counting of tactile stimuli. With one of them, 94.44% average accuracy and 2.81 s average completion time were acquired in the task of entering a number from the range 1 to 10. We also evaluate the quantitative performance of the combination of interruptible speech and non-speech auditory feedback. Our results show that when speech feedback exists, adding a continuous change of pitch or clicking sound at the boundaries does not have a significant effect on the performance. Using only speech feedback, 95.47% accuracy and 1.45 s completion time were acquired.

[1]  Jan B. F. van Erp,et al.  Multisensory temporal numerosity judgment , 2008, Brain Research.

[2]  Li-Wei Chan,et al.  Dwell+: Multi-Level Mode Selection Using Vibrotactile Cues , 2017, UIST.

[3]  Gregory D. Abowd,et al.  FingerPing: Recognizing Fine-grained Hand Poses using Active Acoustic On-body Sensing , 2018, CHI.

[4]  Ian Oakley,et al.  A motion-based marking menu system , 2007, CHI Extended Abstracts.

[5]  Ian Oakley,et al.  Tilt to scroll: evaluating a motion based vibrotactile mobile interface , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[6]  Yuanchun Shi,et al.  Float: One-Handed and Touch-Free Target Selection on Smartwatches , 2017, CHI.

[7]  Buntarou Shizuki,et al.  AudioTouch: Minimally Invasive Sensing of Micro-Gestures via Active Bio-Acoustic Sensing , 2019, MobileHCI.

[8]  Sriram Subramanian,et al.  Tilt techniques: investigating the dexterity of wrist-based input , 2009, CHI.

[9]  Khai N. Truong,et al.  Disambiguation of imprecise input with one-dimensional rotational text entry , 2014, TCHI.

[10]  Tapio Lokki,et al.  A gesture-based and eyes-free control method for mobile devices , 2009, CHI Extended Abstracts.

[11]  LW O'Sullivan,et al.  Forearm torque strengths and discomfort profiles in pronation and supination , 2005, Ergonomics.

[12]  Kyogu Lee,et al.  Exploring Effects of Auditory Feedback on Menu Selection in Hand-Gesture Interfaces , 2015 .

[13]  Rachel Nuwer.  Armband adds a twitch to gesture control , 2013 .

[14]  Desney S. Tan,et al.  Skinput: appropriating the body as an input surface , 2010, CHI.

[15]  Jaehoon Kim,et al.  Effects of Auditory Feedback on Menu Selection in Hand-Gesture Interfaces , 2015, IEEE MultiMedia.

[16]  Rahul Sawhney,et al.  Sonic Grid: an auditory interface for the visually impaired to navigate GUI-based environments , 2008, IUI '08.

[17]  Li-Wei Chan,et al.  CyclopsRing: Enabling Whole-Hand and Context-Aware Interactions Through a Fisheye Ring , 2015, UIST.

[18]  Tim Paek,et al.  Exploring tilt for no-touch, wrist-only interactions on smartwatches , 2016, MobileHCI.

[19]  Desney S. Tan,et al.  Enabling always-available input with muscle-computer interfaces , 2009, UIST '09.

[20]  Stephen A. Brewster,et al.  Wrist rotation for interaction in mobile contexts , 2008, Mobile HCI.

[21]  S. Azen,et al.  Normal range of motion of joints in male subjects. , 1979, The Journal of bone and joint surgery. American volume.

[22]  Leonard O'Sullivan,et al.  Effect on discomfort of frequency of wrist exertions combined with wrist articulations and forearm rotation , 2010 .

[23]  Edin Sabic,et al.  Threshold of Spearcon Recognition for Auditory Menus , 2016 .

[24]  Patrick Olivier,et al.  Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor , 2012, UIST.

[25]  Bruce N. Walker,et al.  Advanced auditory menus: design and evaluation of auditory scroll bars , 2008, Assets '08.

[26]  Stephen A. Brewster,et al.  Multimodal 'eyes-free' interaction techniques for wearable devices , 2003, CHI '03.

[27]  Jun Gong,et al.  WristWhirl: One-handed Continuous Smartwatch Input using Wrist Gestures , 2016, UIST.

[28]  Seungwoo Kang,et al.  Exploring current practices for battery use and management of smartwatches , 2015, SEMWEB.

[29]  Ian Oakley,et al.  Counting clicks and beeps: Exploring numerosity based haptic and audio PIN entry , 2012, Interact. Comput..

[30]  Jérôme Pasquero,et al.  A haptic wristwatch for eyes-free interactions , 2011, CHI.

[31]  Buntarou Shizuki,et al.  Investigating Accuracy of Tilting Operation on Wrist-worn Devices with Touchscreens , 2016, CHI Extended Abstracts.

[32]  Joseph A. Paradiso,et al.  WristFlex: low-power gesture input with wrist-worn pressure sensors , 2014, UIST.

[33]  James A. Landay,et al.  ActiVibe: Design and Evaluation of Vibrations for Progress Monitoring , 2016, CHI.

[34]  Stephen A. Brewster,et al.  Novel Multimodal Feedback Techniques for In-Car Mid-Air Gesture Interaction , 2017, AutomotiveUI.

[35]  Pierre Dragicevic,et al.  Earpod: eyes-free menu selection using touch input and reactive audio feedback , 2007, CHI.

[36]  Chris North,et al.  Design and evaluation of freehand menu selection interfaces using tilt and pinch gestures , 2011, Int. J. Hum. Comput. Stud..

[37]  J. J. Higgins,et al.  The aligned rank transform for nonparametric factorial analyses using only anova procedures , 2011, CHI.

[38]  C J Vierck,et al.  A critical band filter in touch , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  Loren G. Terveen,et al.  The sound of one hand: a wrist-mounted bio-acoustic fingertip gesture interface , 2002, CHI Extended Abstracts.

[40]  Tapio Lokki,et al.  Eyes-free interaction with free-hand gestures and auditory menus , 2012, Int. J. Hum. Comput. Stud..

[41]  Ravin Balakrishnan,et al.  Direct Manipulation in Tactile Displays , 2016, CHI.

[42]  E. Lechelt.  Temporal numerosity discrimination: intermodal comparisons revisited. , 1975, British journal of psychology.