A Thumb Stroke-Based Virtual Keyboard for Sight-Free Text Entry on Touch-Screen Mobile Phones

The use of QWERTY on most of the current mobile devices for text entry usually requires users’ full visual attention and both hands, which is not always possible due to situational or physical impairments of users. Prior research has shown that users prefer to hold and interact with a mobile device with a single hand when possible, which is challenging and poorly supported by current mobile devices. We propose a novel thumbstroke based keyboard called ThumbStroke, which can support both sight-free and one-handed text entry on touch-screen mobile devices. Selecting a character for text entry via ThumbStroke completely relies on the directions of thumb movements at anywhere on a device screen. We evaluated ThumbStroke through a longitudinal lab experiment including 20 sessions with 13 participants. ThumbStroke shows advantages in typing accuracy and user perceptions in comparison to Escape and QWERTY and results in faster typing speed than QWERTY for sight-free text entry.

[1]  Stephen A. Brewster,et al.  The effects of walking speed on target acquisition on a touchscreen interface , 2011, Mobile HCI.

[2]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[3]  Jacob O. Wobbrock,et al.  Measures of Text Entry Performance , 2007 .

[4]  Gennaro Costagliola,et al.  Interpretation of strokes in radial menus: The case of the KeyScretch text entry method , 2013, J. Vis. Lang. Comput..

[5]  I. Scott MacKenzie,et al.  SAK: Scanning ambiguous keyboard for efficient one-key text entry , 2010, TCHI.

[6]  Per Ola Kristensson,et al.  Complementing text entry evaluations with a composition task , 2014, TCHI.

[7]  Koji Yatani,et al.  Escape-Keyboard: A Sight-Free One-Handed Text Entry Method for Mobile Touch-screen Devices , 2013, Int. J. Mob. Hum. Comput. Interact..

[8]  Kent Lyons,et al.  Experimental Evaluations of the Twiddler One-Handed Chording Mobile Keyboard , 2006, Hum. Comput. Interact..

[9]  Kwangtaek Kim,et al.  Typing performance evaluation with multimodal soft keyboard completely integrated in commercial mobile devices , 2015, Journal on Multimodal User Interfaces.

[10]  Gregory D. Abowd,et al.  Cirrin: a word-level unistroke keyboard for pen input , 1998, UIST '98.

[11]  Gregory D. Abowd,et al.  No-Look Notes: Accessible Eyes-Free Multi-touch Text Entry , 2010, Pervasive.

[12]  Brad A. Myers,et al.  Analyzing the input stream for character- level errors in unconstrained text entry evaluations , 2006, TCHI.

[13]  Benjamin B. Bederson,et al.  ThumbSpace: Generalized One-Handed Input for Touchscreen-Based Mobile Devices , 2007, INTERACT.

[14]  I. Scott MacKenzie,et al.  Half-QWERTY: a one-handed keyboard facilitating skill transfer from QWERTY , 1993, INTERCHI.

[15]  Shumin Zhai,et al.  Touch behavior with different postures on soft smartphone keyboards , 2012, Mobile HCI.

[16]  William Buxton,et al.  The limits of expert performance using hierarchic marking menus , 1993, INTERCHI.

[17]  Dongsong Zhang,et al.  A study of direction's impact on single-handed thumb interaction with touch-screen mobile phones , 2014, CHI Extended Abstracts.

[18]  Jan Krüger,et al.  A reduced QWERTY keyboard for mobile text entry , 2004, CHI EA '04.

[19]  I. Scott MacKenzie,et al.  Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric , 2003, CHI '03.

[20]  Siddhartha Nambiar,et al.  BrailleKey: An alternative Braille text input system: Comparative study of an innovative simplified text input system for the visually impaired , 2012, 2012 4th International Conference on Intelligent Human Computer Interaction (IHCI).

[21]  Jukka Holm,et al.  Utilizing Sound Effects in Mobile User Interface Design , 2007, INTERACT.

[22]  Cristian Bernareggi,et al.  TypeInBraille: a braille-based typing application for touchscreen devices , 2011, ASSETS.

[23]  Ken Perlin,et al.  Quikwriting: continuous stylus-based text entry , 1998, UIST '98.

[24]  Sung H. Han,et al.  One-handed thumb interaction of mobile devices from the input accuracy perspective , 2010 .

[25]  Xiang 'Anthony' Chen,et al.  The fat thumb: using the thumb's contact size for single-handed mobile interaction , 2012, Mobile HCI.

[26]  Joaquim A. Jorge,et al.  BrailleType: Unleashing Braille over Touch Screen Mobile Phones , 2011, INTERACT.

[27]  Barbara Millet,et al.  Design and Evaluation of Three Alternative Keyboard Layouts for a Five-Key Text Entry Technique , 2009 .

[28]  Vittorio Fuccella,et al.  Virtual Stick in Caret Positioning on Touch Screens , 2013, IHM.

[29]  Gregory D. Abowd,et al.  An evaluation of BrailleTouch: mobile touchscreen text entry for the visually impaired , 2012, Mobile HCI.

[30]  Stephen A. Brewster,et al.  Multimodal 'eyes-free' interaction techniques for wearable devices , 2003, CHI '03.

[31]  Ni Lar Thein,et al.  Design and Evaluation of Android Slide Kyeboard for Myanmar Language , 2012 .

[32]  I. Scott MacKenzie,et al.  Text Entry for Mobile Computing: Models and Methods,Theory and Practice , 2002, Hum. Comput. Interact..

[33]  Stéphane Huot,et al.  TapTap and MagStick: improving one-handed target acquisition on small touch-screens , 2008, AVI '08.

[34]  Takao Nakagawa,et al.  Usability Evaluation for Software Keyboard on High-Performance Mobile Devices , 2011, HCI.

[35]  Stephen A. Brewster,et al.  Overcoming the Lack of Screen Space on Mobile Computers , 2002, Personal and Ubiquitous Computing.

[36]  Shumin Zhai,et al.  The word-gesture keyboard: reimagining keyboard interaction , 2012, CACM.

[37]  Ravin Balakrishnan,et al.  Simple vs. compound mark hierarchical marking menus , 2004, UIST '04.

[38]  I. Scott MacKenzie,et al.  Phrase sets for evaluating text entry techniques , 2003, CHI Extended Abstracts.

[39]  Hussain Tinwala,et al.  Eyes-free text entry on a touchscreen phone , 2009, 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH).

[40]  Shumin Zhai,et al.  Shapewriter on the iphone: from the laboratory to the real world , 2009, CHI Extended Abstracts.

[41]  Dongsong Zhang,et al.  ExtendedThumb: A Target Acquisition Approach for One-Handed Interaction With Touch-Screen Mobile Phones , 2015, IEEE Transactions on Human-Machine Systems.

[42]  I. Scott MacKenzie,et al.  Recent developments in text-entry error rate measurement , 2004, CHI EA '04.