TEXTile: Eyes-Free Text Input on Smart Glasses Using Touch Enabled Textile on the Forearm

Smart glasses are autonomous and efficient computers that can perform complex tasks through mobile applications. This paper focuses on text input for mobile context. We present a new connected fabric to smart glasses as a device for text entry. This device, integrated into clothing, provides a new interaction technique called TEXTile. It allows typing without requiring users to hold a device. Users can put fingers anywhere on the fabric surface and release them, without needing to look at the fabric or using markers on the fabric. The text entry technique is based on eight combinations of fingers in contact or released, identified as pleasant among 15 in a survey involving 74 participants. A first user’s study with 20 participants establishes that the eight combinations for TEXTile were significantly reliable (98.95% recognition rate). A second study with nine participants evaluates the learning curve of TEXTile. Users achieved a mean typing of 8.11 WPM at the end of ten 12-min sessions, which can be slow, but sufficient with short text compared to other advantages of the technique. Results show low error rates for tasks completed and good usability (76% in SUS questionnaire). The NASA-TLX questionnaire establishes there is no important mental or physical workload to accomplish the task.

[1]  I. Scott MacKenzie,et al.  1 thumb, 4 buttons, 20 words per minute: design and evaluation of H4-writer , 2011, UIST.

[2]  Da-Yuan Huang,et al.  DigitSpace: Designing Thumb-to-Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions , 2016, CHI.

[3]  Falko Kuester,et al.  Towards keyboard independent touch typing in VR , 2005, VRST '05.

[4]  Xiang 'Anthony' Chen,et al.  Typing on Glasses: Adapting Text Entry to Smart Eyewear , 2015, MobileHCI.

[5]  Qun Li,et al.  GlassGesture: Exploring head gesture interface of smart glasses , 2016, 2016 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[6]  Geehyuk Lee,et al.  Typing on a Smartwatch for Smart Glasses , 2017, ISS.

[7]  Beat Signer,et al.  SpeeG: a multimodal speech- and gesture-based text input solution , 2012, AVI.

[8]  Klaus H. Hinrichs,et al.  DigiTap: an eyes-free VR/AR symbolic input device , 2014, VRST '14.

[9]  Pourang Irani,et al.  ThumbText: Text Entry for Wearable Devices Using a Miniature Ring , 2018, Graphics Interface.

[10]  Pourang Irani,et al.  Consumed endurance: a metric to quantify arm fatigue of mid-air interactions , 2014, CHI.

[11]  Ivan Poupyrev,et al.  Project Jacquard: Interactive Digital Textiles at Scale , 2016, CHI.

[12]  Richard E. Ladner,et al.  Input finger detection for nonvisual touch screen text entry in Perkinput , 2012, Graphics Interface.

[13]  Xincheng Li,et al.  One-Dimensional Handwriting: Inputting Letters and Words on Smart Glasses , 2016, CHI.

[14]  Antti Jylhä,et al.  Designing a Willing-to-Use-in-Public Hand Gestural Interaction Technique for Smart Glasses , 2016, CHI.

[15]  Brad A. Myers,et al.  EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion , 2003, UIST '03.

[16]  I. Scott MacKenzie,et al.  Huffman Base-4 Text Entry Glove (H4 TEG) , 2012, 2012 16th International Symposium on Wearable Computers.

[17]  Kasper Hornbæk,et al.  zPatch: Hybrid Resistive/Capacitive eTextile Input , 2018, TEI.

[18]  Stephen A. Brewster,et al.  Usable gestures for mobile interfaces: evaluating social acceptability , 2010, CHI.

[19]  Kyu-Han Kim,et al.  TypingRing: A Wearable Ring Platform for Text Input , 2015, MobiSys.

[20]  Ellen Yi-Luen Do,et al.  Don't mind me touching my wrist: a case study of interacting with on-body technology in public , 2013, ISWC '13.

[21]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[22]  Chris Harrison,et al.  PocketTouch: through-fabric capacitive touch input , 2011, UIST '11.

[23]  Ken Perlin,et al.  Quikwriting: continuous stylus-based text entry , 1998, UIST '98.

[24]  Wen-Huang Cheng,et al.  FingerPad: private and subtle interaction using fingertips , 2013, UIST.

[25]  Stefan Schneegaß,et al.  GestureSleeve: using touch sensitive fabrics for gestural input on the forearm for controlling smartwatches , 2016, SEMWEB.

[26]  Tanja Schultz,et al.  Airwriting: Hands-Free Mobile Text Input by Spotting and Continuous Recognition of 3d-Space Handwriting with Inertial Sensors , 2012, 2012 16th International Symposium on Wearable Computers.

[27]  Chris North,et al.  AirStroke: bringing unistroke text entry to freehand gesture interfaces , 2011, CHI.

[28]  Kent Lyons,et al.  Twiddler typing: one-handed chording text entry for mobile phones , 2004, CHI.

[29]  Yuanchun Shi,et al.  Tap, Dwell or Gesture?: Exploring Head-Based Text Entry Techniques for HMDs , 2017, CHI.

[30]  Anthony Dunnigan,et al.  Exploring gestural interaction in smart spaces using head mounted devices with ego-centric sensing , 2014, SUI.

[31]  Saied B. Nesbat A system for fast, full-text entry for small electronic devices , 2003 .

[32]  Xiang 'Anthony' Chen,et al.  Swipeboard: a text entry technique for ultra-small interfaces that supports novice to expert transitions , 2014, UIST.

[33]  Shwetak N. Patel,et al.  DigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-mounted Displays , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[34]  Woohun Lee,et al.  Button Keyboard: A Very Small Keyboard with Universal Usability for Wearable Computing , 2007, INTERACT.

[35]  Paul Lukowicz,et al.  From Smart Clothing to Smart Table Cloth: Design and Implementation of a Large Scale, Textile Pressure Matrix Sensor , 2014, ARCS.

[36]  I. Scott MacKenzie,et al.  Phrase sets for evaluating text entry techniques , 2003, CHI Extended Abstracts.

[37]  Hussain Tinwala,et al.  Eyes-free text entry on a touchscreen phone , 2009, 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH).

[38]  Sriram Subramanian,et al.  GesText: accelerometer-based gestural text-entry systems , 2010, CHI.

[39]  Roope Raisamo,et al.  Device independent text input: a rationale and an example , 2000, AVI '00.

[40]  A. J. Bernheim Brush,et al.  Phoneprioception: enabling mobile phones to infer where they are kept , 2013, CHI.

[41]  Mike Y. Chen,et al.  PalmType: Using Palms as Keyboards for Smart Glasses , 2015, MobileHCI.

[42]  Mario Romero,et al.  BrailleTouch: Mobile Texting for the Visually Impaired , 2011, HCI.

[43]  Thomas Engel,et al.  Text entry on smart glasses , 2015, 2015 8th International Conference on Human System Interaction (HSI).

[44]  Päivi Majaranta,et al.  Effects of feedback on eye typing with a short dwell time , 2004, ETRA.

[45]  Jae Wook Jeon,et al.  Designing a universal keyboard using chording gloves , 2002 .