Freehand gestural text entry for interactive TV

Users increasingly expect more interactive experiences with TV. Combined with the recent development of freehand gestural interaction enabled by inexpensive sensors, interactive television has the potential to offer a highly usable and engaging experience. However, common interaction tasks such as text input are still challenging with such systems. In this paper, we investigate text entry using freehand gestures captured with a low-cost sensor system. Two virtual keyboard layouts and three selection techniques were designed and evaluated. Results show that a text entry method with dual circle layout and an expanding target selection technique offers ease of use and error tolerance, key features if we are to increase the use and enhance the experience of interactive TV in the living room.

[1]  Kellogg S. Booth,et al.  Mid-air text input techniques for very large wall displays , 2009, Graphics Interface.

[2]  Brad A. Myers,et al.  EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion , 2003, UIST '03.

[3]  Ravin Balakrishnan,et al.  Fitts' law and expanding targets: Experimental studies and designs for user interfaces , 2005, TCHI.

[4]  Terry Winograd,et al.  FlowMenu: combining command, text, and data entry , 2000, UIST '00.

[5]  Chris North,et al.  AirStroke: bringing unistroke text entry to freehand gesture interfaces , 2011, CHI.

[6]  Radu-Daniel Vatavu.  Interfaces That Should Feel Right: Natural Interaction with Multimedia Information , 2009 .

[7]  Roope Raisamo,et al.  Quikwriting as a multi-device text entry method , 2004, NordiCHI '04.

[8]  Andrew D. Wilson.  Using a depth camera as a touch sensor , 2010, ITS '10.

[9]  Oleg Spakov,et al.  Fast gaze typing with an adjustable dwell time , 2009, CHI.

[10]  Gang Ren,et al.  3D selection with freehand gesture , 2013, Comput. Graph..

[11]  Donald A. Norman,et al.  Natural user interfaces are not natural , 2010, INTR.

[12]  Koji Yatani,et al.  The 1line keyboard: a QWERTY layout in a single line , 2011, UIST '11.

[13]  Mark D. Dunlop,et al.  QWERTH: an optimized semi-ambiguous keyboard design , 2012, Mobile HCI.

[14]  Sriram Subramanian,et al.  GesText: accelerometer-based gestural text-entry systems , 2010, CHI.

[15]  Alan Wexelblat.  Research Challenges in Gesture: Open Issues and Unsolved Problems , 1997, Gesture Workshop.

[16]  Pavel Slavík,et al.  Comparison of two text entry methods on interactive TV , 2012, EuroITV.

[17]  Debatri Chatterjee,et al.  An Iterative Methodolgy to Improve TV Onscreen Keyboard Layout Design through Evaluation of User Studies , 2012 .

[18]  I. Scott MacKenzie,et al.  Phrase sets for evaluating text entry techniques , 2003, CHI Extended Abstracts.

[19]  Shumin Zhai,et al.  Interlaced QWERTY: accommodating ease of visual search and input flexibility in shape writing , 2008, CHI.

[20]  Jochen Rick,et al.  Performance optimizations of virtual keyboards for stroke-based text entry on a touch-based tabletop , 2010, UIST.

[21]  mc schraefel,et al.  A Taxonomy of Gestures in Human Computer Interactions , 2005 .

[22]  Robert J. Teather,et al.  Assessing the Effects of Orientation and Device on (Constrained) 3D Movement Techniques , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[23]  Radu-Daniel Vatavu,et al.  User-defined gestures for free-hand TV control , 2012, EuroITV.

[24]  Harald Reiterer,et al.  Natural User Interfaces : Why We Need Better Model-Worlds, Not Better Gestures , 2010, CHI 2010.

[25]  Shumin Zhai,et al.  More than dotting the i's --- foundations for crossing-based interfaces , 2002, CHI.

[26]  Ryosuke Aoki,et al.  A gesture recognition algorithm for vision-based unicursal gesture interfaces , 2012, EuroITV.

[27]  Tovi Grossman,et al.  Pointing at trivariate targets in 3D environments , 2004, CHI.

[28]  Ken Perlin,et al.  Quikwriting: continuous stylus-based text entry , 1998, UIST '98.

[29]  Shumin Zhai,et al.  Quasi-qwerty soft keyboard optimization , 2010, CHI.

[30]  I. Scott MacKenzie,et al.  Gathering text entry metrics on android devices , 2011, CHI EA '11.

[31]  Shumin Zhai,et al.  Shorthand writing on stylus keyboard , 2003, CHI '03.

[32]  Per Ola Kristensson,et al.  Continuous recognition of one-handed and two-handed gestures using 3D full-body motion tracking sensors , 2012, IUI '12.

[33]  Adam J. Sporka,et al.  A comparative study on distant free-hand pointing , 2012, EuroITV.

[34]  Beat Signer,et al.  SpeeG: a multimodal speech- and gesture-based text input solution , 2012, AVI.

[35]  Dzmitry Aliakseyeu,et al.  Comparing text entry methods for interactive television applications , 2009, EuroITV '09.

[36]  Manfred Tscheligi,et al.  Evaluating performance and acceptance of older adults using freehand gestures for TV menu control , 2012, EuroITV.

[37]  Gang Ren,et al.  3D Marking menu selection with freehand gestures , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[38]  Arianna Iatrino,et al.  Text Editing in Digital Terrestrial Television: A Comparison of Three Interfaces , 2007 .

[39]  Shumin Zhai,et al.  SHARK2: a large vocabulary shorthand writing system for pen-based computers , 2004, UIST '04.

[40]  Jakob Nielsen,et al.  Gestural interfaces: a step backward in usability , 2010, INTR.

[41]  Hrvoje Benko,et al.  Beyond flat surface computing: challenges of depth-aware and curved interfaces , 2009, ACM Multimedia.