Mid-air text input techniques for very large wall displays

Traditional text input modalities, namely keyboards, are often not appropriate for use when standing in front of very large wall displays. Direct interaction techniques, such as handwriting, are better, but are not well suited to situations where users are not in close physical proximity to the display. We discuss the potential of mid-air interaction techniques for text input on very large wall displays, and introduce two factors, distance-dependence and visibility-dependence, which are useful for segmenting the design space of mid-air techniques. We then describe three techniques that were designed with the goal of exploring the design space, and present a comparative evaluation of those techniques. Questions raised by the evaluation were investigated further in a second evaluation focusing on distance-dependence. The two factors of distance- and visibility-dependence can guide the design of future text input techniques, and our results suggest that distance-independent techniques may be best for use with very large wall displays.

[1]  Robert W. Bailey,et al.  Human Performance Engineering: Designing High Quality Professional User Interfaces for Computer Products, Applications and Systems , 1996 .

[2]  Daniel Vogel,et al.  Distant freehand pointing and clicking on very large, high resolution displays , 2005, UIST.

[3]  Thomas Grechenig,et al.  TwoStick: writing with a game controller , 2007, GI '07.

[4]  Daniel Vogel,et al.  Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users , 2004, UIST '04.

[5]  Thomas P. Moran,et al.  Tivoli: an electronic whiteboard for informal workgroup meetings , 1993, INTERCHI.

[6]  James D. Foley,et al.  The human factors of computer graphics interaction techniques , 1984, IEEE Computer Graphics and Applications.

[7]  William Buxton Surface and Tangible Computing, and the "Small" Matter of People and Design , 2008, 2008 IEEE International Solid-State Circuits Conference - Digest of Technical Papers.

[8]  Carsten Magerkurth,et al.  A pervasive keyboard - separating input from display , 2003, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[9]  Nette Schultz,et al.  An intuitive text input method for touch wheels , 2006, CHI.

[10]  I. Scott MacKenzie,et al.  LetterWise: prefix-based disambiguation for mobile text input , 2001, UIST '01.

[11]  Daniel J. Wigdor,et al.  TiltText: using tilt for text input to mobile phones , 2003, UIST '03.

[12]  Yang Liu,et al.  Hand-Gesture Based Text Input for Wearable Computers , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[13]  Anthony Tang,et al.  Designing for bystanders: reflections on building a public digital forum , 2008, CHI.

[14]  Robert DeLine,et al.  Let's go to the whiteboard: how and why software developers use drawings , 2007, CHI.

[15]  Sang Hyuk Hong,et al.  Designing a universal keyboard using chording gloves , 2002, CUU '03.

[16]  Mary Czerwinski,et al.  Toward Characterizing the Productivity Benefits of Very Large Displays , 2003, INTERACT.

[17]  Neff Walker,et al.  A comparison of selection time from walking and pull-down menus , 1990, CHI '90.

[18]  Takeo Igarashi,et al.  Flatland: new dimensions in office whiteboards , 1999, CHI '99.

[19]  Anthony Tang,et al.  Shadow reaching: a new perspective on interaction for large displays , 2007, UIST.

[20]  Brad A. Myers,et al.  EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion , 2003, UIST '03.

[21]  Benoît Martin VirHKey: a VIRtual Hyperbolic KEYboard with gesture interaction and visual feedback for mobile devices , 2005, Mobile HCI.

[22]  I. Scott MacKenzie,et al.  The design and evaluation of a high-performance soft keyboard , 1999, CHI '99.

[23]  Alan F. Blackwell,et al.  Dasher—a data entry interface using continuous gestures and language models , 2000, UIST '00.

[24]  I. Scott MacKenzie,et al.  Phrase sets for evaluating text entry techniques , 2003, CHI Extended Abstracts.

[25]  Dan Venolia,et al.  T-Cube: a fast, self-disclosing pen-based alphabet , 1994, CHI '94.

[26]  Andriy Pavlovych,et al.  An Analysis of Novice Text Entry Performance on Large Interactive Wall Surfaces , 2005 .

[27]  Patrick Baudisch,et al.  Soap: a pointing device that works in mid-air , 2006, UIST.