Distant freehand pointing and clicking on very large, high resolution displays

We explore the design space of freehand pointing and clicking interaction with very large high resolution displays from a distance. Three techniques for gestural pointing and two for clicking are developed and evaluated. In addition, we present subtle auditory and visual feedback techniques to compensate for the lack of kinesthetic feedback in freehand interaction, and to promote learning and use of appropriate postures.

[1]  Shumin Zhai,et al.  Manual and gaze input cascaded (MAGIC) pointing , 1999, CHI '99.

[2]  Andrew Wilson,et al.  Pointing in Intelligent Environments with the WorldCursor , 2003, INTERACT.

[3]  Andrew S. Forsberg,et al.  Image plane interaction techniques in 3D immersive environments , 1997, SI3D.

[4]  Michel Millodot Od PhD DOSc Faao FCOptom.  Dictionary of Optometry and Visual Science , 2000 .

[5]  Yanqing Wang,et al.  The role of contextual haptic and visual constraints on object manipulation in virtual environments , 2000, CHI.

[6]  A. Kendon.  Gesture: Visible Action as Utterance , 2004 .

[7]  John Paulin Hansen,et al.  Eye-gaze control of multimedia systems , 1995 .

[8]  Richard A. Bolt,et al.  Gaze-orchestrated dynamic windows , 1981, SIGGRAPH '81.

[9]  Jeffrey Nichols,et al.  Interacting at a distance: measuring the performance of laser pointers and other devices , 2002, CHI.

[10]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[11]  Tovi Grossman,et al.  Multi-finger gestural interaction with 3d volumetric displays , 2004, UIST '04.

[12]  Doug A. Bowman,et al.  An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments , 1997, SI3D.

[13]  Roel Vertegaal,et al.  EyeWindows: evaluation of eye-controlled zooming windows for focus selection , 2005, CHI.

[14]  Choon Hong Peck.  Useful parameters for the design of laser pointer interaction techniques , 2001, CHI Extended Abstracts.

[15]  Philip R. Cohen,et al.  Multimodal speech-gesture interface for handfree painting on a virtual paper using partial recurrent neural networks as gesture recognizer , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[16]  Jeffrey S. Shell,et al.  Auramirror: reflections on attention , 2004, ETRA.

[17]  Dan R. Olsen,et al.  Laser pointer interaction , 2001, CHI.

[18]  Sergey V. Matveyev,et al.  The optical tweezers: multiple-point interaction technique , 2003, VRST '03.

[19]  Ravin Balakrishnan,et al.  Reaching for objects in VR displays: lag and frame rate , 1994, TCHI.

[20]  Ken Hinckley,et al.  A survey of design issues in spatial input , 1994, UIST '94.

[21]  Michel Millodot.  Dictionary of Optometry and Visual Science , 1997 .

[22]  Randy F. Pausch,et al.  Voodoo dolls: seamless interaction at multiple scales in virtual environments , 1999, SI3D.

[23]  Sergey V. Matveyev,et al.  Laser Pointer Interaction with Hand Tremor Elimination , 2003 .

[24]  Shumin Zhai,et al.  User performance in relation to 3D input device design , 1998, COMG.

[25]  I.,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..

[26]  Ivan Poupyrev,et al.  Manipulating Objects in Virtual Worlds: Categorization and Empirical Evaluation of Interaction Techniques , 1999, J. Vis. Lang. Comput..

[27]  C. Dickinson,et al.  Dictionary of Optometry and Visual Science. , 1998 .

[28]  I. Scott MacKenzie,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..

[29]  Wolfgang Stuerzlinger,et al.  Laser Pointers as Collaborative Pointing Devices , 2002, Graphics Interface.

[30]  I. Scott MacKenzie,et al.  An Evaluation of Two Input Devices for Remote Pointing , 2001, EHCI.

[31]  Regan L. Mandryk,et al.  TractorBeam: seamless integration of local and remote pointing for tabletop displays , 2005, Graphics Interface.

[32]  Daniel Vogel,et al.  Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users , 2004, UIST '04.

[33]  Rainer Stiefelhagen,et al.  Pointing gesture recognition based on 3D-tracking of face, hands and head orientation , 2003, ICMI '03.

[34]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.