VisionWand: interaction techniques for large displays using a passive wand tracked in 3D

A passive wand tracked in 3D using computer vision techniques is explored as a new input mechanism for interacting with large displays. We demonstrate a variety of interaction techniques that exploit the affordances of the wand, resulting in an effective interface for large scale interaction. The lack of any buttons or other electronics on the wand presents a challenge that we address by developing a set of postures and gestures to track state and enable command input. We also describe the use of multiple wands, and posit designs for more complex wands in the future.

[1]  Jakub Segen,et al.  Look ma, no mouse! , 2000, CACM.

[2]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[3]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[4]  Terry Winograd,et al.  Fluid interaction with high-resolution wall-size displays , 2001, UIST '01.

[5]  Ravin Balakrishnan,et al.  VisionWand: interaction techniques for large displays using a passive wand tracked in 3D , 2004, SIGGRAPH 2004.

[6]  Paul A. Beardsley,et al.  Computer vision for computer interaction , 1999, COMG.

[7]  William T. Freeman,et al.  Television control by hand gestures , 1994 .

[8]  William Buxton,et al.  The limits of expert performance using hierarchic marking menus , 1993, INTERCHI.

[9]  John C. Tang,et al.  Liveboard: a large interactive display supporting group meetings, presentations, and remote collaboration , 1992, CHI.

[10]  Peter Schröder,et al.  Surface drawing: creating organic 3D shapes with the hand and tangible tools , 2001, CHI.

[11]  Saul Greenberg,et al.  The notification collage: posting information to public and personal displays , 2001, CHI.

[12]  Jakub Segen,et al.  Gesture VR: vision-based 3D hand interace for spatial interaction , 1998, MULTIMEDIA '98.

[13]  Jeffrey Nichols,et al.  Interacting at a distance: measuring the performance of laser pointers and other devices , 2002, CHI.

[14]  Myron W. Krueger,et al.  Artificial reality II , 1991 .

[15]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[16]  Dan R. Olsen,et al.  Laser pointer interaction , 2001, CHI.

[17]  Michael J. McGuffin,et al.  FaST Sliders: Integrating Marking Menus and the Adjustment , 2002, Graphics Interface.

[18]  Takeo Igarashi,et al.  Flatland: new dimensions in office whiteboards , 1999, CHI '99.

[19]  William Buxton,et al.  Creating principal 3D curves with digital tape drawing , 2002, CHI.

[20]  Chris Shaw,et al.  Two-handed polygonal surface design , 1994, UIST '94.

[21]  Steven A. Shafer,et al.  XWand: UI for intelligent spaces , 2003, CHI '03.

[22]  James H. Clark,et al.  Designing surfaces in 3-D , 1976, CACM.

[23]  Greg Welch,et al.  Motion Tracking: No Silver Bullet, but a Respectable Arsenal , 2002, IEEE Computer Graphics and Applications.

[24]  James L. Crowley,et al.  Perceptual user interfaces: things that see , 2000, CACM.

[25]  Emmanuel Barillot,et al.  Control menus: excecution and control in a single interactor , 2000, CHI Extended Abstracts.

[26]  William Buxton,et al.  Interaction techniques for 3D modeling on large displays , 2001, I3D '01.

[27]  Meredith Ringel Morris,et al.  Barehands: implement-free interaction with a wall-mounted display , 2001, CHI Extended Abstracts.

[28]  Wolfgang Stuerzlinger,et al.  Laser Pointers as Collaborative Pointing Devices , 2002, Graphics Interface.

[29]  William Buxton,et al.  Large Displays in Automotive Design , 2000, IEEE Computer Graphics and Applications.

[30]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[31]  Michael F. Deering,et al.  HoloSketch: a virtual reality sketching/animation tool , 1995, TCHI.

[32]  Andrew Wilson,et al.  Pointing in Intelligent Environments with the WorldCursor , 2003, INTERACT.

[33]  Jun Rekimoto,et al.  ToolStone: effective use of the physical manipulation vocabularies of input devices , 2000, UIST '00.