Balloon Selection: A Multi-Finger Technique for Accurate Low-Fatigue 3D Selection

Balloon selection is a 3D interaction technique that is modeled after the real world metaphor of manipulating a helium balloon attached to a string. Balloon selection allows for precise 3D selection in the volume above a tabletop surface by using multiple fingers on a multi-touch-sensitive surface. The 3DOF selection tasks is decomposed in part into a 2DOF positioning task performed by one finger on the tabletop in an absolute 2D Cartesian coordinate system and a 1DOF positioning task performed by another finger on the tabletop in a relative 2D polar coordinate system. We have evaluated balloon selection in a formal user study that compared it to two well-known interaction techniques for selecting a static 3D target: a 3DOF tracked wand and keyboard cursor keys. We found that balloon selection was significantly faster than using cursor keys and had a significantly lower error rate than the wand. The lower error rate appeared to result from the user's hands being supported by the tabletop surface, resulting in significantly reduced hand tremor and arm fatigue.

[1]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[2]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[3]  Steven K. Feiner,et al.  Collaborative mixed reality visualization of an archaeological excavation , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[4]  Dennis Proffitt,et al.  Two-handed virtual manipulation , 1998, TCHI.

[5]  Jefferson Y. Han.  Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[6]  Jun Rekimoto,et al.  A Multi-finger Interface for Performance Animation of Deformable Drawings , 2005 .

[7]  Andrew S. Forsberg,et al.  Aperture based selection for immersive virtual environments , 1996, UIST '96.

[8]  Ferran Argelaguet,et al.  Friction surfaces: scaled ray-casting manipulation for interacting with 2D GUIs , 2006, EGVE'06.

[9]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[10]  Donald B. Johnson,et al.  Testbed Evaluation of Virtual Environment Interaction Techniques , 1999, Presence: Teleoperators & Virtual Environments.

[11]  Matthias Bues,et al.  iSith - Intersection-based Spatial Interaction for Two Hands , 2006, 3D User Interfaces (3DUI'06).

[12]  Tobias Höllerer,et al.  Interactive Perspective Cut-away Views for General 3D Scenes , 2006, 3D User Interfaces (3DUI'06).

[13]  Frits H. Post,et al.  Hybrid interfaces in VEs: intent and interaction , 2006, EGVE'06.

[14]  Hector J. Levesque,et al.  The adaptive agent architecture: achieving fault-tolerance using persistent broker teams , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[15]  G. Drew Kessler,et al.  Precise and rapid interaction through scaled manipulation in immersive virtual environments , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[16]  Doug A. Bowman,et al.  Overcoming World in Miniature Limitations by a Scaled and Scrolling WIM , 2006, 3D User Interfaces (3DUI'06).

[17]  Doug A. Bowman,et al.  An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments , 1997, SI3D.

[18]  William Buxton,et al.  The design of a GUI paradigm based on tablets, two-hands, and transparency , 1997, CHI.

[19]  Doug A. Bowman,et al.  Testbed Evaluation of Virtual Environment Interaction Techniques , 2001, Presence Teleoperators Virtual Environ..

[20]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[21]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[22]  Andrew D. Wilson.  PlayAnywhere: a compact interactive tabletop projection-vision system , 2005, UIST.

[23]  Steven K. Feiner,et al.  SenseShapes: using statistical geometry for object selection in a multimodal augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[24]  Donald Lee Vickers,et al.  Sorcerer's apprentice: head-mounted display and wand , 1972 .

[25]  Norman I. Badler,et al.  Multi-dimensional input techniques and articulated figure positioning by multiple constraints , 1987, I3D '86.

[26]  Holger Regenbrecht,et al.  MagicMeeting: A Collaborative Tangible Augmented Reality System , 2002, Virtual Reality.

[27]  Robert J. K. Jacob,et al.  The perceptual structure of multidimensional input device selection , 1992, CHI.

[28]  Tovi Grossman,et al.  Multi-finger gestural interaction with 3d volumetric displays , 2004, UIST '04.

[29]  Steven K. Feiner,et al.  The Flexible Pointer: An Interaction Technique for Selection in Augmented and Virtual Reality , 2003 .

[30]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[31]  Steven K. Feiner,et al.  Cross-dimensional gestural interaction techniques for hybrid immersive environments , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[32]  Frederick P. Brooks,et al.  Moving objects in space: exploiting proprioception in virtual-environment interaction , 1997, SIGGRAPH.

[33]  Daniel C. Robbins,et al.  Interactive shadows , 1992, UIST '92.

[34]  Y. Guiard.  Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[35]  Ken Hinckley,et al.  A survey of design issues in spatial input , 1994, UIST '94.

[36]  Steven K. Feiner,et al.  Cutaways and ghosting: satisfying visibility constraints in dynamic 3D illustrations , 1992, The Visual Computer.

[37]  Bernd Fröhlich,et al.  Two-handed direct manipulation on the responsive workbench , 1997, SI3D.

[38]  W. Buxton,et al.  A study in two-handed input , 1986, CHI '86.

[39]  Andrew D. Wilson.  TouchLight: an imaging touch screen and display for gesture-based interaction , 2004, ICMI '04.

[40]  Frederick P. Brooks,et al.  Walkthrough—a dynamic graphics system for simulating virtual buildings , 1987, I3D '86.

[41]  Robert St. Amant,et al.  HabilisDraw DT: a bimanual tool-based direct manipulation drawing environment , 2004, CHI EA '04.

[42]  Narendra Ahuja,et al.  A new collaborative infrastructure: SCAPE , 2003, IEEE Virtual Reality, 2003. Proceedings..

[43]  Randy F. Pausch,et al.  Voodoo dolls: seamless interaction at multiple scales in virtual environments , 1999, SI3D.