A Survey of 3D Interaction Techniques

Recent gains in the performance of 3D graphics hardware and rendering systems have not been matched by a corresponding improvement in our knowledge of how to interact with the virtual environments we create; therefore there is a need to examine these further if we are to improve the overall quality of our interactive 3D systems. This paper examines some of the interaction techniques which have been developed for object manipulation, navigation and application control in 3D virtual environments. The use of both mouse‐based techniques and 3D input devices is considered, along with the role of feedback and some aspects of tools and widgets.

[1]  Jock D. Mackinlay,et al.  A semantic analysis of the design space of input devices , 1990 .

[2]  Myron W. Krueger,et al.  Artificial reality II , 1991 .

[3]  Jock D. Mackinlay,et al.  A Semantic Analysis of the Design Space of Input Devices , 1990, Hum. Comput. Interact..

[4]  Dan Venolia.  Facile 3D direct manipulation , 1993, CHI '93.

[5]  Andrew S. Forsberg,et al.  Image plane interaction techniques in 3D immersive environments , 1997, SI3D.

[6]  Brenda K. Laurel,et al.  Interface as Mimesis , 1986 .

[7]  J. Gibson.  The Senses Considered As Perceptual Systems , 1967 .

[8]  Norman I. Badler,et al.  Automatic viewing control for 3D direct manipulation , 1992, I3D '92.

[9]  Song Li,et al.  Metis – An Object‐Oriented Toolkit for Constructing Virtual Reality Applications , 1999, Comput. Graph. Forum.

[10]  Colin Ware,et al.  Exploration and virtual camera control in virtual three dimensional environments , 1990, I3D '90.

[11]  William Buxton,et al.  There's more to interaction than meets the eye: some issues in manual input , 1987 .

[12]  Mel Slater,et al.  The Virtual Treadmill: A Naturalistic Metaphor for Navigation in Immersive Virtual Environments , 1995, Virtual Environments.

[13]  David Zeltzer,et al.  A survey of glove-based input , 1994, IEEE Computer Graphics and Applications.

[14]  Jaron Lanier,et al.  A hand gesture interface device , 1987, CHI 1987.

[15]  John F. Hughes,et al.  An interactive 3D toolkit for constructing 3D widgets , 1993, SIGGRAPH.

[16]  I. Howard,et al.  Human Spatial Orientation , 1966 .

[17]  Andrew Roberts,et al.  3-Draw: a tool for designing 3D shapes , 1991, IEEE Computer Graphics and Applications.

[18]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[19]  Mark Green,et al.  JDCAD: A highly interactive 3D modeling system , 1994, Comput. Graph..

[20]  Stephen Travis Pope,et al.  A cookbook for using the model-view controller user interface paradigm in Smalltalk-80 , 1988 .

[21]  John J. Leggett,et al.  Interaction styles and input/output devices , 1993, Behav. Inf. Technol..

[22]  Michael Gleicher,et al.  Through-the-lens camera control , 1992, SIGGRAPH.

[23]  Abigail Sellen,et al.  A study in interactive 3-D rotation using 2-D control devices , 1988, SIGGRAPH.

[24]  Eric A. Bier.  Snap-dragging in three dimensions , 1990, I3D '90.

[25]  Daniel C. Robbins,et al.  Three-dimensional widgets , 1992, I3D '92.

[26]  C. Hand.  A SURVEY OF 3-D INPUT DEVICES , 1993 .

[27]  F. Brooks,et al.  Feeling and seeing: issues in force display , 1990, ACM Symposium on Interactive 3D Graphics and Games.

[28]  Rupert England.  Sensory-motor systems in virtual manipulation , 1995 .

[29]  Larisa Matejic.  LOG: Building 3D User Interface Widgets By Demonstration , 1993 .

[30]  James D. Hollan,et al.  Direct Manipulation Interfaces , 1985, Hum. Comput. Interact..

[31]  F. P. Brooks,et al.  Grasping reality through illusion—interactive graphics serving science , 1988, CHI '88.

[32]  Mark R. Mine,et al.  Working in a Virtual World: Interaction Techniques Used in the Chapel Hill Immersive Modeling Program , 1996 .

[33]  C. Oman.  Sensory conflict in motion sickness: an Observer Theory approach , 1991 .

[34]  Christer Carlsson,et al.  DIVE A multi-user virtual reality system , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[35]  Tamotsu Murakami,et al.  Direct and intuitive input device for 3-D shape deformation , 1994, CHI '94.

[36]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[37]  Geoffrey E. Hinton,et al.  Building adaptive interfaces with neural networks: The glove-talk pilot study , 1990, INTERACT.

[38]  Ken Hinckley,et al.  Passive real-world interface props for neurosurgical visualization , 1994, International Conference on Human Factors in Computing Systems.

[39]  Rupert England,et al.  Simulated and virtual realities: elements of perception , 1995 .

[40]  I. Scott MacKenzie,et al.  Extending Fitts' law to two-dimensional tasks , 1992, CHI.

[41]  Michael Deering,et al.  High resolution virtual reality , 1992, SIGGRAPH.

[42]  Lutz Kettner,et al.  A classification scheme of 3D interaction techniques , 1995 .

[43]  Daniel Thalmann,et al.  Physically-based interactive camera motion control using 3D input devices , 1991 .

[44]  John D. M. Edwards,et al.  MaPS: movement and planning support for navigation in an immersive VRML browser , 1997, VRML '97.

[45]  W. Buxton,et al.  A study in two-handed input , 1986, CHI '86.

[46]  Eliot Greenfield,et al.  The Virtual Tricorder , 1995 .

[47]  M. M. Wloka,et al.  Interacting with virtual reality , 1995 .

[48]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[49]  Stephanie Houde,et al.  Iterative design of an interface for easy 3-D direct manipulation , 1992, CHI.

[50]  Daniel Thalmann,et al.  VB2: an architecture for interaction in synthetic worlds , 1993, UIST '93.

[51]  Gregory M. Nielson,et al.  Direct manipulation techniques for 3D objects using 2D locator devices , 1987, I3D '86.

[52]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[53]  Kellogg S. Booth,et al.  Fish tank virtual reality , 1993, INTERCHI.

[54]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[55]  Christopher Schmandt,et al.  Spatial input/display correspondence in a stereoscopic computer graphic work station , 1983, SIGGRAPH.

[56]  Dieter W. Fellner,et al.  MRTspace - Multi-user 3D environments using VRML , 1996, WebNet.

[57]  Yasuhiro Nakamura,et al.  3D direct manipulation interface: Development of the Zashiki-Warashi system , 1994, Comput. Graph..

[58]  Michael D. Harrison,et al.  Abstract Interaction Objects , 1993, Comput. Graph. Forum.

[59]  Enrico Gobbetti,et al.  An integrated environment to visually construct 3D animations , 1995, SIGGRAPH.

[60]  Eric A. Bier.  Skitters and jacks: interactive 3D positioning tools , 1987, I3D '86.

[61]  Michael J. Griffin,et al.  Head-coupled virtual environment with display lag , 1995 .

[62]  David A. Carr,et al.  Specification of interface interaction objects , 1994, CHI '94.

[63]  Jock D. Mackinlay,et al.  Rapid controlled movement through a virtual 3D workspace , 1990, SIGGRAPH.

[64]  Chris Shaw,et al.  Two-handed polygonal surface design , 1994, UIST '94.

[65]  Daniel Thalmann,et al.  Sculpting with the `ball and mouse' metaphor , 1991 .

[66]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[67]  John F. Hughes,et al.  Sculpting: an interactive volumetric modeling technique , 1991, SIGGRAPH.