An Introduction to 3-D User Interface Design

Three-dimensional user interface design is a critical component of any virtual environment (VE) application. In this paper, we present a broad overview of 3-D interaction and user interfaces. We discuss the effect of common VE hardware devices on user interaction, as well as interaction techniques for generic 3-D tasks and the use of traditional 2-D interaction styles in 3-D environments. We divide most user-interaction tasks into three categories: navigation, selection/manipulation, and system control. Throughout the paper, our focus is on presenting not only the available techniques but also practical guidelines for 3-D interaction design and widely held myths. Finally, we briefly discuss two approaches to 3-D interaction design and some example applications with complex 3-D interaction requirements. We also present an annotated online bibliography as a reference companion to this article.

[1]  Rudolph P. Darken,et al.  A Handheld Computer as an Interaction Device to a Virtual Environment , 1999 .

[2]  Dieter Schmalstieg,et al.  Using transparent props for interaction with the virtual table , 1999, SI3D.

[3]  Andrew S. Forsberg,et al.  Aperture based selection for immersive virtual environments , 1996, UIST '96.

[4]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[5]  Eliot Greenfield,et al.  The Virtual Tricorder , 1995 .

[6]  B. Shneiderman.  Designing the User Interface (3rd Ed.) , 1998 .

[7]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[8]  Doug A. Bowman,et al.  Designing Animal Habitats Within an Immersive VE , 1998, IEEE Computer Graphics and Applications.

[9]  Frederick P. Brooks,et al.  Moving objects in space: exploiting proprioception in virtual-environment interaction , 1997, SIGGRAPH.

[10]  Michael Gleicher,et al.  The challenges of 3D interaction: a CHI '94 workshop , 1994, SGCH.

[11]  Doug A. Bowman,et al.  An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments , 1997, SI3D.

[12]  Andrew S. Forsberg,et al.  Image plane interaction techniques in 3D immersive environments , 1997, SI3D.

[13]  Jean-Claude Martin,et al.  TYCOON: Theoretical Framework and Software Tools for Multimodal Interfaces , 1997 .

[14]  Steve Benford,et al.  Legibility enhancement for information visualisation , 1995, Proceedings Visualization '95.

[15]  Matthias M. Wloka,et al.  The virtual tricorder: a uniform interface for virtual reality , 1995, UIST '95.

[16]  Balakrishnan,et al.  20 th Century 3 DUI Bib , .

[17]  Marc Olano,et al.  3DM: a three dimensional modeler using a head-mounted display , 1992, I3D '92.

[18]  Dennis Proffitt,et al.  Cooperative bimanual action , 1997, CHI.

[19]  Ivan Poupyrev,et al.  Virtual Notepad: handwriting in immersive VR , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[20]  Helsin Cevik.  Map usage in virtual environments , 1998 .

[21]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[22]  Joseph J. LaViola,et al.  ErgoDesk: A Framework for Two- and Three-Dimensional Interaction at the ActiveDesk , 1998 .

[23]  Bernd Fröhlich,et al.  The cubic mouse: a new device for three-dimensional input , 2000, CHI.

[24]  Mark Green,et al.  JDCAD: A highly interactive 3D modeling system , 1994, Comput. Graph..

[25]  Barbara Hayes-Roth,et al.  Differences in spatial knowledge acquired from maps and navigation , 1982, Cognitive Psychology.

[26]  Doug A. Bowman,et al.  Maintaining Spatial Orientation during Travel in an Immersive Virtual Environment , 1999, Presence.

[27]  Rudy Darken,et al.  Map usage in virtual environments: orientation issues , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[28]  Donald B. Johnson,et al.  Testbed Evaluation of Virtual Environment Interaction Techniques , 1999, Presence: Teleoperators & Virtual Environments.

[29]  Ben Shneiderman,et al.  Designing the user interface (2nd ed.): strategies for effective human-computer interaction , 1992 .

[30]  Craig A. Will,et al.  Review of Virtual Environment Interface Technology. , 1996 .

[31]  Michael Gleicher,et al.  The challenges of 3D interaction , 1994, CHI Conference Companion.

[32]  Deborah Hix,et al.  User-centered design and evaluation of a real-time battlefield visualization virtual environment , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[33]  Randy F. Pausch,et al.  Voodoo dolls: seamless interaction at multiple scales in virtual environments , 1999, SI3D.

[34]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[35]  Jr. Joseph J. LaViola,et al.  Whole-Hand and Speech Input in Virtual Environments , 1999 .

[36]  Doug A. Bowman,et al.  Travel in immersive virtual environments: an evaluation of viewpoint motion control techniques , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.