Using a head-mounted projective display in interactive augmented environments

Head-mounted projective displays (HMPD) have been recently proposed as an alternative to conventional eyepiece-type head-mounted displays (HMDs). HMPDs consist of a pair of miniature projection lenses, beamsplitters, and displays mounted on the helmet and retro-reflective sheeting materials placed strategically in the environment. The HMPD technology is first reviewed briefly, which includes its features and capabilities and a comparison with conventional visualization techniques, as well as our recent implementation of a compact HMPD prototype. Then we present some preliminary findings on retro-reflective materials and discuss a framework for collaborative AR environments, which supports at least three modes of collaboration: interactive local collaboration in an AR environment, passive distant collaboration, and interactive distant collaboration. Finally, two preliminary application examples of the HMPD technology for interactive collaboration in augmented environments are included, which demonstrate some of the HMPD characteristics and embody the framework for distant collaboration.

[1]  Masahiko Inami,et al.  Object-oriented displays: a new type of display systems-from immersive display to object-oriented displays , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[2]  Frank Biocca,et al.  An ultra-light and compact design and implementation of head-mounted projective displays , 2001, Proceedings IEEE Virtual Reality 2001.

[3]  J. Rolland,et al.  A non-intrusive display technique for providing real-time data within a surgeons critical area of interest. , 1998, Studies in health technology and informatics.

[4]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[5]  J P Rolland,et al.  Engineering of head-mounted projective displays. , 2000, Applied optics.

[6]  Kuo-Chi Lin,et al.  Automatic Modeling of Knee-Joint Motion For The Virtual Reality Dynamic Anatomy (VRDA) Tool , 2000, Presence: Teleoperators & Virtual Environments.

[7]  George W. Fitzmaurice,et al.  HMDs, caves & chameleon: a human-centric analysis of interaction in virtual space , 1998, COMG.

[8]  Maxine D. Brown,et al.  The ImmersaDesk and Infinity Wall projection-based virtual reality displays , 1997, COMG.

[9]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[10]  Ryugo Kijima,et al.  Transition between virtual environment and workstation environment with projective head mounted display , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[11]  Henry Fuchs,et al.  Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization , 2000, Presence: Teleoperators & Virtual Environments.

[12]  Masahiko Inami,et al.  Visuo-haptic display using head-mounted projector , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[13]  Ivan E. Sutherland,et al.  The Ultimate Display , 1965 .