Development of Head-Mounted Projection Displays for Distributed, Collaborative, Augmented Reality Applications

Distributed systems technologies supporting 3D visualization and social collaboration will be increasing in frequency and type over time. An emerging type of head-mounted display referred to as the head-mounted projection display (HMPD) was recently developed that only requires ultralight optics (i.e., less than 8 g per eye) that enables immersive multiuser, mobile augmented reality 3D visualization, as well as remote 3D collaborations. In this paper a review of the development of lightweight HMPD technology is provided, together with insight into what makes this technology timely and so unique. Two novel emerging HMPD-based technologies are then described: a teleportal HMPD (T-HMPD) enabling face-to-face communication and visualization of shared 3D virtual objects, and a mobile HMPD (M-HMPD) designed for outdoor wearable visualization and communication. Finally, the use of HMPD in medical visualization and training, as well as in infospaces, two applications developed in the ODA and MIND labs respectively, are discussed.

[1]  Myron W. Krueger,et al.  Responsive environments , 1977, AFIPS '77.

[2]  Weimin Mou,et al.  Performance Evaluation of Augmented Reality for Directed Assembly , 2004 .

[3]  Richard E. Kerber,et al.  Guidelines for cardiopulmonary resuscitation and emergency care, II: Adult basic life support , 1992 .

[4]  Jannick Rolland,et al.  Albertian errors in head-mounted displays: I. Choice of eye-point location for a near- or far-field task visualization. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  Frank Biocca,et al.  Toward a More Robust Theory and Measure of Social Presence: Review and Suggested Criteria , 2003, Presence: Teleoperators & Virtual Environments.

[6]  Larry S. Davis,et al.  Enabling a Continuum of Virtual Environment Experiences , 2003, IEEE Computer Graphics and Applications.

[7]  Yi-Pai Huang,et al.  26.3: Multidirectional Asymmetrical Microlens-Array Light Control Films for High Performance Reflective Liquid Crystal Displays , 2002 .

[8]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[9]  Masahiko Inami,et al.  Object-oriented displays , 1998, SIGGRAPH '98.

[10]  J P Rolland,et al.  Engineering of head-mounted projective displays. , 2000, Applied optics.

[11]  Jannick P. Rolland,et al.  The ARC Display: an augmented reality visualization center , 2002, The First IEEE International Workshop Agumented Reality Toolkit,.

[12]  Yi-Pai Huang,et al.  Multidirectional Asymmetrical Microlens-Array Light Control Films for High Performance Reflective Liquid Crystal Displays , 2002 .

[13]  Ryugo Kijima,et al.  Transition between virtual environment and workstation environment with projective head mounted display , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[14]  Terry Daugherty.  Manipulating Objects in the Virtual Space Around the Body: Relationship Between Spatial Location, Ease of Manipulation, Spatial Recall, and Spatial Ability , 2001 .

[15]  Jason Daly,et al.  Development of a training tool for endotracheal intubation: distributed augmented reality. , 2003, Studies in health technology and informatics.

[16]  Ivan Poupyrev,et al.  The MagicBook - Moving Seamlessly between Reality and Virtuality , 2001, IEEE Computer Graphics and Applications.

[17]  Frank Biocca,et al.  Mobile Face Capture for Virtual Face Videos , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[18]  W KruegerMyron,et al.  VIDEOPLACEan artificial reality , 1985 .

[19]  O. Grüsser,et al.  Multimodal Structure of the Extrapersonal Space , 1983 .

[20]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[21]  Jannick P. Rolland,et al.  Conformal optics for 3D visualization , 1998, Other Conferences.

[22]  F. Biocca,et al.  Criteria And Scope Conditions For A Theory And Measure Of Social Presence , 2001 .

[23]  E. Gonzalez,et al.  Guidelines for cardiopulmonary resuscitation and emergency cardiac care. , 1987, Clinical pharmacy.

[24]  Masahiko Inami,et al.  Object-oriented displays: a new type of display systems-from immersive display to object-oriented displays , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[25]  Jannick P. Rolland,et al.  Optical versus Video See-Through Head-Mounted Displays , 2001 .

[26]  Hong Hua,et al.  Design of an ultralight and compact projection lens. , 2003, Applied optics.

[27]  James E. Cutting,et al.  Chapter 3 – Perceiving Layout and Knowing Distances: The Integration, Relative Potency, and Contextual Use of Different Information about Depth* , 1995 .

[28]  Frank Biocca,et al.  Teleportal Augmented Reality System: Integrating Virtual Objects, Remote Collaborators, and Physical Reality for Distributed Networked Manufacturing , 2004 .

[29]  Felix G. Hamza-Lup,et al.  Adaptive scene synchronization for virtual and mixed reality environments , 2004, IEEE Virtual Reality 2004.

[30]  Jannick P. Rolland,et al.  EMBEDDED TRAINING DISPLAY TECHNOLOGY FOR THE ARMY'S FUTURE COMBAT VEHICLES , 2006 .

[31]  Ron M. Walls,et al.  2,392 emergency department intubations: First report of the ongoing National Emergency Airway Registry study (NEAR 97) , 1999 .

[32]  Chandan Reddy,et al.  A Non-obtrusive Head Mounted Face Capture System , 2003 .

[33]  J. Rolland,et al.  A non-intrusive display technique for providing real-time data within a surgeons critical area of interest. , 1998, Studies in health technology and informatics.

[34]  Jannick P. Rolland,et al.  Methodology for the Iterative Evaluation of Prototype Head-Mounted Displays in Virtual Environments: Visual Acuity Metrics , 2005, Presence: Teleoperators & Virtual Environments.

[35]  Hong Hua,et al.  System and Interface Framework for SCAPE as a Collaborative Infrastructure , 2004, Presence: Teleoperators & Virtual Environments.

[36]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[37]  F. Previc.  The neuropsychology of 3-D space. , 1998, Psychological bulletin.

[38]  Felix G. Hamza-Lup,et al.  Physically-based Deformation of High-Resolution 3D Lung Models for Augmented Reality based Medical Visualization , 2004 .

[39]  Larry S. Davis,et al.  A method for designing marker-based tracking probes , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[40]  Masahiko Inami,et al.  Visuo-haptic display using head-mounted projector , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[41]  Myron W. Krueger,et al.  VIDEOPLACE—an artificial reality , 1985, CHI '85.

[42]  Weimin Mou,et al.  Frames of reference in mobile augmented reality displays. , 2004, Journal of experimental psychology. Applied.

[43]  Frank Biocca,et al.  Extended Abstract Mapping the Semantic Asymmetries of Virtual and Augmented Reality Space , 2001, Cognitive Technology.

[44]  Felix G. Hamza-Lup,et al.  Scene Synchronization for Real-Time Interaction in Distributed Mixed Reality and Virtual Reality Environments , 2004, Presence: Teleoperators & Virtual Environments.

[45]  Fred H. Previc,et al.  The Neuropsychology of 3-D Space , 1998 .

[46]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .