An optical see-through display for mutual occlusion of real and virtual environments

In a mixed reality system, mutual occlusion of real and virtual environments enhances the user's feeling that virtual objects truly exist in the real world. However, conventional optical see-through displays cannot present mutual occlusion correctly since the synthetic objects always appear as semi-transparent ghosts floating in front of the real scene. In this paper, we propose a novel display design that attacks this well-known unsettled problem. Our optical see-through display with mutual occlusion capability has the following advantages: (1) since the light-blocking mechanism is embedded in the display and no additional setting is needed, it can be used anywhere, e.g. outdoors; (2) since incoming light can easily be cut off in any situation, virtual images keep their original intended colors, e.g. black; (3) since the light-blocking mechanism is separated from the display for color graphics, most existing see-through displays can be employed. We also describe our prototype display, which has confirmed the effectiveness of the approach.

[1]  Ronald Azuma,et al.  A motion-stabilized outdoor augmented reality system , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[2]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[3]  T. Ronald,et al.  Azuma A Survey of Augmented Reality , 2022 .

[4]  Naokazu Yokoya,et al.  A stereoscopic video see-through augmented reality system based on real-time vision-based registration , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[5]  Greg Welch,et al.  The HiBall Tracker: high-performance wide-area tracking for virtual and augmented environments , 1999, VRST '99.

[6]  Ken-ichi Kameyama Tangible modeling system , 1999, SIGGRAPH '99.

[7]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[8]  Masahiko Inami,et al.  Visuo-haptic display using head-mounted projector , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[9]  Takeo Kanade,et al.  A stereo machine for video-rate dense depth mapping and its new applications , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.