A Shared-Aperture Tracking Display for Augmented Reality

The operation and performance of a six degree-of-freedom (DOF) shared-aperture tracking system with image overlay is described. This unique tracking technology shares the same aperture or scanned optical beam with the visual display, virtual retinal display (VRD). This display technology provides high brightness in an AR helmet-mounted display, especially in the extreme environment of a military cockpit. The VRD generates an image by optically scanning visible light directly to the viewer's eye. By scanning both visible and infrared light, the head-worn display can be directly coupled to a head-tracking system. As a result, the proposed tracking system requires minimal calibration between the user's viewpoint and the tracker's viewpoint. This paper demonstrates that the proposed shared-aperture tracking system produces high accuracy and computational efficiency. The current proof-of-concept system has a precision of +/ 0.05 and +/ 0.01 deg. in the horizontal and vertical axes, respectively. The static registration error was measured to be 0.08 +/ 0.04 and 0.03 +/ 0.02 deg. for the horizontal and vertical axes, respectively. The dynamic registration error or the system latency was measured to be within 16.67 ms, equivalent to our display refresh rate of 60 Hz. In all testing, the VRD was fixed and the calibrated motion of a robot arm was tracked. By moving the robot arm within a restricted volume, this real-time shared-aperture method of tracking was extended to six-DOF measurements. Future AR applications of our shared-aperture tracking and display system will be highly accurate head tracking when the VRD is helmet mounted and worn within an enclosed space, such as an aircraft cockpit.

[1]  Joseph J. LaViola,et al.  Pop through button devices for VE navigation and interaction , 2002, Proceedings IEEE Virtual Reality 2002.

[2]  Thomas A. Furness,et al.  Unique shared-aperture display with head or target tracking , 2002, Proceedings IEEE Virtual Reality 2002.

[3]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[4]  Max Donath,et al.  The Minnesota Scanner: a prototype sensor for three-dimensional tracking of moving body segments , 1989, IEEE Trans. Robotics Autom..

[5]  Hakan Urey,et al.  Performance of a biaxial MEMS-based scanner for microdisplay applications , 2000, SPIE MOEMS-MEMS.

[6]  Kiriakos N. Kutulakos,et al.  Calibration-Free Augmented Reality , 1998, IEEE Trans. Vis. Comput. Graph..

[7]  Richard L. Holloway,et al.  Registration Error Analysis for Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[8]  Jannick P. Rolland,et al.  A Survey of Tracking Technologies for Virtual Environments , 2001 .

[9]  Ronald Azuma,et al.  Hybrid inertial and vision tracking for augmented reality registration , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[10]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[11]  Andrew S. Forsberg,et al.  Image plane interaction techniques in 3D immersive environments , 1997, SI3D.

[12]  Michael Harrington,et al.  WearTrack: a self-referenced head and hand tracker for wearable computers and portable VR , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[13]  Tsuneo Yoshikawa,et al.  Accurate image overlay on video see-through HMDs using vision and accelerometers , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[14]  Suya You,et al.  Fusion of vision and gyro tracking for robust augmented reality registration , 2001, Proceedings IEEE Virtual Reality 2001.

[15]  Ronald Azuma,et al.  Space Resection by Collinearity: Mathematics Behind the Optical Ceiling Head-Tracker , 1991 .

[16]  Thomas A. Furness,et al.  Vision with a scanning laser display: comparison of flicker sensitivity to a CRT , 2001 .

[17]  George D. Stetten,et al.  Real time tomographic reflection: phantoms for calibration and biopsy , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[18]  Karel Zikan,et al.  Videometric head tracker for augmented reality applications , 1995, Other Conferences.

[19]  Richard S. Johnston,et al.  Development of a commercial retinal scanning display , 1995, Defense, Security, and Sensing.