Dynamic registration correction in augmented-reality systems

This paper addresses the problem of correcting visual registration errors in video-based augmented-reality systems. Accurate visual registration between real and computer-generated objects in combined images is critically important for conveying the perception that both types of object occupy the same 3-dimensional (3D) space. To date, augmented-reality systems have concentrated on simply improving 3D coordinate system registration in order to improve apparent (image) registration error. This paper introduces the idea of dynamically measuring registration error in combined images (2D error) and using that information to correct 3D coordinate system registration error which in turn improves registration in the combined images. Registration can be made exact in every combined image if a small video delay can be tolerated. Our experimental augmented-reality system achieves improved image registration, stability, and error tolerance from tracking system drift and jitter over current augmented-reality systems. No additional tracking hardware or other devices are needed on the user's head-mounted display. Computer-generated objects can be "nailed" to real-world reference points in every image the user sees with an easily-implemented algorithm. Dynamic error correction as demonstrated here will likely be a key component of future augmented-reality systems.

[1]  Bernard D. Adelstein,et al.  A testbed for characterizing dynamic response of virtual environment spatial sensors , 1992, UIST '92.

[2]  Thomas P. Caudell,et al.  Calibration of head-mounted displays for augmented reality applications , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[3]  Ronald Azuma,et al.  Improving static and dynamic registration in an optical see-through HMD , 1994, SIGGRAPH.

[4]  Mike Bajura.  Camera Calibration for Video See-Through Head-Mounted Display , 1993 .

[5]  John F. Hughes,et al.  Autocalibration for virtual environments tracking hardware , 1993, SIGGRAPH.

[6]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[7]  Jannick P. Rolland,et al.  Video see-through design for merging of real and virtual environments , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[8]  Blair MacIntyre,et al.  Annotating the real world with knowledge-based graphics on a see-through head-mounted display , 1992 .

[9]  Radu Horaud,et al.  An analytic solution for the perspective 4-point problem , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[11]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Uwe H List,et al.  Nonlinear Prediction of Head Movements for Helmet-Mounted Displays , 1983 .

[13]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[14]  Chris Shaw,et al.  On temporal-spatial realism in the virtual reality environment , 1991, UIST '91.