Computer-vision-based registration techniques for augmented reality

Augmented reality is a term used to describe systems in which computer-generated information is superimposed on top of the real world; for example, through the use of a see- through head-mounted display. A human user of such a system could still see and interact with the real world, but have valuable additional information, such as descriptions of important features or instructions for performing physical tasks, superimposed on the world. For example, the computer could identify and overlay them with graphic outlines, labels, and schematics. The graphics are registered to the real-world objects and appear to be 'painted' onto those objects. Augmented reality systems can be used to make productivity aids for tasks such as inspection, manufacturing, and navigation. One of the most critical requirements for augmented reality is to recognize and locate real-world objects with respect to the person's head. Accurate registration is necessary in order to overlay graphics accurately on top of the real-world objects. At the Colorado School of Mines, we have developed a prototype augmented reality system that uses head-mounted cameras and computer vision techniques to accurately register the head to the scene. The current system locates and tracks a set of pre-placed passive fiducial targets placed on the real-world objects. The system computes the pose of the objects and displays graphics overlays using a see-through head-mounted display. This paper describes the architecture of the system and outlines the computer vision techniques used.

[1]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[2]  W. Eric L. Grimson,et al.  An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Warren Robinson,et al.  Synthetic Experience: A Proposed Taxonomy , 1992, Presence Teleoperators Virtual Environ..

[4]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[5]  Ulrich Neumann,et al.  Dynamic registration correction in augmented-reality systems , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[6]  Ronald Azuma,et al.  Tracking a head-mounted display in a room-sized environment with head-mounted cameras , 1990, Defense, Security, and Sensing.

[7]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[8]  David E. Breen,et al.  Calibration Requirements and Procedures for a Monitor-Based Augmented Reality System , 1995, IEEE Trans. Vis. Comput. Graph..

[9]  Ronald Azuma,et al.  Improving static and dynamic registration in an optical see-through HMD , 1994, SIGGRAPH.

[10]  Karel Zikan,et al.  Videometric head tracker for augmented reality applications , 1995, Other Conferences.

[11]  J. P. Mellor,et al.  Enhanced Reality Visualization in a Surgical Environment , 1995 .

[12]  David Harwood,et al.  Passive ranging to known planar point sets , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[13]  Lance B. Gatrell,et al.  Robust image features: concentric contrasting circles and their image extraction , 1992, Other Conferences.

[14]  John R. Spofford,et al.  Machine-vision-based teleoperation aid , 1991 .

[15]  Thomas P. Caudell.  Introduction to augmented and virtual reality , 1995, Other Conferences.

[16]  Kiriakos N. Kutulakos,et al.  Affine object representations for calibration-free augmented reality , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[17]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[18]  Ronald Azuma,et al.  Tracking requirements for augmented reality , 1993, CACM.

[19]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[20]  Frank Biocca,et al.  A Survey of Position Trackers , 1992, Presence: Teleoperators & Virtual Environments.

[21]  Warren Robinett,et al.  Electronic Expansion of Human Perception , 1991 .

[22]  Michael Magee,et al.  Optical target location using machine vision in space robotics tasks , 1991, Other Conferences.

[23]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[24]  Israel Amir,et al.  Design of Fiducials for Accurate Registration Using Machine Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..