Calibration Requirements and Procedures for Augmented Reality

Augmented reality entails the use of models and their associated renderings to supplement information in a real scene. In order for this information to be relevant or meaningful, the models must be positioned and displayed in such a way that they blend into the real world in terms of alignments, perspectives, illuminations, etc. For practical reasons the information necessary to obtain this realistic blending cannot be known a priori, and cannot be hard-wired into a system. Instead a number of calibration procedures are necessary so that the location and parameters of each of the system components are known. In this paper we identify the calibration steps necessary to build a complete computer model of the real world and then, using the augmented reality system developed at ECRC (Grasp) as an example, we describe each of the calibration processes.

[1]  Sundaram Ganapathy,et al.  Decomposition of transformation matrices for robot vision , 1984, Pattern Recognition Letters.

[2]  David E. Breen,et al.  Annotating Real-World Objects Using Augmented Reality , 1995, Computer Graphics.

[3]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  David E. Breen,et al.  Augmented vision system for industrial applications , 1995, Other Conferences.

[5]  William E. Lorensen,et al.  Enhancing reality in the operating room , 1993, Proceedings Visualization '93.

[6]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[7]  Michael Deering,et al.  High resolution virtual reality , 1992, SIGGRAPH.

[8]  Ronald Azuma,et al.  Improving static and dynamic registration in an optical see-through HMD , 1994, SIGGRAPH.

[9]  Michael Gleicher,et al.  Through-the-lens camera control , 1992, SIGGRAPH.

[10]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[11]  Shumin Zhai,et al.  ARGOS: a display system for augmenting reality , 1993, CHI '93.

[12]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[13]  Narendra Ahuja,et al.  Motion and Structure From Two Perspective Views: Algorithms, Error Analysis, and Error Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[15]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[16]  Zhengyou Zhang.  Motion and structure from two perspective views: from essential parameters to Euclidean motion through the fundamental matrix , 1997 .

[17]  Alain Fournier.  Illumination Problems in Computer Augmented Reality , 1994 .

[18]  Thomas P. Caudell,et al.  Calibration of head-mounted displays for augmented reality applications , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[19]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Shumin Zhai,et al.  Applications of augmented reality for human-robot communication , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[21]  W. Eric L. Grimson,et al.  An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Roger Y. Tsai,et al.  Techniques for calibration of the scale factor and image center for high accuracy 3D machine vision metrology , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[23]  David E. Breen,et al.  Distributed Augmented Reality for Collaborative Design Applications , 1995, Comput. Graph. Forum.

[24]  John F. Hughes,et al.  Autocalibration for virtual environments tracking hardware , 1993, SIGGRAPH.