Integration of real and virtual light sources in augmented reality worlds

A number of issues need to be taken into consideration for the output of an augmented reality application to appear realistic. Such issues include the level of detail of the virtual scene, the accuracy of alignment between the two worlds and the correspondence of illumination between the real and virtual components. This paper reviews registration techniques used to perform the alignment process and discusses a research project that investigates methods matching light conditions. Although a number of registration techniques exist, feature based registration has not yet achieved popularity within production environments because of the associated difficulties. Instead, fiducial marker based systems are being implemented for their robustness and ease of implementation. Further work to be undertaken is discussed towards the end of the paper.

[1]  Maarten Vergauwen,et al.  Augmented Reality Using Uncalibrated Video Sequences , 2000, SMILE.

[2]  Ryo Hirose,et al.  A vision-based AR registration method utilizing edges and vertices of 3D model , 2005, ICAT '05.

[3]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Wan Kyun Chung,et al.  Data Association Using Visual Object Recognition for EKF-SLAM in Home Environment , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Tom Drummond,et al.  Going out: robust model-based tracking for outdoor augmented reality , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[6]  Vincent Lepetit,et al.  Fully automated and stable registration for augmented reality applications , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[7]  Nassir Navab,et al.  Visual marker detection and decoding in AR systems: a comparative study , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[8]  Zhongfei Zhang,et al.  Systematic static shadow detection , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[9]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[10]  Céline Loscos,et al.  Classification of Illumination Methods for Mixed Reality , 2006, Comput. Graph. Forum.

[11]  Reinhold Behringer,et al.  Registration for outdoor augmented reality applications using computer vision techniques and hybrid sensors , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[12]  Khoi Nguyen,et al.  Computer-vision-based registration techniques for augmented reality , 1996, Other Conferences.

[13]  Suya You,et al.  Tracking with omni-directional vision for outdoor AR systems , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[14]  Yang Wang,et al.  Estimation of multiple directional light sources for synthesis of augmented reality images , 2002, Graph. Model..

[15]  David G. Lowe,et al.  What and Where: 3D Object Recognition with Accurate Pose , 2006, Toward Category-Level Object Recognition.

[16]  David G. Lowe,et al.  Scene modelling, recognition and tracking with invariant image features , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[17]  Olfa Besbes,et al.  Moving shadow detection with support vector domain description in the color ratios space , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[18]  Stephen DiVerdi,et al.  Implicit 3D modeling and tracking for anywhere augmentation , 2007, VRST '07.

[19]  Céline Loscos,et al.  Automatic generation of consistent shadows for augmented reality , 2005, Graphics Interface.

[20]  Bruce H. Thomas,et al.  First Person Indoor/Outdoor Augmented Reality Application: ARQuake , 2002, Personal and Ubiquitous Computing.

[21]  Gui Yun Tian,et al.  Comprehensive interest points based imaging mosaic , 2003, Pattern Recognit. Lett..

[22]  David E. Breen,et al.  Calibration Requirements and Procedures for a Monitor-Based Augmented Reality System , 1995, IEEE Trans. Vis. Comput. Graph..

[23]  Bruce H. Thomas,et al.  The Tinmith System - Demonstrating New Techniques for Mobile Augmented Reality Modelling , 2002, AUIC.

[24]  Haeyong Chung,et al.  Distributed metric calibration of ad hoc camera networks , 2006, TOSN.

[25]  Volker Coors,et al.  Matching buildings: pose estimation in an urban environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[26]  Andrew W. Fitzgibbon,et al.  Markerless tracking using planar structures in the scene , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[27]  William B. Thompson,et al.  Geometric Reasoning for Map-Based Localization , 1996 .

[28]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[29]  Tom Drummond,et al.  Fusing points and lines for high performance tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[30]  Gustavo Patow,et al.  A Survey of Inverse Rendering Problems , 2003, Comput. Graph. Forum.

[31]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[32]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[33]  Werner Hartmann,et al.  A real-time shadow approach for an augmented reality application using shadow volumes , 2003, VRST '03.

[34]  Yan Feng,et al.  Estimation of Light Source Environment for Illumination Consistency of Augmented Reality , 2008, 2008 Congress on Image and Signal Processing.