Photometric registration by adaptive high dynamic range image generation for augmented reality

This paper describes photometric registration for augmented reality (AR) using a high-dynamic-range (HDR) image. In photorealistic AR, estimating the lighting environment of virtual objects is difficult because of low dynamic range cameras. In order to overcome this problem, we propose a method that estimates the lighting environment from an HDR image and renders virtual objects using an HDR environment map. Virtual objects are overlaid in real-time by adjusting the dynamic range of the rendered image with tone mapping according to the exposure time of the camera. The HDR image is generated from multiple images captured with various exposure times. We have found through experimentation that the updating rate is improved by effectively limiting the dynamic range, depending on the exposure time. We have verified the effect of limiting the dynamic range on the reality of virtual objects.

[1]  Matti Niskanen.  View Dependent Enhancement of the Dynamic Range of Video , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[2]  Ki-Sang Hong,et al.  Extending dynamic range of two color images under different exposures , 2004, ICPR 2004.

[3]  Narendra Ahuja,et al.  Split Aperture Imaging for High Dynamic Range , 2004, International Journal of Computer Vision.

[4]  Katsushi Ikeuchi,et al.  Illumination from Shadows , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[6]  Paul E. Debevec,et al.  Real-Time High Dynamic Range Texture Mapping , 2001, Rendering Techniques.

[7]  Michael Ashikhmin,et al.  A reality check for tone-mapping operators , 2006, TAP.

[8]  Michael Haller,et al.  Image Based Shadowing in Real-Time Augmented Reality , 2006, Int. J. Virtual Real..

[9]  Paul Debevec.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 2008, SIGGRAPH Classes.

[10]  Naokazu Yokoya,et al.  Geometric and photometric registration for real-time augmented reality , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[11]  Li Li,et al.  Photorealistic rendering for augmented reality using environment illumination , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[12]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[13]  Richard Szeliski,et al.  High dynamic range video , 2003, ACM Trans. Graph..

[14]  James F. Blinn,et al.  Texture and reflection in computer generated images , 1976, CACM.

[15]  K. Ikeuchi,et al.  Virtual Kawaradera : Fast Shadow Texture for Augmented Reality , 2004 .

[16]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.