Goniometric Light Reconstruction for Augmented Reality Image Synthesis

Reconstruction of light and material properties from digital photographs is a challenging problem. We describe a new image-based approach for the reconstruction of light and material properties from a set of photographs. Using these values in a lighting simulation makes it possible to augment the photograph with correct lighting conditions in all regions of the photograph. Since light sources are the most important component for the correct appearance of virtual objects, special emphasis is put on the reconstruction of a light goniometric as a realistic light source description. Furthermore we describe a new data structure to rapidly detect changing regions in the photograph for a fast update after moving objects. For high quality images we show how to use anti-aliasing techniques to improve the display quality especially at the edges between real and synthetic objects.

[1]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[2]  Norman I. Badler,et al.  User-controlled physics-based animation for articulated figures , 1996, Proceedings Computer Animation '96.

[3]  F.W. Da Silva,et al.  An architecture for motion capture based animation , 1997, Proceedings X Brazilian Symposium on Computer Graphics and Image Processing.

[4]  Bonnie Lee Appleton.  Patterns and Software: Essential Concepts and Terminology , 1997 .

[5]  Katsushi Ikeuchi,et al.  Illumination Distribution from Brightness in Shadows: Adaptive Estimation of Illumination Distribution with Unknown Reflectance Properties in Shadow Regions , 1999, ICCV.

[6]  Jessica K. Hodgins,et al.  Adapting simulated behaviors for new characters , 1997, SIGGRAPH.

[7]  David C. Brogan,et al.  Dynamically simulated characters in virtual environments , 1998, SIGGRAPH '97.

[8]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[9]  A. Fournier,et al.  Common Illumination between Real and Computer Generated Scenes , 1992 .

[10]  J. McCarthy.  Situations, Actions, and Causal Laws , 1963 .

[11]  Bruce Blumberg,et al.  Multi-level direction of autonomous creatures for real-time virtual environments , 1995, SIGGRAPH.

[12]  Tomoyuki Nishita,et al.  A montage method: the overlaying of the computer generated images onto a background photograph , 1986, SIGGRAPH.

[13]  Mao-Jiun J. Wang,et al.  Image thresholding by minimizing the measures of fuzzines , 1995, Pattern Recognit..

[14]  Katsushi Ikeuchi,et al.  Acquiring a Radiance Distribution to Superimpose Virtual Objects onto Real Scene , 2001, MVA.

[15]  Mary M. Galloway,et al.  Texture analysis using gray level run lengths , 1974 .

[16]  Philipp Slusallek,et al.  Rendering Techniques ’97: Proceedings of the Eurographics Workshop in St. Etienne, France, June 16–18, 1997 , 1997, Eurographics.

[17]  Michiel van de Panne,et al.  Motion synthesis by example , 1996 .

[18]  H. Wartenberg,et al.  Cytologie, Histologie und mikroskopische Anatomie des Menschen , 1989 .

[19]  Sean S. B. Moore,et al.  FFTs for the 2-Sphere-Improvements and Variations , 1996 .

[20]  A Straw,et al.  Guide to the Software Engineering Body of Knowledge , 1998 .

[21]  Andrew W. Fitzgibbon,et al.  Direct least squares fitting of ellipses , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[22]  Pierre Poulin,et al.  Interactive Virtual Relighting and Remodeling of Real Scenes , 1999, Rendering Techniques.

[23]  George Drettakis,et al.  Interactive Common Illumination for Computer Augmented Reality , 1997, Rendering Techniques.

[24]  Glorianna Davenport.  Smarter Tools for Storytelling: Are They Just Around the Corner? , 1996, IEEE MultiMedia.

[25]  N. Magnenat-Thalmann,et al.  Motion Control of Virtual Humans , 1998, IEEE Computer Graphics and Applications.

[26]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[27]  John David Funge,et al.  Making them behave: cognitive models for computer animation , 1998 .

[28]  Kelvin Sung,et al.  Design and implementation of the Maya Renderer , 1998, Proceedings Pacific Graphics '98. Sixth Pacific Conference on Computer Graphics and Applications (Cat. No.98EX208).

[29]  Paul E. Debevec,et al.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 1998, SIGGRAPH '08.

[30]  Steve Hollasch,et al.  Advanced animation and rendering techniques , 1994, Comput. Graph..

[31]  George Drettakis,et al.  Interactive update of global illumination using a line-space hierarchy , 1997, SIGGRAPH.

[32]  Daniel Thalmann,et al.  Pro-actively Interactive Evolution for Computer Animation , 1999, Computer Animation and Simulation.

[33]  Ben Delaney.  On the Trail of the Shadow Woman: The Mystery of Motion Capture , 1998, IEEE Computer Graphics and Applications.