Integrating synthetic objects into real scenes

Abstract This paper presents a methodology for integrating synthetic objects into real scenes. We take a set of photographs of the real scene and build a simple image-based model. We use high dynamic range images to build an accurate representation of the lighting in the scene. Then we insert a synthetic object into the model and compute its illumination and shading using the lighting information. Illumination changes produced by the synthetic object are also applied to real-scene objects located nearby. We show how easy it is to achieve photo-realistic results without specialized hardware. Our approach takes advantage of techniques like automatic camera calibration, high dynamic range image capture and image-based lighting.

[1]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[2]  Tim Wittenburg.  Photo-Based 3D Graphics in C++: Compositing, Warping, Morphing, and Other Digital Special Effects , 1995 .

[3]  P. Kam,et al.  : 4 , 1898, You Can Cross the Massacre on Foot.

[4]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[5]  S. Wassertheurer.  Photo-based 3D graphics in C++ , 1997 .

[6]  Tomoyuki Nishita,et al.  A montage method: the overlaying of the computer generated images onto a background photograph , 1986, SIGGRAPH.

[7]  Jean-Philippe Tarel,et al.  RES: computing the interactions between real and virtual objects in video sequences , 1995 .

[8]  Katsushi Ikeuchi,et al.  Acquiring a Radiance Distribution to Superimpose Virtual Objects onto Real Scene , 2001, MVA.

[9]  T. Ronald,et al.  Azuma A Survey of Augmented Reality , 2022 .

[10]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  G. W. Larson,et al.  Rendering with radiance - the art and science of lighting visualization , 2004, Morgan Kaufmann series in computer graphics and geometric modeling.

[12]  大野 義夫,et al.  Computer Graphics : Principles and Practice, 2nd edition, J.D. Foley, A.van Dam, S.K. Feiner, J.F. Hughes, Addison-Wesley, 1990 , 1991 .

[13]  Westone,et al.  Home Page , 2004, 2022 2nd International Conference on Intelligent Cybernetics Technology & Applications (ICICyTA).

[14]  Pierre Poulin,et al.  Interactive Virtual Relighting and Remodeling of Real Scenes , 1999, Rendering Techniques.

[15]  George Drettakis,et al.  Interactive Common Illumination for Computer Augmented Reality , 1997, Rendering Techniques.

[16]  Kiriakos N. Kutulakos,et al.  Calibration-Free Augmented Reality , 1998, IEEE Trans. Vis. Comput. Graph..

[17]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[18]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[19]  Paul E. Debevec,et al.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 1998, SIGGRAPH '08.

[20]  Jeffrey J. McConnell.  United States: computer graphics education in computer science undergoing a transformation , 1996, COMG.

[21]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[22]  A. Fournier,et al.  Common Illumination between Real and Computer Generated Scenes , 1992 .

[23]  Simon Gibson,et al.  Interactive Rendering with Real-World Illumination , 2000, Rendering Techniques.

[24]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1992, SIGGRAPH.