New acquisition techniques for real objects and light sources in computer graphics

Accurate representations of objects and light sources in a scene model are a crucial prerequisite for realistic image synthesis using computer graphics techniques. This thesis presents techniques for the efficient acquisition of real world objects and real world light sources, as well as an assessment of the quality of the acquired models. Making use of color management techniques, we setup an appearance reproduction pipeline that ensures best-possible reproduction of local light reflection with the available input and output devices. We introduce a hierarchical model for the subsurface light transport in translucent objects, derive an acquisition methodology, and acquire models of several translucent objects that can be rendered interactively. Since geometry models of real world objects are often acquired using 3D range scanners, we also present a method based on the concept of modulation transfer functions to evaluate their accuracy. In order to illuminate a scene with realistic light sources, we propose a method to acquire a model of the near-field emission pattern of a light source with optical prefiltering. We apply this method to several light sources with different emission characteristics and demonstrate the integration of the acquired models into both, global illumination as well as hardware-accelerated rendering systems.

[1]  Shoji Tominaga,et al.  3D Recording and Rendering of Art Paintings , 2001, Color Imaging Conference.

[2]  Hans-Peter Seidel,et al.  Interactive Rendering of Translucent Objects † , 2003, Comput. Graph. Forum.

[3]  J. Koenderink,et al.  Optical properties (bidirectional reflection distribution functions) of velvet. , 1998, Applied optics.

[4]  David Salesin,et al.  Environment matting and compositing , 1999, SIGGRAPH.

[5]  Peter-Pike J. Sloan,et al.  Clustered principal components for precomputed radiance transfer , 2003, ACM Trans. Graph..

[6]  Andrew S. Glassner,et al.  Principles of Digital Image Synthesis , 1995 .

[7]  Christophe Schlick,et al.  An Inexpensive BRDF Model for Physically‐based Rendering , 1994, Comput. Graph. Forum.

[8]  Richard Szeliski,et al.  High dynamic range video , 2003, ACM Trans. Graph..

[9]  Michael F. Cohen,et al.  Radioptimization: goal based rendering , 1993, SIGGRAPH.

[10]  Britton Chance,et al.  Photon Migration and Imaging in Random Media and Tissues , 1993 .

[11]  James F. Blinn,et al.  Models of light reflection for computer synthesized pictures , 1977, SIGGRAPH.

[12]  Yves D. Willems,et al.  Bi-directional path tracing , 1993 .

[13]  Donald P. Greenberg,et al.  Global illumination using local linear density estimation , 1997, TOGS.

[14]  David Salesin,et al.  Surface light fields for 3D photography , 2000, SIGGRAPH.

[15]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[16]  Hans-Peter Seidel,et al.  Efficient Rendering of Local Subsurface Scattering , 2005, Comput. Graph. Forum.

[17]  Hans-Peter Seidel,et al.  Image-based reconstruction of spatial appearance and geometric detail , 2003, TOGS.

[18]  WhittedTurner,et al.  A 3-dimensional representation for fast rendering of complex scenes , 1980 .

[19]  Jos Stam,et al.  Multiple Scattering as a Diffusion Process , 1995, Rendering Techniques.

[20]  Stephen E. Reichenbach,et al.  Characterizing digital image acquisition devices , 1991 .

[21]  Gavin S. P. Miller,et al.  Lazy Decompression of Surface Light Fields for Precomputed Global Illumination , 1998, Rendering Techniques.

[22]  Hans-Peter Seidel,et al.  Interactive Rendering of Translucent Deformable Objects , 2003, Rendering Techniques.

[23]  Claus P. Keferstein,et al.  Testing bench for laser triangulation sensors , 1998 .

[24]  Harold R. Zatz Galerkin radiosity: a higher order solution method for global illumination , 1993, SIGGRAPH.

[25]  M. Levoy,et al.  An assessment of laser range measurement on marble surfaces , 2001 .

[26]  Yves D. Willems,et al.  Rendering Participating Media with Bidirectional Path Tracing , 1996, Rendering Techniques.

[27]  H. Seidel,et al.  DISCO: acquisition of translucent objects , 2004, ACM Trans. Graph..

[28]  I. Ashdown,et al.  Near-Field Photometry: A New Approach , 1993 .

[29]  Mark Meyer,et al.  Implicit fairing of irregular meshes using diffusion and curvature flow , 1999, SIGGRAPH.

[30]  Wojciech Matusik,et al.  Acquisition and Rendering of Transparent and Refractive Objects , 2002, Rendering Techniques.

[31]  Kevin G. Suffern,et al.  Painting with light , 2002, SIGGRAPH '02.

[32]  Turner Whitted,et al.  A 3-dimensional representation for fast rendering of complex scenes , 1980, SIGGRAPH '80.

[33]  Mel Siegel,et al.  General near-zone light source model and its application to computer-automated reflector design , 1996 .

[34]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[35]  Kenneth E. Torrance,et al.  Extending the radiosity method to include specularly reflecting and translucent materials , 1990, TOGS.

[36]  Bui Tuong Phong Illumination for computer generated pictures , 1975, Commun. ACM.

[37]  Steve Mann,et al.  ON BEING `UNDIGITAL' WITH DIGITAL CAMERAS: EXTENDING DYNAMIC RANGE BY COMBINING DIFFERENTLY EXPOSED PICTURES , 1995 .

[38]  Jussi Paakkari,et al.  Method for evaluating the performance of range imaging devices , 1993, Other Conferences.

[39]  Holly E. Rushmeier,et al.  The 3D Model Acquisition Pipeline , 2002, Comput. Graph. Forum.

[40]  Henrik Wann Jensen,et al.  A rapid hierarchical rendering technique for translucent materials , 2005, ACM Trans. Graph..

[41]  Pieter Peers,et al.  Relighting with 4D incident light fields , 2003, ACM Trans. Graph..

[42]  Robert L. Stevenson,et al.  Estimation-theoretic approach to dynamic range enhancement using multiple exposures , 2003, J. Electronic Imaging.

[43]  Michael F. Cohen,et al.  Radiosity and realistic image synthesis , 1993 .

[44]  Arthur Appel,et al.  Some techniques for shading machine renderings of solids , 1968, AFIPS Spring Joint Computing Conference.

[45]  Erik Lindholm,et al.  A user-programmable vertex engine , 2001, SIGGRAPH.

[46]  Ian Ashdown,et al.  Near-Field Photometry: Measuring and Modeling Complex 3-D Light Sources , 1995, SIGGRAPH 1995.

[47]  G.E. Moore,et al.  Cramming More Components Onto Integrated Circuits , 1998, Proceedings of the IEEE.

[48]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[49]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[50]  David Salesin,et al.  Environment matting extensions: towards higher accuracy and real-time capture , 2000, SIGGRAPH.

[51]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[52]  Hans-Peter Seidel,et al.  Building a Photo Studio for Measurement Purposes , 2000, VMV.

[53]  Martial Hebert,et al.  3D measurements from imaging laser radars: how good are they? , 1992, Image Vis. Comput..

[54]  Yukio Okano Influence of Image Enhancement Processing on SFR of Digital Cameras , 1998, PICS.

[55]  G. Toussaint Solving geometric problems with the rotating calipers , 1983 .

[56]  F. E. Nicodemus,et al.  Geometrical considerations and nomenclature for reflectance , 1977 .

[57]  Britton Chance,et al.  Monte Carlo simulations of photon migration path distributions in multiple scattering media , 1993, Photonics West - Lasers and Applications in Science and Engineering.

[58]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[59]  H. Jensen Realistic Image Synthesis Using Photon Mapping , 2001 .

[60]  Alan Edelman,et al.  Modeling and rendering of weathered stone , 1999, SIGGRAPH.

[61]  Paul M. Hubel,et al.  Eyeing the Camera: into the Next Century , 2002, Color Imaging Conference.

[62]  François X. Sillion,et al.  A Unified Hierarchical Algorithm for Global Illumination with Scattering Volumes and Object Clusters , 1995, IEEE Trans. Vis. Comput. Graph..

[63]  Michael S. Foster,et al.  Field-testing protocols for evaluation of 3D imaging focal plane array ladar systems , 2002, SPIE Defense + Commercial Sensing.

[64]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[65]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[66]  Per H. Christensen,et al.  A practical guide to global illumination using photon mapping , 2000, SIGGRAPH 2000.

[67]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[68]  Barry N. Taylor,et al.  Guidelines for Evaluating and Expressing the Uncertainty of Nist Measurement Results , 2017 .

[69]  Per H. Christensen,et al.  Efficient simulation of light transport in scenes with participating media using photon maps , 1998, SIGGRAPH.

[70]  Mark Segal,et al.  Fast shadows and lighting effects using texture mapping , 1992, SIGGRAPH.

[71]  Christophe Schlick,et al.  A Rendering Algorithm for Discrete Volume Density Objects , 1993, Comput. Graph. Forum.

[72]  Mumin Song,et al.  Overview of three-dimensional shape measurement using optical methods , 2000 .

[73]  Hendrik P. A. Lensch,et al.  Efficient, image-based appearance acquisition of real-world objects , 2003 .

[74]  Robert L. Stevenson,et al.  Dynamic range improvement through multiple exposures , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[75]  Michael W. Halle Holographic stereograms as discrete imaging systems , 1994, Electronic Imaging.

[76]  J. Murdoch Inverse Square Law Approximation of Illuminance , 1981 .

[77]  Robert J. Woodham,et al.  Analysing Images of Curved Surfaces , 1981, Artif. Intell..

[78]  C. Benjamin Wooley,et al.  Source modeling for illumination design , 1997, Optics & Photonics.

[79]  S. Marschner,et al.  Inverse Rendering for Computer Graphics , 1998 .

[80]  Hans-Peter Seidel,et al.  A Silhouette-Based Algorithm for Texture Registration and Stitching , 2001, Graph. Model..

[81]  J. Winget,et al.  Finite Element Methods for Global Illumination , 1991 .

[82]  Peter D. Burns,et al.  Diagnostics for Digital Capture Using MTF , 2001, PICS.

[83]  Hans-Peter Seidel,et al.  Accurate light source acquisition and rendering , 2003, ACM Trans. Graph..

[84]  Thomas Malzbender,et al.  Polynomial texture maps , 2001, SIGGRAPH.

[85]  Steve Marschner,et al.  Inverse Lighting for Photography , 1997, CIC.

[86]  Michael Goesele,et al.  3D Data Acquisition , 2002, Eurographics.

[87]  Hans-Peter Seidel,et al.  Color Calibrated High Dynamic Range Imaging with ICC Profiles , 2001, Color Imaging Conference.

[88]  G. Sapiro,et al.  Geometric partial differential equations and image analysis [Book Reviews] , 2001, IEEE Transactions on Medical Imaging.

[89]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[90]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[91]  Pat Hanrahan,et al.  Reflection from layered surfaces due to subsurface scattering , 1993, SIGGRAPH.

[92]  Werner Purgathofer,et al.  Tone Reproduction and Physically Based Spectral Rendering , 2002, Eurographics.

[93]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[94]  Julie Dorsey,et al.  Rendering of Wet Materials , 1999, Rendering Techniques.

[95]  Donald P. Greenberg,et al.  A Comprehensive Light-Source Description for Computer Graphics , 1984, IEEE Computer Graphics and Applications.

[96]  T. Williams The Optical Transfer Function of Imaging Systems , 1998 .

[97]  J. Janesick,et al.  Scientific Charge-Coupled Devices , 2001 .

[98]  Holger Mönch,et al.  P‐81: Source Imaging Goniometer Method of Light Source Characterization for Accurate Projection System Design , 2000 .

[99]  Amitabh Varshney,et al.  Interactive subsurface scattering for translucent meshes , 2003, I3D '03.

[100]  Reinhard Klette,et al.  Computer vision - three-dimensional data from images , 1998 .

[101]  Hans-Peter Seidel,et al.  Validation of Color Managed 3D Appearance Acquisition , 2004, Color Imaging Conference.

[102]  Jos Stam,et al.  An Illumination Model for a Skin Layer Bounded by Rough Surfaces , 2001, Rendering Techniques.

[103]  B. C. Madden,et al.  Extended Intensity Range Imaging , 1993 .

[104]  Hans-Peter Seidel,et al.  Interactive visualization of complex real-world light sources , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[105]  Gustavo Patow,et al.  A Survey of Inverse Rendering Problems , 2003, Comput. Graph. Forum.

[106]  Hans-Peter Seidel,et al.  Accuracy of 3D range scanners by measurement of the slanted edge modulation transfer function , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[107]  Donald P. Greenberg,et al.  Non-linear approximation of reflectance functions , 1997, SIGGRAPH.

[108]  Gabriel Taubin,et al.  A signal processing approach to fair surface design , 1995, SIGGRAPH.

[109]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[110]  Pat Hanrahan,et al.  Monte Carlo evaluation of non-linear scattering equations for subsurface reflection , 2000, SIGGRAPH.

[111]  John C. Hart,et al.  GPU algorithms for radiosity and subsurface scattering , 2003, HWWS '03.

[112]  Steve Marschner,et al.  A practical model for subsurface light transport , 2001, SIGGRAPH.

[113]  A. Karimi,et al.  Master‟s thesis , 2011 .

[114]  Pat Hanrahan,et al.  A signal-processing framework for inverse rendering , 2001, SIGGRAPH.

[115]  Franc¸ois Blais,et al.  Review of 20 years of range sensor development , 2003, IS&T/SPIE Electronic Imaging.

[116]  Michael Goesele,et al.  Image-Based Measurement of Light Sources With Correct Filtering , 2001 .

[117]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[118]  Dinesh K. Pai,et al.  Scanning physical interaction behavior of 3D objects , 2001, SIGGRAPH.

[119]  François Blais Review of 20 years of range sensor development , 2004, J. Electronic Imaging.

[120]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[121]  Henrik Wann Jensen,et al.  Global Illumination using Photon Maps , 1996, Rendering Techniques.

[122]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[123]  Mark Segal,et al.  The OpenGL Graphics System: A Specification , 2004 .

[124]  Marc Stamminger,et al.  Translucent Shadow Maps , 2003, Rendering Techniques.

[125]  Akira Ishimaru,et al.  Wave propagation and scattering in random media , 1997 .

[126]  Ken Perlin,et al.  An image synthesizer , 1988 .

[127]  Graham Dalton Reverse engineering using laser metrology , 1998 .

[128]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[129]  Leonidas J. Guibas,et al.  Bidirectional Estimators for Light Transport , 1995 .