A framework for realistic image synthesis

Our goal is to develop physically based lighting models and perceptually based rendering procedures for computer graphics that will produce synthetic images that are visually and measurably indistinguishable from real-world images. Fidelity of the physical simulation is of primary concern. Our research framework is subdivided into three sub-sections: the local light reflection model, the energy transport simulation, and the visual display algorithms. The first two subsections are physically based, and the last is perceptually based. We emphasize the comparisons between simulations and actual measurements, the difficulties encountered, and the need to utilize the vast amount of psychophysical research already conducted. Future research directions are enumerated. We hope that results of this research will help establish a more fundamental, scientific approach for future rendering algorithms. This presentation describes a chronology of past research in global illumination and how parts of our new system are currently being developed.

[1]  Paul S. Heckbert.  Adaptive radiosity textures for bidirectional ray tracing , 1990, SIGGRAPH.

[2]  Turner Whitted,et al.  An improved illumination model for shaded display , 1979, CACM.

[3]  Steven Collins,et al.  Adaptive Splatting for Specular to Diffuse Light Transport , 1995 .

[4]  Donald P. Greenberg,et al.  Non-linear approximation of reflectance functions , 1997, SIGGRAPH.

[5]  Donald P. Greenberg,et al.  The hemi-cube: a radiosity solution for complex environments , 1985, SIGGRAPH.

[6]  Leonidas J. Guibas,et al.  Optimally combining sampling techniques for Monte Carlo rendering , 1995, SIGGRAPH.

[7]  Arthur Appel,et al.  Some techniques for shading machine renderings of solids , 1968, AFIPS Spring Joint Computing Conference.

[8]  Gary W. Meyer,et al.  A frequency based ray tracer , 1995, SIGGRAPH.

[9]  Peter Schröder,et al.  Spherical wavelets: efficiently representing functions on the sphere , 1995, SIGGRAPH.

[10]  Robert L. Cook,et al.  A Reflectance Model for Computer Graphics , 1987, TOGS.

[11]  James T. Kajiya,et al.  Anisotropic reflection models , 1985, SIGGRAPH.

[12]  C. G. Mueller,et al.  FREQUENCY OF SEEING FUNCTIONS FOR INTENSITY DISCRIMINATION AT VARIOUS LEVELS OF ADAPTING INTENSITY , 1951, The Journal of general physiology.

[13]  Stephen H. Westin,et al.  Predicting reflectance functions from complex surfaces , 1992, SIGGRAPH.

[14]  Eric P. Lafortune,et al.  Mathematical Models and Monte Carlo Algorithms for Physically Based Rendering , 1995 .

[15]  Holly E. Rushmeier,et al.  Tone reproduction for realistic images , 1993, IEEE Computer Graphics and Applications.

[16]  Jr Meyer.  Color calculations for and perceptual assessment of computer graphic images , 1983 .

[17]  Donald P. Greenberg,et al.  A comprehensive physical model for light reflection , 1991, SIGGRAPH.

[18]  Samuel P. Uselton,et al.  Smooth B-spline illumination maps for bidirectional ray tracing , 1995, TOGS.

[19]  Robert L. Cook,et al.  Distributed ray tracing , 1984, SIGGRAPH.

[20]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[21]  Gary W. Meyer,et al.  Wavelength dependent reflectance functions , 1994, SIGGRAPH.

[22]  James Arvo,et al.  A clustering algorithm for radiosity in complex environments , 1994, SIGGRAPH.

[23]  Donald P. Greenberg,et al.  A radiosity method for non-diffuse environments , 1986, SIGGRAPH.

[24]  Andrea J. van Doorn,et al.  Bidirectional Reflection Distribution Function Expressed in Terms of Surface Scattering Modes , 1996, ECCV.

[25]  Pat Hanrahan,et al.  A rapid hierarchical radiosity algorithm , 1991, SIGGRAPH.

[26]  Sumanta N. Pattanaik,et al.  Computational Methods for Global Illumination and Visual-isation of Complex 3D Environments , 1993 .

[27]  David Salesin,et al.  A fast and accurate light reflection model , 1992, SIGGRAPH.

[28]  Thomas A. Leonard,et al.  Results Of A CO2 BRDF Round Robin , 1990, Optics & Photonics.

[29]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[30]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[31]  D. H. Kelly.  Visual response to time-dependent stimuli. I. Amplitude sensitivity measurements. , 1961, Journal of the Optical Society of America.

[32]  Donald P. Greenberg,et al.  A two-pass solution to the rendering equation: A synthesis of ray tracing and radiosity methods , 1987, SIGGRAPH.

[33]  WhittedTurner.  An improved illumination model for shaded display , 1979 .

[34]  Robert P. Breault,et al.  Stray light and contamination in optical systems : 17-19 August 1988, San Diego, California , 1989 .

[35]  Shree K. Nayar,et al.  Generalization of Lambert's reflectance model , 1994, SIGGRAPH.

[36]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[37]  Seth J. Teller,et al.  Partitioning and ordering large radiosity computations , 1994, SIGGRAPH.

[38]  Samuel P. Uselton,et al.  Statistically optimized sampling for distributed ray tracing , 1985, SIGGRAPH.

[39]  Donald P. Greenberg,et al.  Perceptual color spaces for computer graphics , 1980, SIGGRAPH '80.

[40]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[41]  B. Silverman.  Density estimation for statistics and data analysis , 1986 .

[42]  Don P. Mitchell,et al.  Generating antialiased images at low sampling densities , 1987, SIGGRAPH.

[43]  A RednerRichard,et al.  Smooth B-spline illumination maps for bidirectional ray tracing , 1995 .

[44]  M. H. Pirenne,et al.  VISION AND THE EYE , 1949 .

[45]  Greg Ward,et al.  A Contrast-Based Scalefactor for Luminance Display , 1994, Graphics Gems.

[46]  Alain Fournier,et al.  Separating Reflection Functions for Linear Radiosity , 1995, Rendering Techniques.

[47]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[48]  Donald P. Greenberg,et al.  Physically-based glare effects for digital images , 1995, SIGGRAPH.

[49]  Dani Lischinski,et al.  Combining hierarchical radiosity and discontinuity meshing , 1993, SIGGRAPH.

[50]  M. A. Bouman,et al.  Spatial Modulation Transfer in the Human Eye , 1967 .

[51]  Donald S. Fussell,et al.  Adaptive mesh generation for global diffuse illumination , 1990, SIGGRAPH.

[52]  Michael F. Cohen,et al.  A Radiosity Solution for Complex Environments , 1997 .

[53]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[54]  Donald P. Greenberg,et al.  Modeling the interaction of light between diffuse surfaces , 1984, SIGGRAPH.

[55]  Genevieve Greenwald-Katz,et al.  Computers in architecture , 1976, AFIPS '76.

[56]  Stephen H. Westin,et al.  A global illumination solution for general reflectance distributions , 1991, SIGGRAPH.

[57]  Nelson L. Max,et al.  Bidirectional reflection functions from surface bump maps , 1987, SIGGRAPH.

[58]  Bui Tuong Phong.  Illuminat~on for computer generated images , 1973 .

[59]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[60]  J. Mollon.  Color vision. , 1982, Annual review of psychology.

[61]  Donald P. Greenberg,et al.  Fitting virtual lights for non-diffuse walkthroughs , 1997, SIGGRAPH.

[62]  Holly E. Rushmeier,et al.  A progressive multi-pass method for global illumination , 1991, SIGGRAPH.

[63]  James F. Blinn,et al.  Models of light reflection for computer synthesized pictures , 1977, SIGGRAPH.

[64]  Pierre Poulin,et al.  A model for anisotropic reflection , 1990, SIGGRAPH.

[65]  Leslie D. Stroebel.  Photographic materials and processes , 1986 .

[66]  E. Adelson.  Perceptual organization and the judgment of brightness. , 1993, Science.

[67]  Donald P. Greenberg,et al.  Global illumination using local linear density estimation , 1997, TOGS.

[68]  Donald P. Greenberg,et al.  A model of visual masking for computer graphics , 1997, SIGGRAPH.

[69]  Gregory J. Ward,et al.  The RADIANCE lighting simulation and rendering system , 1994, SIGGRAPH.

[70]  Pat Hanrahan,et al.  Reflection from layered surfaces due to subsurface scattering , 1993, SIGGRAPH.