High dynamic range imaging

Current display devices can display only a limited range of contrast and colors, which is one of the main reasons that most image acquisition, processing, and display techniques use no more than eight bits per color channel. This course outlines recent advances in high-dynamic-range imaging, from capture to display, that remove this restriction, thereby enabling images to represent the color gamut and dynamic range of the original scene rather than the limited subspace imposed by current monitor technology. This hands-on course teaches how high-dynamic-range images can be captured, the file formats available to store them, and the algorithms required to prepare them for display on low-dynamic-range display devices. The trade-offs at each stage, from capture to display, are assessed, allowing attendees to make informed choices about data-capture techniques, file formats, and tone-reproduction operators. The course also covers recent advances in image-based lighting, in which HDR images can be used to illuminate CG objects and realistically integrate them into real-world scenes. Through practical examples taken from photography and the film industry, it shows the vast improvements in image fidelity afforded by high-dynamic-range imaging.

[1]  Parry Moon,et al.  THE VISUAL EFFECT OF NON-UNIFORM SURROUNDS: , 1945 .

[2]  I. W. Busbridge The Mathematics of Radiative Transfer. , 1960 .

[3]  John E. Kaufman IES lighting handbook : the standard lighting guide , 1966 .

[4]  A. Oppenheim,et al.  Nonlinear filtering of multiplied and convolved signals , 1968 .

[5]  Jr. Thomas G. Stockham,et al.  Image processing in the context of a visual model , 1972 .

[6]  Werner Frei,et al.  Image Enhancement by Histogram Hyperbolization , 1977 .

[7]  Robert L. Cook,et al.  A Reflectance Model for Computer Graphics , 1987, TOGS.

[8]  David D. Miller,et al.  The Application of Computer Graphics in Lighting Design , 1984 .

[9]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[10]  Donald P. Greenberg,et al.  An experimental evaluation of computer graphics imagery , 1986, TOGS.

[11]  Yoshiaki Shirai,et al.  Three-Dimensional Computer Vision , 1987, Symbolic Computation.

[12]  Kenneth E. Torrance,et al.  The zonal method for calculating light intensities in the presence of a participating medium , 1987, SIGGRAPH.

[13]  Jean-Charles Pinoli,et al.  A model for logarithmic image processing , 1988 .

[14]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[15]  Roy Hall,et al.  Illumination and Color in Computer Generated Imagery , 1988, Monographs in Visual Communication.

[16]  Takashi Okamoto,et al.  A lighting model aiming at drive simulators , 1990, SIGGRAPH.

[17]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[18]  Donald P. Greenberg,et al.  A comprehensive physical model for light reflection , 1991, SIGGRAPH.

[19]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[20]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[21]  A. Fournier,et al.  Common Illumination between Real and Computer Generated Scenes , 1992 .

[22]  A. Mokrane,et al.  A new image contrast enhancement technique based on a contrast discrimination model , 1992, CVGIP Graph. Model. Image Process..

[23]  B. C. Madden,et al.  Extended Intensity Range Imaging , 1993 .

[24]  Holly E. Rushmeier,et al.  Tone reproduction for realistic images , 1993, IEEE Computer Graphics and Applications.

[25]  Kenneth Chiu,et al.  Spatially Nonuniform Scaling Functions for High Contrast Images , 1993 .

[26]  Katsushi Ikeuchi,et al.  Temporal-color space analysis of reflection , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Gary W. Meyer,et al.  Wavelength dependent reflectance functions , 1994, SIGGRAPH.

[28]  Steve Mann,et al.  ON BEING `UNDIGITAL' WITH DIGITAL CAMERAS: EXTENDING DYNAMIC RANGE BY COMBINING DIFFERENTLY EXPOSED PICTURES , 1995 .

[29]  Richard Szeliski,et al.  Image mosaicing for tele-reality applications , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[30]  Claude Puech,et al.  Radiosity and global illumination , 1994 .

[31]  Olivier D. Faugeras,et al.  3-D scene representation as a collection of images , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[32]  Gregory J. Ward,et al.  The RADIANCE lighting simulation and rendering system , 1994, SIGGRAPH.

[33]  James Arvo,et al.  Graphics Gems II , 1994 .

[34]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[35]  Christophe Schlick,et al.  Quantization Techniques for Visualization of High Dynamic Range Pictures , 1995 .

[36]  Christine D. Piatko,et al.  Comparing Real and Synthetic Images: Some Ideas about Metrics , 1995, Rendering Techniques.

[37]  Andrew S. Glassner,et al.  Principles of Digital Image Synthesis , 1995 .

[38]  Pat Hanrahan,et al.  A realistic camera model for computer graphics , 1995, SIGGRAPH.

[39]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[40]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[41]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[42]  Andrea J. van Doorn,et al.  Illuminance texture due to surface mesostructure , 1996 .

[43]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[44]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997, SIGGRAPH '97.

[45]  Donald P. Greenberg,et al.  Non-linear approximation of reflectance functions , 1997, SIGGRAPH.

[46]  Christine D. Piatko,et al.  A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes , 1997, IEEE Trans. Vis. Comput. Graph..

[47]  Gavin S. P. Miller,et al.  Lazy Decompression of Surface Light Fields for Precomputed Global Illumination , 1998, Rendering Techniques.

[48]  Gregory Ward Larson,et al.  Overcoming Gamut and Dynamic Range Limitations in Digital Images , 1998, CIC.

[49]  Gregory Ward Larson,et al.  LogLuv Encoding for Full-Gamut, High-Dynamic Range Images , 1998, J. Graphics, GPU, & Game Tools.

[50]  Per H. Christensen,et al.  Efficient simulation of light transport in scenes with participating media using photon maps , 1998, SIGGRAPH.

[51]  Donald P. Greenberg,et al.  A multiscale model of adaptation and spatial vision for realistic image display , 1998, SIGGRAPH.

[52]  Yizhou Yu,et al.  Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping , 1998, Rendering Techniques.

[53]  Greg Turk,et al.  LCIS: a boundary hierarchy for detail-preserving contrast reduction , 1999, SIGGRAPH.

[54]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[55]  Sabine Süsstrunk,et al.  Chromatic adaptation performance of different RGB sensors , 2000, IS&T/SPIE Electronic Imaging.

[56]  Changjun Li,et al.  Simplification of the CMCCAT97 , 2000, Color Imaging Conference.

[57]  Werner Purgathofer,et al.  Combined Rendering of Polarization and Fluorescence Effects , 2001, Rendering Techniques.

[58]  H. Jensen Realistic Image Synthesis Using Photon Mapping , 2001 .

[59]  Steve Marschner,et al.  A practical model for subsurface light transport , 2001, SIGGRAPH.

[60]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[61]  F. Durand,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002, ACM Trans. Graph..

[62]  Michael Ashikhmin,et al.  A Tone Mapping Algorithm for High Contrast Images , 2002, Rendering Techniques.

[63]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[64]  Greg Ward,et al.  Fast, Robust Image Registration for Compositing High Dynamic Range Photographs from Hand-Held Exposures , 2003, J. Graphics, GPU, & Game Tools.

[65]  G. Ward,et al.  54.2: A High Dynamic Range Display Using Low and High Resolution Modulators , 2003 .

[66]  Frédéric H. Pighin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH Courses.