Image Quality Metrics

Advances in image synthesis techniques allow us to simulate the distribution of light energy in a scene with great precision. Unfortunately, this does not ensure that the displayed image will have a high fidelity visual appearance. Reasons for this include the limited dynamic range of displays, any residual shortcomings of the rendering process, and the extent to which human vision encodes such departures from perfect physical realism. Image quality metrics are paramount to provide quantitative data on the fidelity of rendered images. This course addresses techniques to compare real and synthetic images, identify important visual system characteristics and help reduce rendering times significantly. Case studies involving both static and dynamic images are considered. Their different image quality metric requirements are compared and contrasted.

[1]  R. F. Hess,et al.  Temporal properties of human visual filters: number, shapes and spatial covariation , 1992, Vision Research.

[2]  Michael P. Eckert,et al.  The significance of eye movements and image acceleration for coding television image sequences , 1993 .

[3]  Gary W. Meyer,et al.  A frequency based ray tracer , 1995, SIGGRAPH.

[4]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[5]  Andrew S. Glassner,et al.  An introduction to ray tracing , 1989 .

[6]  Christophe Schlick,et al.  An Inexpensive BRDF Model for Physically‐based Rendering , 1994, Comput. Graph. Forum.

[7]  John E. Kaufman,et al.  IES lighting handbook , 1981 .

[8]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[9]  Robert Eriksson,et al.  Modeling the perception of digital images: a performance study , 1998, Electronic Imaging.

[10]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[11]  Donald P. Greenberg,et al.  A Testbed for Image Synthesis , 1991, Eurographics.

[12]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997, SIGGRAPH '97.

[13]  James Arvo,et al.  A framework for realistic image synthesis , 1997, SIGGRAPH.

[14]  Patrick C. Teo,et al.  Perceptual image distortion , 1994, Proceedings of 1st International Conference on Image Processing.

[15]  Roy Hall,et al.  A Testbed for Realistic Image Synthesis , 1983, IEEE Computer Graphics and Applications.

[16]  Benoit M. Macq,et al.  Image quality criterion based on the cancellation of the masked noise , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[17]  Kenneth Chiu,et al.  Spatially Nonuniform Scaling Functions for High Contrast Images , 1993 .

[18]  Roger J. Hubbold,et al.  Perceptually‐Driven Radiosity , 1997, Comput. Graph. Forum.

[19]  Karol Myszkowski,et al.  The Visible Differences Predictor: Applications to Global Illumination Problems , 1998, Rendering Techniques.

[20]  Donald P. Greenberg,et al.  Modeling the interaction of light between diffuse surfaces , 1984, SIGGRAPH.

[21]  Eric P. Lafortune,et al.  Mathematical Models and Monte Carlo Algorithms for Physically Based Rendering , 1995 .

[22]  Holly E. Rushmeier,et al.  Tone reproduction for realistic images , 1993, IEEE Computer Graphics and Applications.

[23]  H. Wilson,et al.  Modified line-element theory for spatial-frequency and width discrimination. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[24]  F. E. Nicodemus,et al.  Geometrical considerations and nomenclature for reflectance , 1977 .

[25]  Claude Puech,et al.  Radiosity and global illumination , 1994 .

[26]  Roman Kuchkuda,et al.  An introduction to ray tracing , 1993, Comput. Graph..

[27]  Karol Myszkowski,et al.  A case study towards validation of global illumination algorithms: progressive hierarchical radiosity with clustering , 2000, The Visual Computer.

[28]  Christine D. Piatko,et al.  Comparing Real and Synthetic Images: Some Ideas about Metrics , 1995, Rendering Techniques.

[29]  Donald P. Greenberg,et al.  A perceptually based physical error metric for realistic image synthesis , 1999, SIGGRAPH.

[30]  Xin Tong,et al.  Video quality evaluation using ST-CIELAB , 1999, Electronic Imaging.

[31]  Donald P. Greenberg,et al.  The hemi-cube: a radiosity solution for complex environments , 1985, SIGGRAPH.

[32]  A. Gilchrist,et al.  Local and global processes in surface lightness perception , 1995, Perception & psychophysics.

[33]  Karol Myszkowski,et al.  An Efficient Cluster-Based Hierarchical Progressive Radiosity Algorithm , 1995, ICSC.

[34]  오승준.  [서평]「Digital Video Processing」 , 1996 .

[35]  Raghu Machiraju,et al.  Steering Image Generation with Wavelet Based Perceptual Metric , 1997, Comput. Graph. Forum.

[36]  Anil C. Kokaram,et al.  Perceptual distortion measure for edgelike artifacts in image sequences , 1998, Electronic Imaging.

[37]  Reginald L. Lagendijk,et al.  Perceptual image quality based on a multiple channel HVS model , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[38]  Tomoyuki Nishita,et al.  Continuous tone representation of three-dimensional objects taking account of shadows and interreflection , 1985, SIGGRAPH '85.

[39]  Erik Reinhard,et al.  Fidelity of Graphics Reconstructions: A Psychophysical Investigation , 1998, Rendering Techniques.

[40]  Dani Lischinski,et al.  Combining hierarchical radiosity and discontinuity meshing , 1993, SIGGRAPH.

[41]  Andrew B. Watson,et al.  Toward a perceptual video-quality metric , 1998, Electronic Imaging.

[42]  James Arvo,et al.  Particle transport and image synthesis , 1990, SIGGRAPH.

[43]  Scott Daly,et al.  Engineering observations from spatiovelocity and spatiotemporal visual models , 1998, Electronic Imaging.

[44]  Michael F. Cohen,et al.  Radiosity and realistic image synthesis , 1993 .

[45]  Arthur Appel,et al.  Some techniques for shading machine renderings of solids , 1968, AFIPS Spring Joint Computing Conference.

[46]  C. Lambrecht.  Perceptual models and architectures for video coding applications , 1996 .

[47]  Joyce H. D. M. Westerink,et al.  Perceived sharpness in moving images , 1990, Other Conferences.

[48]  Leonard McMillan,et al.  Post-rendering 3D warping , 1997, SI3D.

[49]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[50]  Dani Lischinski,et al.  Bounds and error estimates for radiosity , 1994, SIGGRAPH.

[51]  Zygmunt Pizlo,et al.  Image quality assessment with a Gabor pyramid model of the human visual system , 1997, Electronic Imaging.

[52]  D. H. Kelly.  Motion and vision. II. Stabilized spatio-temporal threshold surface. , 1979, Journal of the Optical Society of America.

[53]  Charles J. C. Lloyd,et al.  Design of a spatial-chromatic human vision model for evaluating full-color display systems , 1990, Other Conferences.

[54]  Alan Watt,et al.  3D Computer Graphics , 1993 .

[55]  E. Adelson,et al.  The analysis of moving visual patterns , 1985 .

[56]  Gary W. Meyer,et al.  A perceptually based adaptive sampling algorithm , 1998, SIGGRAPH.

[57]  Xavier Pueyo,et al.  An Image-Space Refinement Criterion for Linear Hierarchical Radiosity , 1997, Graphics Interface.

[58]  Henrik Wann Jensen,et al.  Global Illumination using Photon Maps , 1996, Rendering Techniques.

[59]  Jeffrey B. Mulligan,et al.  Design and performance of a digital video quality metric , 1999, Electronic Imaging.

[60]  Mikio Shinya.  Spatial anti-aliasing for animation sequences with spatio-temporal filtering , 1993, SIGGRAPH.

[61]  J. Painter,et al.  Antialiased ray tracing by adaptive progressive refinement , 1989, SIGGRAPH.

[62]  Stefan Winkler,et al.  Perceptual distortion metric for digital color video , 1999, Electronic Imaging.

[63]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[64]  Donald P. Greenberg,et al.  An Efficient Radiosity Approach for Realistic Image Synthesis , 1986, IEEE Computer Graphics and Applications.

[65]  Dani Lischinski,et al.  Discontinuity meshing for accurate radiosity , 1992, IEEE Computer Graphics and Applications.

[66]  Andrew S. Glassner,et al.  Principles of Digital Image Synthesis , 1995 .

[67]  Andrew B. Watson,et al.  The cortex transform: rapid computation of simulated neural images , 1987 .

[68]  Christoph Zetzsche,et al.  Multiple Channel Model For The Prediction Of Subjective Image Quality , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[69]  François Sillion.  The State of the Art in Physically-based Rendering and its Impact on Future Applications , 1994 .

[70]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[71]  WhittedTurner.  An improved illumination model for shaded display , 1979 .

[72]  Donald P. Greenberg,et al.  Density Estimation Techniques fro Global Illumination , 1998 .

[73]  Albert J. Ahumada,et al.  Color matrix display simulation based on luminance and chromatic contrast sensitivity of early vision , 1992, Electronic Imaging.

[74]  David J. Sakrison,et al.  The effects of a visual fidelity criterion of the encoding of images , 1974, IEEE Trans. Inf. Theory.

[75]  P. J. Burt,et al.  Fast Filter Transforms for Image Processing , 1981 .

[76]  A. Gilchrist,et al.  Perception of Lightness and Illumination in a World of One Reflectance , 1984, Perception.

[77]  Werner Purgathofer,et al.  State of the Art in Perceptually Driven Radiosity , 1998, Eurographics.

[78]  Ann McNamara,et al.  Measures of Lightness Constancy as an index ot the perceptual fidelity of computer graphics , 1998 .

[79]  Karol Myszkowski,et al.  Perceptually-Informed Accelerated Rendering of High Quality Walkthrough Sequences , 1999, Rendering Techniques.

[80]  George Drettakis,et al.  Accurate Visibility and Meshing Calculations for Hierarchical Radiosity , 1996, Rendering Techniques.

[81]  Donald P. Greenberg,et al.  A progressive refinement approach to fast radiosity image generation , 1998 .

[82]  Donald P. Greenberg,et al.  A progressive refinement approach to fast radiosity image generation , 1988, SIGGRAPH.

[83]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[84]  Derek J. Paddon,et al.  Selective Culling of Discontinuity Lines , 1997, Rendering Techniques.

[85]  Don P. Mitchell,et al.  Generating antialiased images at low sampling densities , 1987, SIGGRAPH.

[86]  Robert L. Cook,et al.  Stochastic sampling in computer graphics , 1988, TOGS.

[87]  Andrew S. Glassner,et al.  Space subdivision for fast ray tracing , 1984, IEEE Computer Graphics and Applications.

[88]  L O Harvey,et al.  Identification confusions among letters of the alphabet. , 1984, Journal of experimental psychology. Human perception and performance.

[89]  Donald P. Greenberg,et al.  Global illumination using local linear density estimation , 1997, TOGS.

[90]  P. O. Bishop,et al.  Spatial vision. , 1971, Annual review of psychology.

[91]  Donald P. Greenberg,et al.  A model of visual masking for computer graphics , 1997, SIGGRAPH.

[92]  Takayuki Tanaka,et al.  ARTS: Accelerated Ray-Tracing System , 1986, IEEE Computer Graphics and Applications.

[93]  Gregory J. Ward,et al.  The RADIANCE lighting simulation and rendering system , 1994, SIGGRAPH.

[94]  Donald P. Greenberg,et al.  An experimental evaluation of computer graphics imagery , 1986, TOGS.

[95]  Karol Myszkowski,et al.  Using the visual differences predictor to improve performance of progressive global illumination computation , 2000, TOGS.

[96]  Gary W. Meyer,et al.  Comparison of two image quality models , 1998, Electronic Imaging.

[97]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[98]  Robert L. Cook,et al.  Distributed ray tracing , 1984, SIGGRAPH.