A psychophysical investigation of global illumination algorithms used in augmented reality

The overarching goal of this research was to compare different rendering solutions in order to understand why some yield better results specifically when applied to rendering synthetic objects into real photographs. A psychophysical experiment was conducted in which the composite images were judged for accuracy against the original photograph. In addition, iCAM, an image color appearance model was also used to calculate image differences for the same set of images. Conclusions obtained included the effect of global illumination on the accuracy of the final composite rendering. Also, it was discovered that the original rendering with all of its artifacts is not necessarily an indicator of the final composite image's judged accuracy. Finally, initial results show promise in using iCAM to predict a relationship similar to the psychophysics, which could eventually be used in-the-rendering-loop to achieve photorealism with minimized computation.

[1]  George Drettakis,et al.  Interactive Virtual Relighting of Real Scenes , 2000, IEEE Trans. Vis. Comput. Graph..

[2]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[3]  Roger A. Browse,et al.  Choosing Rendering Parameters for Effective Communication of 3D Shape , 2000, IEEE Computer Graphics and Applications.

[4]  Toby Howard,et al.  Flexible Image‐Based Photometric Reconstruction using Virtual Light Sources , 2001, Comput. Graph. Forum.

[5]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[6]  Mark D. Fairchild,et al.  On the Salience of Novel Stimuli: Adaptation and Image Noise , 2005, CIC.

[7]  Jed Lengyel,et al.  The Convergence of Graphics and Vision , 1998, Computer.

[8]  James A. Ferwerda,et al.  Three varieties of realism in computer graphics , 2003, IS&T/SPIE Electronic Imaging.

[9]  John R. Schott,et al.  Remote Sensing: The Image Chain Approach , 1996 .

[10]  Geoffrey S. Hubona,et al.  The relative contributions of stereo, lighting, and background scenes in promoting 3D depth visualization , 1999, TCHI.

[11]  Ann McNamara,et al.  Comparing Real & Synthetic Scenes using Human Judgements of Lightness , 2000, Rendering Techniques.

[12]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[13]  George Drettakis,et al.  Interactive Common Illumination for Computer Augmented Reality , 1997, Rendering Techniques.

[14]  Gary W. Meyer,et al.  A frequency based ray tracer , 1995, SIGGRAPH.

[15]  R. Berns.  Billmeyer and Saltzman's Principles of Color Technology , 2000 .

[16]  Erik Reinhard,et al.  Fidelity of Graphics Reconstructions: A Psychophysical Investigation , 1998, Rendering Techniques.

[17]  Mark D. Fairchild,et al.  The iCAM Framework for Image Appearance, Image Differences, and Image Quality , 2002 .

[18]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[19]  Roy S. Berns,et al.  Colorimetric Characterization of a Computer-Controlled Liquid Crystal Display , 2004 .

[20]  Mark D. Fairchild,et al.  Image appearance modeling , 2003, IS&T/SPIE Electronic Imaging.

[21]  Ethan D. Montag,et al.  Empirical formula for creating error bars for the method of paired comparison , 2006, J. Electronic Imaging.

[22]  Andrew S. Glassner.  Principles of digital image synthesis. Volume 1 , 1995 .

[23]  Ron Brinkmann,et al.  The Art and Science of Digital Compositing , 1999 .

[24]  Edward Cutrell,et al.  Measuring the Perception of Visual Realism in Images , 2001, Rendering Techniques.

[25]  Roy Hall,et al.  Illumination and Color in Computer Generated Imagery , 1988, Monographs in Visual Communication.

[26]  Katsushi Ikeuchi,et al.  Acquiring a Radiance Distribution to Superimpose Virtual Objects onto Real Scene , 2001, MVA.

[27]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[28]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[29]  Christine D. Piatko,et al.  Comparing Real and Synthetic Images: Some Ideas about Metrics , 1995, Rendering Techniques.

[30]  Donald P. Greenberg,et al.  Perceiving spatial relationships in computer-generated images , 1992, IEEE Computer Graphics and Applications.

[31]  Alain Fournier.  Illumination Problems in Computer Augmented Reality , 1994 .

[32]  Paul Debevec.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 2008, SIGGRAPH Classes.

[33]  Mark D. Fairchild,et al.  Measuring images: differences, quality, and appearance , 2003, IS&T/SPIE Electronic Imaging.

[34]  D. Tolhurst,et al.  The human visual system is optimised for processing the spatial information in natural visual images , 2000, Current Biology.

[35]  Ann McNamara,et al.  Visual Perception in Realistic Image Synthesis , 2001, Comput. Graph. Forum.

[36]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[37]  Mark D. Fairchild,et al.  iCAM framework for image appearance, differences, and quality , 2004, J. Electronic Imaging.

[38]  Jeremy Adam Selan,et al.  MERGING LIVE VIDEO WITH SYNTHETIC IMAGERY , 2003 .

[39]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[40]  Mark D. Fairchild,et al.  Development and Testing of a Color Space (IPT) with Improved Hue Uniformity , 1998, CIC.

[41]  D. Tolhurst,et al.  The effects of amplitude-spectrum statistics on foveal and peripheral discrimination of changes in natural images, and a multi-resolution model , 2005, Vision Research.

[42]  Mark D. Fairchild,et al.  Full-Spectral Color Calculations in Realistic Image Synthesis , 1999, IEEE Computer Graphics and Applications.

[43]  Donald P. Greenberg,et al.  Perceptual illumination components , 2004, ACM Trans. Graph..

[44]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[45]  Fabio Pellacini,et al.  Perceptually-driven decision theory for interactive realistic rendering , 2003, TOGS.

[46]  Donald P. Greenberg,et al.  A multiscale model of adaptation and spatial vision for realistic image display , 1998, SIGGRAPH.

[47]  K. Mullen.  The contrast sensitivity of human colour vision to red‐green and blue‐yellow chromatic gratings. , 1985, The Journal of physiology.

[48]  Alan Watt,et al.  3D Computer Graphics , 1993 .

[49]  Riad I. Hammoud,et al.  Estimating the photorealism of images: distinguishing paintings from photographs , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[50]  C. Alejandro Párraga,et al.  A multiresolution color model for visual difference prediction , 2005, APGV '05.

[51]  Donald P. Greenberg,et al.  A model of visual masking for computer graphics , 1997, SIGGRAPH.

[52]  Donald P. Greenberg,et al.  An experimental evaluation of computer graphics imagery , 1986, TOGS.

[53]  H. Jensen.  Realistic Image Synthesis Using Photon Mapping , 2001 .