Exploiting entropy masking in perceptual graphic rendering

Abstract Since the human visual system (HVS) is the ultimate appreciator of most photorealistically rendered images, rendering process can be accelerated by exploiting the properties of the HVS. According to the concept of entropy masking, the HVS is not sensitive to visual distortions in unstructured visual signals. For structured regions, pixels are highly correlated, while the similarity among pixels in unstructured regions is low. In this paper, we detect unstructured regions by extracting local patches from each pixel and its neighboring pixels, and comparing the similarity between the local patches of the center pixel and the neighboring pixels. We further exploit entropy masking in perceptual rendering, and experimental results demonstrate that the proposed method can accelerate rendering, without degrading the perceived quality of resultant images.

[1]  HeidrichWolfgang,et al.  HDR-VDP-2 , 2011 .

[2]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[3]  V. Bruce,et al.  Visual perception: physiology, psychology and ecology. Fourth edition , 2003 .

[4]  Gary W. Meyer,et al.  A perceptually based adaptive sampling algorithm , 1998, SIGGRAPH.

[5]  Libor Vása,et al.  Dihedral Angle Mesh Error: a fast perception correlated distortion measure for fixed connectivity triangle meshes , 2012, Comput. Graph. Forum.

[6]  Santi P. Maity,et al.  DHT domain digital watermarking with low loss in image informations , 2010 .

[7]  Donald P. Greenberg,et al.  Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments , 2001, TOGS.

[8]  Pradeep Sen,et al.  Removing the Noise in Monte Carlo Rendering with General Image Denoising Algorithms , 2013, Comput. Graph. Forum.

[9]  Kai Wang,et al.  A fast roughness-based approach to the assessment of 3D mesh visual quality , 2012, Comput. Graph..

[10]  Kurt Debattista,et al.  A GPU based saliency map for high-fidelity selective rendering , 2006, AFRIGRAPH '06.

[11]  Karol Myszkowski,et al.  Perception-Based Fast Rendering and Antialiasing of Walkthrough Sequences , 2000, IEEE Trans. Vis. Comput. Graph..

[12]  Karol Myszkowski,et al.  Perceptually-Informed Accelerated Rendering of High Quality Walkthrough Sequences , 1999, Rendering Techniques.

[13]  Greg Humphreys,et al.  Physically Based Rendering, Second Edition: From Theory To Implementation , 2010 .

[14]  Donald P. Greenberg,et al.  A perceptually based physical error metric for realistic image synthesis , 1999, SIGGRAPH.

[15]  Donald P. Greenberg,et al.  Using Perceptual Texture Masking for Efficient Image Synthesis , 2002, Comput. Graph. Forum.

[16]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[17]  Donald P. Greenberg,et al.  A model of visual masking for computer graphics , 1997, SIGGRAPH.

[18]  Sarah H. Creem-Regehr,et al.  Visual Perception from a Computer Graphics Perspective , 2011 .

[19]  Andrew P. Bradley,et al.  Perceptual quality metrics applied to still image compression , 1998, Signal Process..

[20]  Dirk Bartz,et al.  State-of-the-Art of the Role of Perception for Computer Graphics , 2008 .

[21]  Hans-Peter Seidel,et al.  Perception-guided global illumination solution for animation rendering , 2001, SIGGRAPH.

[22]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[23]  Irene Cheng,et al.  A Visual Quality Prediction Model for 3D Texture , 2005, Eurographics.

[24]  Shahrokh Ghaemmaghami,et al.  Robustness Enhancement of Content-Based Watermarks Using Entropy Masking Effect , 2005, IWDW.

[25]  Mark A. Georgeson,et al.  Visual perception : physiology, psychology, & ecology , 2003 .

[26]  Patrick Le Callet,et al.  On the performance of human visual system based image quality assessment metric using wavelet domain , 2008, Electronic Imaging.

[27]  Gary W. Meyer,et al.  Perceptually Guided Polygon Reduction , 2008, IEEE Transactions on Visualization and Computer Graphics.

[28]  J. M. Foley,et al.  Contrast masking in human vision. , 1980, Journal of the Optical Society of America.

[29]  Claude E. Shannon,et al.  A mathematical theory of communication , 1948, MOCO.

[30]  Guillaume Lavoué,et al.  A local roughness measure for 3D meshes and its application to visual masking , 2009, TAP.

[31]  Bernice E. Rogowitz,et al.  Are image quality metrics adequate to evaluate the quality of geometric objects? , 2001, IS&T/SPIE Electronic Imaging.

[32]  Andrew B. Watson,et al.  Image quality and entropy masking , 1997, Electronic Imaging.