3D unsharp masking for scene coherent enhancement

We present a new approach for enhancing local scene contrast by unsharp masking over arbitrary surfaces under any form of illumination. Our adaptation of a well-known 2D technique to 3D interactive scenarios is designed to aid viewers in tasks like understanding complex or detailed geometric models, medical visualization and navigation in virtual environments. Our holistic approach enhances the depiction of various visual cues, including gradients from surface shading, surface reflectance, shadows, and highlights, to ease estimation of viewpoint, lighting conditions, shapes of objects and their world-space organization. Motivated by recent perceptual findings on 3D aspects of the Cornsweet illusion, we create scene coherent enhancements by treating cues in terms of their 3D context; doing so has a stronger effect than approaches that operate in a 2D image context and also achieves temporal coherence. We validate our unsharp masking in 3D with psychophysical experiments showing that the enhanced images are perceived to have better contrast and are preferred over unenhanced originals. Our operator runs at real-time rates on a GPU and the effect is easily controlled interactively within the rendering pipeline.

[1]  P. Cavanagh,et al.  Shape from shadows. , 1989, Journal of experimental psychology. Human perception and performance.

[2]  Karol Myszkowski,et al.  Apparent Greyscale: A Simple and Fast Conversion to Perceptually Accurate Images and Video , 2008, Comput. Graph. Forum.

[3]  D Purves,et al.  An Empirical Explanation of the Cornsweet Effect , 1999, The Journal of Neuroscience.

[4]  Tom N. Cornsweet,et al.  II – THE EXPERIMENT OF HECHT, SCHLAER, AND PIRENNE , 1970 .

[5]  Hans-Peter Seidel,et al.  Contrast Restoration by Adaptive Countershading , 2007, Comput. Graph. Forum.

[6]  A. Torralba,et al.  Specular reflections and the perception of shape. , 2004, Journal of vision.

[7]  Adam Finkelstein,et al.  Interactive rendering of suggestive contours with temporal coherence , 2004, NPAR '04.

[8]  R. Haber,et al.  Visual Perception , 2018, Encyclopedia of Database Systems.

[9]  Stefan Bruckner,et al.  Enhancing Depth-Perception with Flexible Volumetric Halos , 2007, IEEE Transactions on Visualization and Computer Graphics.

[10]  Szymon Rusinkiewicz,et al.  Exaggerated shading for depicting shape and detail , 2006, ACM Trans. Graph..

[11]  F. Kingdom,et al.  Border effects on brightness: a review of findings, models and issues. , 1988, Spatial vision.

[12]  Mohammad Ali Badamchizadeh,et al.  Comparative study of unsharp masking methods for image enhancement , 2004, Third International Conference on Image and Graphics (ICIG'04).

[13]  Paolo Cignoni,et al.  A simple normal enhancement technique for interactive non-photorealistic renderings , 2005, Comput. Graph..

[14]  Adam Finkelstein,et al.  Stylized shadows , 2007, NPAR '07.

[15]  Gabriel Taubin,et al.  A signal processing approach to fair surface design , 1995, SIGGRAPH.

[16]  Timo Aila,et al.  Meshless Finite Elements for Hierarchical Global Illumination , 2007 .

[17]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[18]  Oliver Deussen,et al.  Image enhancement by unsharp masking the depth buffer , 2006, SIGGRAPH 2006.

[19]  Paolo Cignoni,et al.  Ambient Occlusion and Edge Cueing for Enhancing Real Time Molecular Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[20]  Wenjun Zeng,et al.  An overview of the visual optimization tools in JPEG 2000 , 2002, Signal Process. Image Commun..