DiCE: dichoptic contrast enhancement for VR and stereo displays

In stereoscopic displays, such as those used in VR/AR headsets, our eyes are presented with two diferent views. The disparity between the views is typically used to convey depth cues, but it could be also used to enhance image appearance. We devise a novel technique that takes advantage of binocular fusion to boost perceived local contrast and visual quality of images. Since the technique is based on ixed tone curves, it has negligible computational cost and it is well suited for real-time applications, such as VR rendering. To control the trade-of between contrast gain and binocular rivalry, we conduct a series of experiments to explain the factors that dominate rivalry perception in a dichoptic presentation where two images of diferent contrasts are displayed. With this new inding, we can efectively enhance contrast and control rivalry in mono-and stereoscopic images, and in VR rendering, as conirmed in validation experiments.

[1]  Greg Ward,et al.  High dynamic range imaging , 2001, SIGGRAPH '04.

[2]  Zhong Ren Local Laplacian Filters and some extensions , 2015 .

[3]  M. M. Taylor,et al.  PEST: Efficient Estimates on Probability Functions , 1967 .

[4]  M. Georgeson,et al.  Contrast constancy: deblurring in human vision by spatial frequency channels. , 1975, The Journal of physiology.

[5]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[6]  Hans-Peter Seidel,et al.  Depth from HDR: depth induction or increased realism? , 2014, SAP.

[7]  Hans-Peter Seidel,et al.  High Dynamic Range Imaging , 2015 .

[8]  R. Blake A Neural Theory of Binocular Rivalry , 1989 .

[9]  F. Rieke,et al.  Single-Photon Absorptions Evoke Synaptic Depression in the Retina to Extend the Operational Range of Rod Vision , 2008, Neuron.

[10]  J. Wolfe Stereopsis and binocular rivalry. , 1986, Psychological review.

[11]  Tien-Tsin Wong,et al.  Binocular tone mapping , 2012, ACM Trans. Graph..

[12]  Christine D. Piatko,et al.  A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes , 1997, IEEE Trans. Vis. Comput. Graph..

[13]  Rafal Mantiuk,et al.  Real-time noise-aware tone mapping , 2015, ACM Trans. Graph..

[14]  W. Levelt,et al.  BINOCULAR BRIGHTNESS AVERAGING AND CONTOUR INFORMATION. , 1965, British journal of psychology.

[15]  Jan Kautz,et al.  Local Laplacian filters: edge-aware image processing with a Laplacian pyramid , 2011, SIGGRAPH 2011.

[16]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, SIGGRAPH 2008.

[17]  F. Kingdom,et al.  Dichoptic color saturation mixture: Binocular luminance contrast promotes perceptual averaging. , 2015, Journal of vision.

[18]  Susan L. Franzel,et al.  Binocularity and visual search , 1988, Perception & psychophysics.

[19]  G. Legge,et al.  Binocular interactions in suprathreshold contrast perception , 1981, Perception & psychophysics.

[20]  F. Kingdom,et al.  Border effects on brightness: a review of findings, models and issues. , 1988, Spatial vision.

[21]  Rafal Mantiuk,et al.  A comparative review of tone‐mapping algorithms for high dynamic range video , 2017, Comput. Graph. Forum.

[22]  Tien-Tsin Wong,et al.  Binocular Tone Mapping with Improved Overall Contrast and Local Details , 2018, Comput. Graph. Forum.

[23]  Tien-Tsin Wong,et al.  Deep binocular tone mapping , 2019, The Visual Computer.

[24]  H. Barlow Vision Science: Photons to Phenomenology by Stephen E. Palmer , 2000, Trends in Cognitive Sciences.

[25]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[26]  Robert Wanat,et al.  Evaluation of Tone Mapping Operators for HDR-Video , 2013, Comput. Graph. Forum.

[27]  Norimichi Kitagawa,et al.  Contrast and Depth Perception: Effects of Texture Contrast and Area Contrast , 2007, Perception.

[28]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, ACM Trans. Graph..

[29]  J. Kulikowski,et al.  Effective contrast constancy and linearity of contrast sensation , 1976, Vision Research.

[30]  J. M. Foley,et al.  Contrast masking in human vision. , 1980, Journal of the Optical Society of America.

[31]  Rafal Mantiuk,et al.  A practical guide and software for analysing pairwise comparison experiments , 2017, ArXiv.

[32]  M. Cannon,et al.  Perceived contrast in the fovea and periphery. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[33]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997, SIGGRAPH '97.

[34]  Philippe Fuchs,et al.  Virtual Reality Headsets - A Theoretical and Pragmatic Approach , 2017 .

[35]  Byron J. Pierce,et al.  Binocular rivalry and head-worn displays , 2010 .

[36]  John S. Martin,et al.  Convergent and divergent viewing affect luning, visual thresholds, and field-of-view fragmentation in partial binocular overlap helmet-mounted displays , 1994, Defense, Security, and Sensing.