Stereo Day-for-Night

Several approaches attempt to reproduce the appearance of a scotopic low-light night scene on a photopic display (“day-for-night”) by introducing color desaturation, loss of acuity, and the Purkinje shift toward blue colors. We argue that faithful stereo reproduction of night scenes on photopic stereo displays requires manipulation of not only color but also binocular disparity. To this end, we performed a psychophysics experiment to devise a model of disparity at scotopic luminance levels. Using this model, we can match binocular disparity of a scotopic stereo content displayed on a photopic monitor to the disparity that would be perceived if the scene was actually scotopic. The model allows for real-time computation of common stereo content as found in interactive applications such as simulators or computer games.

[1]  Charles Wheatstone On some remarkable and hitherto unobserved phenomena of binocular vision. , 1962 .

[2]  Hans-Peter Seidel,et al.  A luminance-contrast-aware disparity model and applications , 2012, ACM Trans. Graph..

[3]  Martin S Banks,et al.  Limits of stereopsis explained by local cross-correlation. , 2009, Journal of vision.

[4]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[5]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[6]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, ACM Trans. Graph..

[7]  DAVID R. SIMMONS,et al.  PII: S0042-6989(96)00273-8 , 1997 .

[8]  J. Mayhew,et al.  Contrast Sensitivity Function for Stereopsis , 1978, Perception.

[9]  Hans-Peter Seidel,et al.  Optimizing Disparity for Motion in Depth , 2013, Comput. Graph. Forum.

[10]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[12]  Hans-Peter Seidel,et al.  A perceptual model for disparity , 2011, ACM Trans. Graph..

[13]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[14]  Gordon E. Legge,et al.  Stereopsis and contrast , 1989, Vision Research.

[15]  Marcelo Bertalmío,et al.  Visual Acuity in Day for Night , 2006, International Journal of Computer Vision.

[16]  Hans-Peter Seidel,et al.  A perceptual model for disparity , 2011, SIGGRAPH 2011.

[17]  D. J. Bradley Night Vision: Basic, Clinical and Applied Aspects , 1991 .

[18]  Greg Ward,et al.  High dynamic range imaging , 2004, SIGGRAPH '04.

[19]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[20]  Hans-Peter Seidel,et al.  Stereo Day-for-Night , 2014, ACM Transactions on Applied Perception.

[21]  J M Wolfe,et al.  Binocular Rivalry and Fusion under Scotopic Luminances , 1994, Perception.

[22]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[23]  Frédo Durand,et al.  Interactive Tone Mapping , 2000, Rendering Techniques.

[24]  M. Barris Vision and Art: The Biology of Seeing , 2005 .

[25]  Margaret S. Livingstone,et al.  Stereopsis and positional acuity under dark adaptation , 1994, Vision Research.

[26]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[27]  Donald P. Greenberg,et al.  Time-dependent visual adaptation for fast realistic image display , 2000, SIGGRAPH.

[28]  S. Hecht THE RELATION BETWEEN VISUAL ACUITY AND ILLUMINATION , 1928, The Journal of general physiology.

[29]  Clifton M. Schor,et al.  Is edge information for stereoacuity spatially channeled? , 1989, Vision Research.

[30]  Aljoscha Smolic,et al.  Nonlinear disparity mapping for stereoscopic 3D , 2010, SIGGRAPH 2010.

[31]  Jan Kautz,et al.  Two-frame stereo photography in low-light settings: a preliminary study , 2012, CVMP.

[32]  Hans-Peter Seidel,et al.  Lossy compression of high dynamic range images and video , 2006, Electronic Imaging.

[33]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[34]  Christine D. Piatko,et al.  A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes , 1997, IEEE Trans. Vis. Comput. Graph..

[35]  James F. O'Brien,et al.  Perceptually based tone mapping for low-light conditions , 2011, SIGGRAPH 2011.

[36]  C. Wheatstone XVIII. Contributions to the physiology of vision. —Part the first. On some remarkable, and hitherto unobserved, phenomena of binocular vision , 1962, Philosophical Transactions of the Royal Society of London.

[37]  Yoshio Nakashima,et al.  Disparity Limit for Binocular Fusion in Fovea , 2006 .

[38]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997, SIGGRAPH '97.

[39]  M. Landy,et al.  Why Is Spatial Stereoresolution So Low? , 2004, The Journal of Neuroscience.

[40]  L. Cormack,et al.  Interocular correlation, luminance contrast and cyclopean processing , 1991, Vision Research.

[41]  A Lit,et al.  Depth-discrimination thresholds for stationary and oscillating targets at various levels of retinal illuminance. , 1966, Journal of the Optical Society of America.

[42]  Peter Shirley,et al.  A Spatial Post-Processing Algorithm for Images of Night Scenes , 2002, J. Graphics, GPU, & Game Tools.

[43]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[44]  F. Kingdom,et al.  Interactions between chromatic- and luminance-contrast-sensitive stereopsis mechanisms , 2002, Vision Research.

[45]  Mark D. Fairchild,et al.  iCAM06: A refined image appearance model for HDR image rendering , 2007, J. Vis. Commun. Image Represent..

[46]  M. Gross,et al.  Nonlinear disparity mapping for stereoscopic 3D , 2010, ACM Trans. Graph..

[47]  A. Lit,et al.  Depth-discrimination thresholds as a function of binocular differences of retinal illuminance at scotopic and photopic levels. , 1959, Journal of the Optical Society of America.

[48]  James F. O'Brien,et al.  Perceptually based tone mapping for low-light conditions , 2011, ACM Trans. Graph..

[49]  Saumil S. Patel,et al.  Relationship between threshold and suprathreshold perception of position and stereoscopic depth. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.