Blur and the perception of depth at occlusions.

The depth ordering of two surfaces, one occluding the other, can in principle be determined from the correlation between the occlusion border's blur and the blur of the two surfaces. If the border is blurred, the blurrier surface is nearer; if the border is sharp, the sharper surface is nearer. Previous research has found that observers do not use this informative cue. We reexamined this finding. Using a multiplane display, we confirmed the previous finding: Our observers did not accurately judge depth order when the blur was rendered and the stimulus presented on one plane. We then presented the same simulated scenes on multiple planes, each at a different focal distance, so the blur was created by the optics of the eye. Performance was now much better, which shows that depth order can be reliably determined from blur information but only when the optical effects are similar to those in natural viewing. We asked what the critical differences were in the single- and multiplane cases. We found that chromatic aberration provides useful information but accommodative microfluctuations do not. In addition, we examined how image formation is affected by occlusions and observed some interesting phenomena that allow the eye to see around and through occluding objects and may allow observers to estimate depth in da Vinci stereopsis, where one eye's view is blocked. Finally, we evaluated how accurately different rendering and displaying techniques reproduce the retinal images that occur in real occlusions. We discuss implications for computer graphics.

[1]  Martin S. Banks,et al.  A stereo display prototype with multiple focal distances , 2004, SIGGRAPH 2004.

[2]  W Neil Charman,et al.  Microfluctuations in accommodation: an update on their characteristics and possible role , 2015, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[3]  James F. O'Brien,et al.  Using blur to affect perceived distance and size , 2010, TOGS.

[4]  G. Mather,et al.  Blur Discrimination and its Relation to Blur-Mediated Depth Perception , 2002, Perception.

[5]  Adrian Glasser,et al.  Amplitude dependent accommodative dynamics in humans , 2003, Vision Research.

[6]  J. Gibson The Senses Considered As Perceptual Systems , 1967 .

[7]  J. C. Kotulak,et al.  The Accommodative Response to Subthreshold Blur and to Perceptual Fading during the Troxler Phenomenon , 1986, Perception.

[8]  C. A. Burbeck,et al.  Occlusion edge blur: a cue to relative visual depth. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Philip B. Kruger,et al.  Chromatic aberration and ocular focus: Fincham revisited , 1993, Vision Research.

[10]  S. Palmer,et al.  Edge-region grouping in figure-ground organization and depth perception. , 2008, Journal of experimental psychology. Human perception and performance.

[11]  B Gillam,et al.  The Role of Monocular Regions in Stereoscopic Displays , 1988, Perception.

[12]  James Gao,et al.  High-speed switchable lens enables the development of a volumetric stereoscopic display. , 2009, Optics express.

[13]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[14]  Bernard Gilmartin,et al.  Current perspective on microfluctuations of accommodation , 1992, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[15]  Inna Tsirlin,et al.  A computational theory of da Vinci stereopsis. , 2014, Journal of vision.

[16]  Johannes Burge,et al.  Optimal defocus estimation in individual natural images , 2011, Proceedings of the National Academy of Sciences.

[17]  P B Kruger,et al.  Accommodation to monochromatic and white-light targets. , 1995, Investigative ophthalmology & visual science.

[18]  Robert L. Cook,et al.  Distributed ray tracing , 1998 .

[19]  Johannes Burge,et al.  Defocus blur discrimination in natural images with natural optics. , 2015, Journal of vision.

[20]  Hans-Peter Seidel,et al.  A perceptual model for disparity , 2011, ACM Trans. Graph..

[21]  Martin S Banks,et al.  Limits of stereopsis explained by local cross-correlation. , 2009, Journal of vision.

[22]  Shinsuke Shimojo,et al.  Da vinci stereopsis: Depth and subjective occluding contours from unpaired image points , 1990, Vision Research.

[23]  G. Westheimer,et al.  Fluctuations of accommodation under steady viewing conditions , 1959, The Journal of physiology.

[24]  George Mather,et al.  Image blur as a pictorial depth cue , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[25]  Martin S. Banks,et al.  Are corresponding points fixed? , 2001, Vision Research.

[26]  Pascal Mamassian,et al.  The role of transparency in da Vinci stereopsis , 2011, Vision Research.

[27]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[28]  W. N. Charman,et al.  Visual sensitivity to temporal change in focus and its relevance to the accommodation response , 1988, Vision Research.

[29]  James F. O'Brien,et al.  Optimal presentation of imagery with focus cues on multi-plane displays , 2015, ACM Trans. Graph..

[30]  Clifton M Schor,et al.  Saccades reduce latency and increase velocity of ocular accommodation , 1999, Vision Research.

[31]  Robert S. Allison,et al.  Detection of the depth order of defocused images , 2005, Vision Research.

[32]  Aljoscha Smolic,et al.  Nonlinear disparity mapping for stereoscopic 3D , 2010, ACM Trans. Graph..

[33]  J. P. Cavanagh,et al.  Reconstructing the third dimension: Interactions between color, texture, motion, binocular disparity, and shape , 1987, Comput. Vis. Graph. Image Process..

[34]  F. Okano,et al.  Repeated vergence adaptation causes the decline of visual functions in watching stereoscopic television , 2005, Journal of Display Technology.

[35]  Martin S. Banks,et al.  Why do animal eyes have pupils of different shapes? , 2015, Science Advances.

[36]  Bernard Mendiburu,et al.  3D Movie Making: Stereoscopic Digital Cinema from Script to Screen , 2009 .

[37]  B. Wandell,et al.  Matching color images: the effects of axial chromatic aberration , 1994 .

[38]  Martin S Banks,et al.  Focus information is used to interpret binocular images. , 2010, Journal of vision.

[39]  Martin S. Banks,et al.  Creating effective focus cues in multi-plane 3D displays , 2011, Optics express.

[40]  K H Spring,et al.  VARIATION OF PUPIL SIZE WITH CHANGE IN THE ANGLE AT WHICH THE LIGHT STIMULUS STRIKES THE RETINA* , 1948, The British journal of ophthalmology.

[41]  Pat Hanrahan,et al.  A realistic camera model for computer graphics , 1995, SIGGRAPH.

[42]  L R Stark,et al.  Accommodation to static chromatic simulations of blurred retinal images , 1999, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[43]  M. Ernst,et al.  Focus cues affect perceived depth. , 2005, Journal of vision.

[44]  David M. Hoffman,et al.  The zone of comfort: Predicting visual discomfort with stereo displays. , 2011, Journal of vision.

[45]  Kevin J. MacKenzie,et al.  Accommodation to multiple-focal-plane displays: Implications for improving stereoscopic displays and for accommodation control. , 2010, Journal of vision.

[46]  Joanne Wood,et al.  Microfluctuations of steady-state accommodation and the cardiopulmonary system , 1995, Vision Research.

[47]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[48]  G. Wyszecki,et al.  Axial chromatic aberration of the human eye. , 1957, Journal of the Optical Society of America.

[49]  Austin Roorda,et al.  Monochromatic aberrations provide an odd-error cue to focus direction. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[50]  G WESTHEIMER,et al.  Factors influencing accommodation responses of the human eye. , 1959, Journal of the Optical Society of America.

[51]  B. Julesz,et al.  A disparity gradient limit for binocular fusion. , 1980, Science.

[52]  Charless C. Fowlkes,et al.  Behavioral / Systems / Cognitive Title : Natural-scene statistics predict the influence of the figure-ground cue of convexity on human depth perception Abbreviated title : Natural-scene statistics influence human depth perception , 2009 .

[53]  M. Georgeson,et al.  Contrast constancy: deblurring in human vision by spatial frequency channels. , 1975, The Journal of physiology.

[54]  E F FINCHAM,et al.  The Accommodation Reflex and its Stimulus * , 1951, The Journal of physiology.

[55]  J. Wolffsohn,et al.  Autonomic correlates of ocular accommodation and cardiovascular function , 2009, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.