Using blur to affect perceived distance and size

We present a probabilistic model of how viewers may use defocus blur in conjunction with other pictorial cues to estimate the absolute distances to objects in a scene. Our model explains how the pattern of blur in an image together with relative depth cues indicates the apparent scale of the image's contents. From the model, we develop a semiautomated algorithm that applies blur to a sharply rendered image and thereby changes the apparent distance and scale of the scene's contents. To examine the correspondence between the model/algorithm and actual viewer experience, we conducted an experiment with human viewers and compared their estimates of absolute distance to the model's predictions. We did this for images with geometrically correct blur due to defocus and for images with commonly used approximations to the correct blur. The agreement between the experimental data and model predictions was excellent. The model predicts that some approximations should work well and that others should not. Human viewers responded to the various types of blur in much the way the model predicts. The model and algorithm allow one to manipulate blur precisely and to achieve the desired perceived scale efficiently.

[1]  Meng Yu,et al.  Camera Models and Optical Systems Used in Computer Graphics: Part I, Object-Based Techniques , 2003, ICCSA.

[2]  Ichiro Yuyama,et al.  A study on the relationship between shooting conditions and cardboard effect of stereoscopic images , 2000, IEEE Trans. Circuits Syst. Video Technol..

[3]  Norimichi Kitagawa,et al.  Contrast and Depth Perception: Effects of Texture Contrast and Area Contrast , 2007, Perception.

[4]  B. Saxberg,et al.  Projected free fall trajectories. I. Theory and simulation. , 1987, Biological cybernetics.

[5]  Michael Potmesil,et al.  A lens and aperture camera model for synthetic image generation , 1981, SIGGRAPH '81.

[6]  J. A. Ball Theory of Mechanical Miniatures in Cinematography , 1924 .

[7]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Robert L. Cook,et al.  Distributed ray tracing , 1984, SIGGRAPH.

[9]  Martin S. Banks,et al.  A stereo display prototype with multiple focal distances , 2004, ACM Trans. Graph..

[10]  Austin Roorda,et al.  Monochromatic aberrations provide an odd-error cue to focus direction. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Francesc Moreno-Noguer,et al.  Active refocusing of images and videos , 2007, ACM Trans. Graph..

[12]  Martin S. Banks,et al.  A stereo display prototype with multiple focal distances , 2004, SIGGRAPH 2004.

[13]  A. M. Rohaly,et al.  The effects of contrast on perceived depth and depth discrimination , 1999, Vision Research.

[14]  S BanksMartin,et al.  Using blur to affect perceived distance and size , 2010 .

[15]  B. Saxberg,et al.  Projected free fall trajectories , 1987, Biological Cybernetics.

[16]  James M. Coughlan,et al.  Manhattan World: Orientation and Outlier Detection by Bayesian Inference , 2003, Neural Computation.

[17]  Charless C. Fowlkes,et al.  Natural-Scene Statistics Predict How the Figure–Ground Cue of Convexity Affects Human Depth Perception , 2010, The Journal of Neuroscience.

[18]  K J Ciuffreda,et al.  Accommodation and Apparent Distance , 1988, Perception.

[19]  J S Larsen,et al.  THE SAGITTAL GROWTH OF THE EYE , 1971, Acta ophthalmologica.

[20]  George Mather,et al.  Depth cue integration: stereopsis and image blur , 2000, Vision Research.

[21]  Heiko Hecht,et al.  Gravitational acceleration as a cue for absolute size and distance? , 1996, Perception & psychophysics.

[22]  Meng Yu,et al.  Camera Models and Optical Systems Used in Computer Graphics: Part II, Image-Based Techniques , 2003, ICCSA.

[23]  Robert L. Cook,et al.  The Reyes image rendering architecture , 1987, SIGGRAPH.

[24]  Martin S Banks,et al.  Gravity as a Monocular Cue for Perception of Absolute Distance and/or Absolute Size , 1992 .

[25]  R. MELDOLA,et al.  The Optics of Photography , 1894, Nature.

[26]  Silvia Miksch,et al.  Semantic depth of field , 2001, IEEE Symposium on Information Visualization, 2001. INFOVIS 2001..

[27]  Hirokazu Yamanoue The Relation between Size Distortion and Shooting Conditions for Stereoscopic Images , 1997 .

[28]  Rudolf Kingslake,et al.  Optics in photography , 1992 .

[29]  Przemyslaw Rokita,et al.  Generating depth of-field effects in virtual reality applications , 1996, IEEE Computer Graphics and Applications.

[30]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, ACM Trans. Graph..

[31]  Kurt Akeley,et al.  The accumulation buffer: hardware support for high-quality rendering , 1990, SIGGRAPH.

[32]  Anatole Lécuyer,et al.  Depth-of-Field Blur Effects for First-Person Navigation in Virtual Environments , 2008, IEEE Computer Graphics and Applications.

[33]  Frédo Durand,et al.  Multi-aperture photography , 2007, ACM Trans. Graph..

[34]  S. Palmer,et al.  Edge-region grouping in figure-ground organization and depth perception. , 2008, Journal of experimental psychology. Human perception and performance.

[35]  Anatole Lécuyer,et al.  Using an Eye-Tracking System to Improve Camera Motions and Depth-of-Field Blur Effects in Virtual Environments , 2008, 2008 IEEE Virtual Reality Conference.

[36]  J. Enns,et al.  Rembrandt's Textural Agency: A Shared Perspective in Visual Art and Science , 2010, Leonardo.

[37]  G A FRY,et al.  The effects of atmospheric scattering on binocular depth perception. , 1949, American journal of optometry and archives of American Academy of Optometry.

[38]  Yoav Y. Schechner,et al.  Depth from Defocus vs. Stereo: How Different Really Are They? , 2004, International Journal of Computer Vision.

[39]  M. Ernst,et al.  Focus cues affect perceived depth. , 2005, Journal of vision.

[40]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  C. A. Burbeck,et al.  Occlusion edge blur: a cue to relative visual depth. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[42]  Beatrice Brillault-O'Mahony,et al.  New method for vanishing point detection , 1991, CVGIP Image Underst..

[43]  Paul Fearing Importance Ordering for Real-Time Depth of Field , 1995, ICSC.

[44]  Masaki Emoto,et al.  Spatial distortion prediction system for stereoscopic images , 2006, J. Electronic Imaging.

[45]  J R Tresilian,et al.  Ordinal depth information from accommodation? , 2000, Ergonomics.

[46]  Adam Finkelstein,et al.  Directing gaze in 3D models with stylized focus , 2006, EGSR '06.

[47]  Wijnand A. IJsselsteijn,et al.  A survey of perceptual evaluations and requirements of three-dimensional TV , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[48]  H. Egusa,et al.  Effects of Brightness, Hue, and Saturation on Perceived Depth between Adjacent Regions in the Visual Field , 1983, Perception.

[49]  Brian A. Barsky Vision-realistic rendering: simulation of the scanned foveal image from wavefront data of human subjects , 2004, APGV '04.

[50]  H. A. V. Bulleid Special effects in cinematography , 1960 .

[51]  Anatole Lécuyer,et al.  Depth-of-Field Blur Effects for First-Person Navigation in Virtual Environments , 2007, IEEE Computer Graphics and Applications.

[52]  G. Mather,et al.  Blur Discrimination and its Relation to Blur-Mediated Depth Perception , 2002, Perception.

[53]  Silvia Miksch,et al.  Useful Properties of Semantic Depth of Field for Better F+C Visualization , 2002, VisSym.

[54]  Robert van Liere,et al.  Fast perception-based depth of field rendering , 2000, VRST '00.

[55]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, SIGGRAPH 2007.

[56]  Michael S. Langer,et al.  Planar orientation from blur gradients in a single image , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[57]  H WALLACH,et al.  ACCOMMODATION AS A DISTANCE-CUE. , 1963, The American journal of psychology.

[58]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[59]  O. Sabouraud [Space perception]. , 1978, Revue d'oto-neuro-ophtalmologie.

[60]  K H Spring,et al.  VARIATION OF PUPIL SIZE WITH CHANGE IN THE ANGLE AT WHICH THE LIGHT STIMULUS STRIKES THE RETINA* , 1948, The British journal of ophthalmology.

[61]  Pat Hanrahan,et al.  A realistic camera model for computer graphics , 1995, SIGGRAPH.

[62]  Takayuki Okatani,et al.  Estimating Scale of a Scene from a Single Image Based on Defocus Blur and Scene Geometry , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[63]  George Mather,et al.  Image blur as a pictorial depth cue , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.