Effects of surface reflectance on local second order shape estimation in dynamic scenes

In dynamic scenes, relative motion between the object, the observer, and/or the environment projects as dynamic visual information onto the retina (optic flow) that facilitates 3D shape perception. When the object is diffusely reflective, e.g. a matte painted surface, this optic flow is directly linked to object shape, a property found at the foundations of most traditional shape-from-motion (SfM) schemes. When the object is specular, the corresponding specular flow is related to shape curvature, a regime change that challenges the visual system to determine concurrently both the shape and the distortions of the (sometimes unknown) environment reflected from its surface. While human observers are able to judge the global 3D shape of most specular objects, shape-from-specular-flow (SFSF) is not veridical. In fact, recent studies have also shown systematic biases in the perceived motion of such objects. Here we focus on the perception of local shape from specular flow and compare it to that of matte-textured rotating objects. Observers judged local surface shape by adjusting a rotation and scale invariant shape index probe. Compared to shape judgments of static objects we find that object motion decreases intra-observer variability in local shape estimation. Moreover, object motion introduces systematic changes in perceived shape between matte-textured and specular conditions. Taken together, this study provides a new insight toward the contribution of motion and surface material to local shape perception.

[1]  P. Mamassian,et al.  Prior knowledge on the illumination position , 2001, Cognition.

[2]  H. Wallach,et al.  The kinetic depth effect. , 1953, Journal of experimental psychology.

[3]  G. Orban,et al.  Perception of Three-Dimensional Shape From Specular Highlights, Deformations of Shading, and Other Types of Visual Information , 2004, Psychological science.

[4]  Ohad Ben-Shahar,et al.  Specular Flow and Shape in One Shot: , 2011, BMVC.

[5]  R. Andersen,et al.  Encoding of three-dimensional structure-from-motion by primate area MT neurons , 1998, Nature.

[6]  Astrid M L Kappers,et al.  The Influence of Illumination Direction on the Pictorial Reliefs of Lambertian Surfaces , 2005, Perception.

[7]  V. S. Ramachandran,et al.  Perception of shape from shading , 1988, Nature.

[8]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[9]  Ohad Ben-Shahar,et al.  Shape from specular flow: Is one flow enough? , 2011, CVPR 2011.

[10]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[11]  J. Koenderink,et al.  The shading cue in context , 2010, i-Perception.

[12]  R. Tibshirani,et al.  An Introduction to the Bootstrap , 1995 .

[13]  Michael S. Landy,et al.  The kinetic depth effect and optic flowȁII. First- and second-order motion , 1991, Vision Research.

[14]  Ohad Ben-Shahar,et al.  A polar representation of motion and implications for optical flow , 2011, CVPR 2011.

[15]  Roland W Fleming,et al.  Real-world illumination and the perception of surface reflectance properties. , 2003, Journal of vision.

[16]  Daniel Kersten,et al.  Distinguishing shiny from matte , 2010 .

[17]  Ohad Ben-Shahar,et al.  Shape from Specular Flow , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Maarten W. A. Wijntjes Probing pictorial relief: from experimental design to surface reconstruction , 2012, Behavior research methods.

[19]  Katja Doerschner,et al.  Effects of surface reflectance and 3D shape on perceived rotation axis. , 2013, Journal of vision.

[20]  N. Prins Psychophysics: A Practical Introduction , 2009 .

[21]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[22]  Paul E. Debevec Image-Based Lighting , 2002, IEEE Computer Graphics and Applications.

[23]  Astrid M L Kappers,et al.  Shape-from-shading for matte and glossy objects. , 2006, Acta psychologica.

[24]  T. Banchoff,et al.  Differential Geometry of Curves and Surfaces , 2010 .

[25]  Paul R. Schrater,et al.  Visual Motion and the Perception of Surface Material , 2011, Current Biology.

[26]  Katja Doerschner,et al.  Perceived rigidity of rotating specular superellipsoids under natural and not-so-natural illuminations , 2010 .

[27]  David Cohen-Steiner,et al.  Restricted delaunay triangulations and normal cycle , 2003, SCG '03.

[28]  P. Perona,et al.  Where is the sun? , 1998, Nature Neuroscience.

[29]  Silvio Savarese,et al.  What do reflections tell us about the shape of a mirror? , 2004, APGV '04.

[30]  J. Koenderink,et al.  Surface perception in pictures , 1992, Perception & psychophysics.

[31]  J. Koenderink,et al.  Photometric Invariants Related to Solid Shape , 1980 .

[32]  Bruce G. Cumming,et al.  RECOGNITION AND PERCEPTUAL USE OF SPECULAR REFLECTIONS , 1991 .

[33]  A. Torralba,et al.  Specular reflections and the perception of shape. , 2004, Journal of vision.

[34]  Andrea J. van Doorn,et al.  Surface shape and curvature scales , 1992, Image Vis. Comput..

[35]  Manfredo P. do Carmo,et al.  Differential geometry of curves and surfaces , 1976 .

[36]  Vision Research , 1961, Nature.

[37]  Ohad Ben-Shahar,et al.  Toward a Theory of Shape from Specular Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[38]  H H Bülthoff,et al.  A Prior for Global Convexity in Local Shape-from-Shading , 2001, Perception.

[39]  Hiroshi Ban,et al.  Perceptual Integration for Qualitatively Different 3-D Cues in the Human Brain , 2013, Journal of Cognitive Neuroscience.

[40]  Paul R. Schrater,et al.  Rapid classification of specular and diffuse reflection from image velocities , 2011, Pattern Recognit..

[41]  Yuichi Sakano,et al.  Effects of self-motion on gloss perception , 2008 .