New approach to the perception of 3D shape based on veridicality, complexity, symmetry and volume

This paper reviews recent progress towards understanding 3D shape perception made possible by appreciating the significant role that veridicality and complexity play in the natural visual environment. The ability to see objects as they really are "out there" is derived from the complexity inherent in the 3D object's shape. The importance of both veridicality and complexity was ignored in most prior research. Appreciating their importance made it possible to devise a computational model that recovers the 3D shape of an object from only one of its 2D images. This model uses a simplicity principle consisting of only four a priori constraints representing properties of 3D shapes, primarily their symmetry and volume. The model recovers 3D shapes from a single 2D image as well, and sometimes even better, than a human being. In the rare recoveries in which errors are observed, the errors made by the model and human subjects are very similar. The model makes no use of depth, surfaces or learning. Recent elaborations of this model include: (i) the recovery of the shapes of natural objects, including human and animal bodies with limbs in varying positions (ii) providing the model with two input images that allowed it to achieve virtually perfect shape constancy from almost all viewing directions. The review concludes with a comparison of some of the highlights of our novel, successful approach to the recovery of 3D shape from a 2D image with prior, less successful approaches.

[1]  Neill W Campbell,et al.  IEEE International Conference on Computer Vision and Pattern Recognition , 2008 .

[2]  Gerald Westheimer,et al.  VISUAL ACUITY AND HYPERACUITY , 2009 .

[3]  B. Rogers,et al.  Similarities between motion parallax and stereopsis in human depth perception , 1982, Vision Research.

[4]  Zygmunt Pizlo,et al.  A computational model that recovers the 3D shape of an object from a single 2D retinal representation , 2009, Vision Research.

[5]  I. Biederman,et al.  Recognizing depth-rotated objects: Evidence and conditions for three-dimensional viewpoint invariance. , 1993 .

[6]  Tadamasa Sawada,et al.  Visual detection of symmetry of 3D shapes. , 2010, Journal of vision.

[7]  Luc Brun,et al.  Contraction kernels and combinatorial maps , 2003, Pattern Recognit. Lett..

[8]  W. Peddie Phenomenal Regression to the Real Object , 1933, Nature.

[9]  K. A. Stevens,et al.  Binocular depth from surfaces versus volumes. , 1989, Journal of experimental psychology. Human perception and performance.

[10]  John Stillwell,et al.  Symmetry , 2000, Am. Math. Mon..

[11]  Vision Research , 1961, Nature.

[12]  B Rogers,et al.  Motion Parallax as an Independent Cue for Depth Perception , 1979, Perception.

[13]  I. Biederman,et al.  Recognizing depth-rotated objects: evidence and conditions for three-dimensional viewpoint invariance. , 1993, Journal of experimental psychology. Human perception and performance.

[14]  Zygmunt Pizlo,et al.  Binocular disparity only comes into play when everything else fails; a finding with broader implications than one might suppose. , 2008, Spatial vision.

[15]  Zygmunt Pizlo,et al.  Detecting mirror-symmetry of a volumetric shape from its single 2D image , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[16]  R. J. Watt,et al.  Towards a general theory of the visual acuities for shape and spatial arrangement , 1984, Vision Research.

[17]  Zygmunt Pizlo,et al.  3D Shape - Its Unique Place in Visual Perception , 2008 .

[18]  S. Edelman,et al.  Orientation dependence in the recognition of familiar and novel views of three-dimensional objects , 1992, Vision Research.

[19]  Adam Finkelstein,et al.  Suggestive contours for conveying shape , 2003, ACM Trans. Graph..

[20]  F. A. Miles Binocular Vision and Stereopsis by Ian P. Howard and Brian J. Rogers, Oxford University Press, 1995. £90.00 (736 pages) ISBN 0 19 508476 4. , 1996, Trends in Neurosciences.

[21]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[22]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[23]  Robert H. Thouless,et al.  Phenomenal Regression to the Real Object , 1931, Nature.

[24]  G Westheimer,et al.  Editorial: Visual acuity and hyperacuity. , 1975, Investigative ophthalmology.

[25]  E. Johnston Systematic distortions of shape from stereopsis , 1991, Vision Research.

[26]  J S Tittle,et al.  The visual perception of three-dimensional length. , 1996, Journal of experimental psychology. Human perception and performance.

[27]  I. Rock,et al.  A case of viewer-centered object perception , 1987, Cognitive Psychology.

[28]  Zygmunt Pizlo,et al.  Any Pair of 2D Curves Is Consistent with a 3D Symmetric Interpretation , 2011, Symmetry.

[29]  J. Todd Review TRENDS in Cognitive Sciences Vol.8 No.3 March 2004 The visual perception of 3D shape q , 2022 .

[30]  J T Todd,et al.  Stereoscopic Discrimination of Interval and Ordinal Depth Relations on Smooth Surfaces and in Empty Space , 1998, Perception.

[31]  R. Hetherington The Perception of the Visual World , 1952 .

[32]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[33]  James T Todd,et al.  The visual perception of 3-D shape from multiple cues: Are observers capable of perceiving metric structure? , 2003, Perception & psychophysics.

[34]  Refractor Vision , 2000, The Lancet.

[35]  Zygmunt Pizlo,et al.  A new look at binocular stereopsis , 2005, Vision Research.