What defines a view?

At a given instant we see only visible surfaces, not an object's complete 3D appearance. Thus, objects may be represented as discrete 'views' showing only those features visible from a limited range of viewpoints. We address how to define a view using Koenderink's (Koenderink & Van Doorn, Biol. Cybernet. 32 (1979) 211.) geometric method for enumerating complete sets of stable views as aspect graphs. Using objects with known aspect graphs, five experiments examined whether the perception of orientation is sensitive to the qualitative features that define aspect graphs. Highest sensitivity to viewpoint changes was observed at locations where the theory predicts qualitative transitions, although some transitions did not affect performance. Hypotheses about why humans ignore some transitions offer insights into mechanisms for object representation.

[1]  I. Rock,et al.  A case of viewer-centered object perception , 1987, Cognitive Psychology.

[2]  I. Biederman,et al.  Viewpoint-dependent mechanisms in visual object recognition: Reply to Tarr and Bülthoff (1995). , 1995 .

[3]  M. Tarr,et al.  Training ‘greeble’ experts: a framework for studying expert object recognition processes , 1998, Vision Research.

[4]  M. Farah.  Is an Object an Object an Object? Cognitive and Neuropsychological Investigations of Domain Specificity in Visual Object Recognition , 1992 .

[5]  M J Tarr,et al.  Is human object recognition better described by geon structural descriptions or by multiple views? Comment on Biederman and Gerhardstein (1993). , 1995, Journal of experimental psychology. Human perception and performance.

[6]  J T Todd,et al.  Perceptual localization of surface position. , 1997, Journal of experimental psychology. Human perception and performance.

[7]  Azriel Rosenfeld,et al.  From volumes to views: An approach to 3-D object recognition , 1992, CVGIP Image Underst..

[8]  A. J. Mistlin,et al.  Visual neurones responsive to faces , 1987, Trends in Neurosciences.

[9]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[10]  Joachim H. Rieger,et al.  On the classification of views of piecewise smooth objects , 1987, Image Vis. Comput..

[11]  M. Tarr,et al.  When does Human Object Recognition use a Viewer-Centered Reference Frame? , 1990 .

[12]  I. Biederman,et al.  Recognizing depth-rotated objects: Evidence and conditions for three-dimensional viewpoint invariance. , 1993 .

[13]  M. Tarr,et al.  Becoming a “Greeble” Expert: Exploring Mechanisms for Face Recognition , 1997, Vision Research.

[14]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[15]  Joachim H. Rieger,et al.  The Geometry of View Space of Opaque Objects Bounded by Smooth Surfaces , 1990, Artif. Intell..

[16]  Isabel Gauthier,et al.  Three-dimensional object recognition is viewpoint dependent , 1998, Nature Neuroscience.

[17]  D. Jacobs.  Space Efficient 3D Model Indexing , 1992 .

[18]  J T Todd,et al.  On the Relative Salience of Euclidean, Affine, and Topological Structure for 3-D Form Discrimination , 1998, Perception.

[19]  J. Hummel,et al.  An architecture for rapid, hierarchical structural description , 1996 .

[20]  G. Humphrey,et al.  Recognizing novel views of three-dimensional objects. , 1992, Canadian journal of psychology.

[21]  John R. Kender,et al.  What is a 'Degenerate' View? , 1987, IJCAI.

[22]  Irvin Rock,et al.  Orientation and form , 1974 .

[23]  Kevin W. Bowyer,et al.  Computing the Perspective Projection Aspect Graph of Solids of Revolution , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  M. Tarr,et al.  Orientation Priming of Novel Shapes in the Context of Viewpoint-Dependent Recognition , 1997, Perception.

[25]  A. W. Ellis.  Normality and pathology in cognitive functions , 1982 .

[26]  Ernest Greene,et al.  The effect of stroke on object recognition , 1988, Brain and Cognition.

[27]  R. Shepard,et al.  Mental Images and Their Transformations , 1982 .

[28]  I. Rock.  The perception of disoriented figures. , 1974, Scientific American.

[29]  Kevin W. Bowyer,et al.  Aspect graphs: An introduction and survey of recent results , 1990, Int. J. Imaging Syst. Technol..

[30]  S. Edelman,et al.  Orientation dependence in the recognition of familiar and novel views of three-dimensional objects , 1992, Vision Research.

[31]  J T Todd,et al.  Perception of rigid motion in depth from the optical deformations of shadows and occlusion boundaries. , 1994, Journal of experimental psychology. Human perception and performance.

[32]  D. Bartram.  Levels of coding in picture-picture comparison tasks , 1976, Memory & cognition.

[33]  Jack Perkins,et al.  Pattern recognition in practice , 1980 .

[34]  Thierry Van Effelterre,et al.  Aspect Graphs for Visual Recognition of Three-Dimensional Objects , 1994 .

[35]  D I Perrett,et al.  Characteristic Views and the Visual Inspection of Simple Faceted and Smooth Objects: ‘Tetrahedra and Potatoes’ , 1988, Perception.

[36]  Dmitry B. Goldgof,et al.  The scale space aspect graph , 1992, CVPR.

[37]  M. J. Tarr,et al.  COMMENT ON: IS HUMAN OBJECT RECOGNITION BETTER DESCRIBED BY GEON STRUCTURAL DESCRIPTIONS OR BY MULTIPLE VIEWS ? BY BARTRAM D.J. , 1995 .

[38]  M. Tarr,et al.  Mental rotation and orientation-dependence in shape recognition , 1989, Cognitive Psychology.

[39]  M. Tarr,et al.  Testing conditions for viewpoint invariance in object recognition. , 1997, Journal of experimental psychology. Human perception and performance.

[40]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  David C. Plaut,et al.  Visual Object Representation: Interpreting Neurophysiological Data within a Computational Framework , 1990, Journal of Cognitive Neuroscience.

[42]  A. Taylor,et al.  The contribution of the right parietal lobe to object recognition. , 1973, Cortex; a journal devoted to the study of the nervous system and behavior.

[43]  M. Tarr,et al.  Do viewpoint-dependent mechanisms generalize across members of a class? , 1998, Cognition.

[44]  R. Jain,et al.  Generating aspect graphs for curved objects , 1989, [1989] Proceedings. Workshop on Interpretation of 3D Scenes.

[45]  H H Bülthoff,et al.  Psychophysical support for a two-dimensional view interpolation theory of object recognition. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[46]  Jean Ponce,et al.  Toward a scale-space aspect graph: solids of revolution , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[47]  P. Jolicoeur.  The time to name disoriented natural objects , 1985, Memory & cognition.

[48]  Vishvjit S. Nalwa,et al.  Line-drawing interpretation: A mathematical framework , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[49]  M. Corballis.  Recognition of disoriented shapes. , 1988, Psychological review.

[50]  S. Ullman,et al.  Generalization to Novel Images in Upright and Inverted Faces , 1993, Perception.

[51]  T. Poggio,et al.  Recognition and Structure from one 2D Model View: Observations on Prototypes, Object Classes and Symmetries , 1992 .

[52]  Allen M. Waxman,et al.  Learning Aspect Graph Representations from View Sequences , 1989, NIPS.

[53]  B. Bergum,et al.  Attention and performance IX , 1982 .

[54]  J J Koenderink,et al.  What Does the Occluding Contour Tell Us about Solid Shape? , 1984, Perception.

[55]  A. J. Mistlin,et al.  Visual cells in the temporal cortex sensitive to face view and gaze direction , 1985, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[56]  M. Tarr,et al.  Activation of the middle fusiform 'face area' increases with expertise in recognizing novel objects , 1999, Nature Neuroscience.

[57]  Peter Dayan,et al.  Neural Models for Part-Whole Hierarchies , 1996, NIPS.

[58]  M. Harries,et al.  Use of Preferential Inspection to Define the Viewing Sphere and Characteristic Views of an Arbitrary Machined Tool Part , 1992, Perception.

[59]  Heinrich H. Bülthoff,et al.  Image-based object recognition , 1995 .

[60]  Pierre Jolicoeur,et al.  Identification of Disoriented Objects: A Dual‐systems Theory , 1990 .

[61]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[62]  M J Tarr,et al.  What Object Attributes Determine Canonical Views? , 1999, Perception.

[63]  M. Tarr.  Rotating objects to recognize them: A case study on the role of viewpoint dependency in the recognition of three-dimensional objects , 1995, Psychonomic bulletin & review.

[64]  Rob Ellis,et al.  Multiple levels of representation for visual objects: a behavioural study , 1987 .

[65]  M. Deakin.  Catastrophe theory. , 1977, Science.

[66]  S. Ullman.  Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.

[67]  P. Jolicoeur,et al.  Identification of disoriented objects: effects of context of prior presentation. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[68]  Dave Bartram,et al.  The role of visual and semantic codes in object naming , 1974 .

[69]  Michael D. Heath,et al.  Are edges sufficient for object recognition? , 1998 .

[70]  Nancy A. Watts.  Calculating the principal views of a polyhedron , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[71]  Rebecca Lawson,et al.  Object Recognition under Sequential Viewing Conditions: Evidence for Viewpoint-Specific Recognition Procedures , 1994, Perception.

[72]  Takeo Kanade,et al.  Automatic generation of object recognition programs , 1988, Proc. IEEE.

[73]  Tomaso Poggio,et al.  Image Representations for Visual Learning , 1996, Science.

[74]  R. Thom.  Structural stability and morphogenesis , 1977, Pattern Recognition.

[75]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.

[76]  H. Whitney.  On Singularities of Mappings of Euclidean Spaces. I. Mappings of the Plane Into the Plane , 1955 .

[77]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[78]  J. Hummel,et al.  Categorical relations in shape perception. , 1996, Spatial vision.

[79]  O. Platonova.  Singularities of projections of smooth surfaces , 1984 .

[80]  John E. W. Mayhew,et al.  3D Model Recognition from Stereoscopic Cues , 1991 .

[81]  D. Perrett,et al.  Evidence accumulation in cell populations responsive to faces: an account of generalisation of recognition without mental transformations , 1998, Cognition.

[82]  Takeo Kanade,et al.  Modelling sensors: Toward automatic generation of object recognition program , 1989, Comput. Vis. Graph. Image Process..

[83]  M. Harries,et al.  Preferential Inspection of Views of 3-D Model Heads , 1991, Perception.

[84]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[85]  N. Logothetis,et al.  Psychophysical and physiological evidence for viewer-centered object representations in the primate. , 1995, Cerebral cortex.

[86]  Jitendra Malik,et al.  Computing the Aspect Graph for Line Drawings of Polyhedral Objects , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[87]  H. Freeman,et al.  On the characteristic views of quadric-surfaced solids , 1991, [1991 Proceedings] Workshop on Directions in Automated CAD-Based Vision.

[88]  Michael Werman,et al.  The visual potential: One convex polygon , 1989, Comput. Vis. Graph. Image Process..

[89]  Jan J. Koenderink,et al.  Solid shape , 1990 .

[90]  D I Perrett,et al.  Frameworks of analysis for the neural representation of animate objects and actions. , 1989, The Journal of experimental biology.

[91]  T. Poggio,et al.  The importance of symmetry and virtual views in three-dimensional object recognition , 1994, Current Biology.

[92]  Heinrich H Bülthoff,et al.  Image-based object recognition in man, monkey and machine , 1998, Cognition.

[93]  Shimon Edelman,et al.  Receptive field spaces and class-based generalization from a single view in face recognition , 1995 .

[94]  James T. Todd,et al.  The perception of surface orientation from multiple sources of optical information , 1995, Perception & psychophysics.

[95]  David W. Jacobs,et al.  Space and Time Bounds on Indexing 3D Models from 2D Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[96]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[97]  Allen M. Waxman,et al.  Learning and Recognizing 3D Objects from Multiple Views in a Neural System , 1992 .