Rotating objects to recognize them: A case study on the role of viewpoint dependency in the recognition of three-dimensional objects

Successful object recognition is essential for finding food, identifying kin, and avoiding danger, as well as many other adaptive behaviors. To accomplish this feat, the visual system must reconstruct 3-D interpretations from 2-D “snapshots” falling on the retina. Theories of recognition address this process by focusing on the question of how object representations are encoded with respect to viewpoint. Although empirical evidence has been equivocal on this question, a growing body of surprising results, including those obtained in the experiments presented in this case study, indicates that recognition is often viewpoint dependent. Such findings reveal a prominent role for viewpointdependent mechanisms and provide support for themultiple-views approach, in which objects are encoded as a set of view-specific representations that are matched to percepts using normalization procedures.

[1]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[2]  R. Shepard,et al.  CHRONOMETRIC STUDIES OF THE ROTATION OF MENTAL IMAGES , 1973 .

[3]  D. Shinar,et al.  Effects of form rotation on the speed of classification: the development of shape constancy , 1973 .

[4]  Irvin Rock,et al.  Orientation and form , 1974 .

[5]  Dave Bartram,et al.  The role of visual and semantic codes in object naming , 1974 .

[6]  R. Shepard,et al.  Transformational studies of the internal representation of three-dimensional objects. , 1974 .

[7]  W. Chase,et al.  Visual information processing. , 1974 .

[8]  Jacqui Lee Schiff,et al.  Frames of Reference , 1975 .

[9]  D. Bartram.  Levels of coding in picture-picture comparison tasks , 1976, Memory & cognition.

[10]  M. Corballis,et al.  Latency to categorize disoriented alphanumeric characters as letters or digits. , 1978 .

[11]  M. Corballis,et al.  Decisions about identity and orientation of rotated letters and digits , 1978, Memory & cognition.

[12]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[13]  M. White.  Naming and categorization of tilted alphanumeric characters do not require mental rotation , 1980 .

[14]  Jack Perkins,et al.  Pattern recognition in practice , 1980 .

[15]  I. Rock,et al.  The effect on form perception of change of orientation in the third dimension. , 1981, Journal of experimental psychology. Human perception and performance.

[16]  F Simion,et al.  Transformation processes upon the visual code , 1982, Perception & psychophysics.

[17]  M. G. Eley,et al.  Identifying rotated letter-like symbols , 1982, Memory & cognition.

[18]  R. Shepard,et al.  Mental Images and Their Transformations , 1982 .

[19]  I. Rock.  The Logic of Perception , 1983 .

[20]  A. Witkin,et al.  On the Role of Structure in Vision , 1983 .

[21]  S. Pinker,et al.  Visual cognition : An introduction * , 1989 .

[22]  B. Tversky,et al.  Journal of Experimental Psychology : General VOL . 113 , No . 2 JUNE 1984 Objects , Parts , and Categories , 2005 .

[23]  Stephen M. Kosslyn,et al.  Pictures and names: Making the connection , 1984, Cognitive Psychology.

[24]  R. Shepard.  Ecological constraints on internal representation: resonant kinematics of perceiving, imagining, thinking, and dreaming. , 1984, Psychological review.

[25]  L. B. Smith,et al.  Mental rotation of representations of two-dimensional and three-dimensional objects , 1985 .

[26]  P. Jolicoeur.  The time to name disoriented natural objects , 1985, Memory & cognition.

[27]  A Koriat,et al.  Mental rotation and visual familiarity , 1985, Perception & psychophysics.

[28]  Douglas L. Hintzman,et al.  "Schema Abstraction" in a Multiple-Trace Memory Model , 1986 .

[29]  L C Robertson,et al.  Reference frames in mental rotation. , 1987, Journal of experimental psychology. Learning, memory, and cognition.

[30]  L C Robertson,et al.  Reference frames in mental rotation. , 1987, Journal of experimental psychology. Learning, memory, and cognition.

[31]  L M Parsons,et al.  Visual discrimination of abstract mirror-reflected three-dimensional objects at many orientations , 1987, Perception & psychophysics.

[32]  L. Parsons.  Imagined spatial transformations of one's hands and feet , 1987, Cognitive Psychology.

[33]  I. Biederman,et al.  Sexing day-old chicks: A case study and expert systems analysis of a difficult perceptual-learning task. , 1987 .

[34]  L M Parsons,et al.  Imagined spatial transformation of one's body. , 1987, Journal of experimental psychology. General.

[35]  B. A. Baldwin,et al.  Cells in temporal cortex of conscious sheep can respond preferentially to the sight of faces. , 1987, Science.

[36]  Jan J. Koenderink,et al.  An internal representation for solid shape based on the topological properties of the apparent contour , 1987 .

[37]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[38]  I. Rock,et al.  A case of viewer-centered object perception , 1987, Cognitive Psychology.

[39]  R. Luce,et al.  Effects of stimulus complexity on mental rotation rate of polygons. , 1987, Journal of experimental psychology. Human perception and performance.

[40]  A. J. Mistlin,et al.  Visual neurones responsive to faces , 1987, Trends in Neurosciences.

[41]  D. Metzler,et al.  Mental rotation: effects of dimensionality of objects and type of task. , 1988, Journal of experimental psychology. Human perception and performance.

[42]  M. Corballis.  Recognition of disoriented shapes. , 1988, Psychological review.

[43]  P. Jolicoeur.  Mental rotation and the identification of disoriented objects. , 1988, Canadian journal of psychology.

[44]  S. Ullman.  Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.

[45]  P. Jolicoeur,et al.  Identification of disoriented objects: effects of context of prior presentation. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[46]  M. Tarr,et al.  Mental rotation and orientation-dependence in shape recognition , 1989, Cognitive Psychology.

[47]  Pierre Jolicoeur,et al.  "Mental rotation and the identification of disoriented objects": Erratum. , 1989 .

[48]  H. Roediger,et al.  Explaining dissociations between implicit and explicit measures of retention: A processing account , 1989 .

[49]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[50]  Randall White.  Visual thinking in the Ice Age , 1989 .

[51]  I. Rock,et al.  Can we imagine how objects look from other viewpoints? , 1989, Cognitive Psychology.

[52]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[53]  Jan J. Koenderink,et al.  Solid shape , 1990 .

[54]  M. Farah.  Visual Agnosia: Disorders of Object Recognition and What They Tell Us about Normal Vision , 1990 .

[55]  P. Jolicoeur,et al.  Orientation congruency effects on the identification of disoriented shapes. , 1990, Journal of experimental psychology. Human perception and performance.

[56]  M. Tarr,et al.  When does Human Object Recognition use a Viewer-Centered Reference Frame? , 1990 .

[57]  Pierre Jolicoeur,et al.  Identification of Disoriented Objects: A Dual‐systems Theory , 1990 .

[58]  Michael J. Tarr,et al.  Article Commentary: Orientation-Dependent Mechanisms in Shape Recognition: Further Issues , 1991 .

[59]  I. Biederman,et al.  Priming contour-deleted images: Evidence for intermediate representations in visual object recognition , 1991, Cognitive Psychology.

[60]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[61]  P. Jolicoeur,et al.  Reference frame and effects of orientation on finding the tops of rotated objects. , 1992, Journal of experimental psychology. Human perception and performance.

[62]  S. Edelman,et al.  Orientation dependence in the recognition of familiar and novel views of three-dimensional objects , 1992, Vision Research.

[63]  G. Humphrey,et al.  Recognizing novel views of three-dimensional objects. , 1992, Canadian journal of psychology.

[64]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.

[65]  D L Schacter,et al.  Priming and recognition of transformed three-dimensional objects: effects of size and reflection. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[66]  H H Bülthoff,et al.  Psychophysical support for a two-dimensional view interpolation theory of object recognition. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[67]  Pierre Jolicoeur,et al.  Orientation-invariant transfer of training in the identification of rotated natural objects , 1993, Memory & cognition.

[68]  G K Humphrey,et al.  An Examination of the Effects of Axis Foreshortening, Monocular Depth Cues, and Visual Field on Object Identification , 1993, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[69]  S. Edelman.  Evaluating Object Recognition Theories by Computer Graphics Psychophysics , 1993 .

[70]  I. Biederman,et al.  Recognizing depth-rotated objects: evidence and conditions for three-dimensional viewpoint invariance. , 1993, Journal of experimental psychology. Human perception and performance.

[71]  Kavitha Srinivas.  Perceptual specificity in nonverbal priming. , 1993 .

[72]  M. Kubovy,et al.  Mental Rotation, Mental Representation, and Flat Slopes , 1993, Cognitive Psychology.

[73]  I. Biederman,et al.  Recognizing depth-rotated objects: Evidence and conditions for three-dimensional viewpoint invariance. , 1993 .

[74]  N. Logothetis,et al.  View-dependent object recognition by monkeys , 1994, Current Biology.

[75]  T. Poggio,et al.  The importance of symmetry and virtual views in three-dimensional object recognition , 1994, Current Biology.

[76]  P. Jolicoeur,et al.  Rotated object identification with and without orientation cues. , 1995, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.