BOLD Activity during Mental Rotation and Viewpoint-Dependent Object Recognition

We measured brain activity during mental rotation and object recognition with objects rotated around three different axes. Activity in the superior parietal lobe (SPL) increased proportionally to viewpoint disparity during mental rotation, but not during object recognition. In contrast, the fusiform gyrus was preferentially recruited in a viewpoint-dependent manner in recognition as compared to mental rotation. In addition, independent of the effect of viewpoint, object recognition was associated with ventral areas and mental rotation with dorsal areas. These results indicate that the similar behavioral effects of viewpoint obtained in these two tasks are based on different neural substrates. Such findings call into question the hypothesis that mental rotation is used to compensate for changes in viewpoint during object recognition.

[1]  A. Georgopoulos,et al.  Time‐resolved fMRI of mental rotation , 1997, Neuroreport.

[2]  M J Tarr,et al.  Is human object recognition better described by geon structural descriptions or by multiple views? Comment on Biederman and Gerhardstein (1993). , 1995, Journal of experimental psychology. Human perception and performance.

[3]  Mark S. Cohen,et al.  Changes in cortical activity during mental rotation. A mapping study using functional MRI. , 1996, Brain : a journal of neurology.

[4]  M. Tarr.  Rotating objects to recognize them: A case study on the role of viewpoint dependency in the recognition of three-dimensional objects , 1995, Psychonomic bulletin & review.

[5]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[6]  M. Tarr,et al.  Testing conditions for viewpoint invariance in object recognition. , 1997, Journal of experimental psychology. Human perception and performance.

[7]  Heinrich H Bülthoff,et al.  Image-based object recognition in man, monkey and machine , 1998, Cognition.

[8]  Michael J Tarr,et al.  What defines a view? , 2001, Vision Research.

[9]  I. Biederman,et al.  Viewpoint-dependent mechanisms in visual object recognition: Reply to Tarr and Bülthoff (1995). , 1995 .

[10]  M. Just,et al.  Graded Functional Activation in the Visuospatial System with the Amount of Task Demand , 1999, Journal of Cognitive Neuroscience.

[11]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[12]  R. Luce,et al.  Effects of stimulus complexity on mental rotation rate of polygons. , 1987, Journal of experimental psychology. Human perception and performance.

[13]  M. Tarr,et al.  Do viewpoint-dependent mechanisms generalize across members of a class? , 1998, Cognition.

[14]  Pierre Jolicoeur,et al.  Identification of Disoriented Objects: A Dual‐systems Theory , 1990 .

[15]  Peter Andersen,et al.  Mental Rotation Studied by Functional Magnetic Resonance Imaging at High Field (4 Tesla): Performance and Cortical Activation , 1997, Journal of Cognitive Neuroscience.

[16]  Rebecca Lawson,et al.  Object Recognition under Sequential Viewing Conditions: Evidence for Viewpoint-Specific Recognition Procedures , 1994, Perception.

[17]  M. Goodale,et al.  The visual brain in action , 1995 .

[18]  Michael J. Tarr.  Is human object recognition better described by geon structural description or by multiple views , 1995 .

[19]  I. Biederman,et al.  Recognizing depth-rotated objects: Evidence and conditions for three-dimensional viewpoint invariance. , 1993 .

[20]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[21]  N. Logothetis,et al.  View-dependent object recognition by monkeys , 1994, Current Biology.

[22]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[23]  John C. Gore,et al.  ROC Analysis of Statistical Methods Used in Functional MRI: Individual Subjects , 1999, NeuroImage.

[24]  P. Jolicoeur.  The time to name disoriented natural objects , 1985, Memory & cognition.

[25]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[26]  R. Shepard,et al.  Mental Images and Their Transformations , 1982 .

[27]  J. T. Massey,et al.  Mental rotation of the neuronal population vector. , 1989, Science.

[28]  M. Corballis,et al.  Winding one's ps and qs: mental rotation and mirror-image discrimination. , 1984, Journal of experimental psychology. Human perception and performance.

[29]  I. Rock,et al.  Can we imagine how objects look from other viewpoints? , 1989, Cognitive Psychology.

[30]  G. Humphrey,et al.  Recognizing novel views of three-dimensional objects. , 1992, Canadian journal of psychology.

[31]  M. Tarr,et al.  Mental rotation and orientation-dependence in shape recognition , 1989, Cognitive Psychology.

[32]  J. H. Steiger,et al.  Nonholistic processing in mental rotation: Some suggestive evidence , 1982, Perception & psychophysics.

[33]  H H Bülthoff,et al.  Psychophysical support for a two-dimensional view interpolation theory of object recognition. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[34]  J. Hochberg,et al.  The effect of landmark features on mental rotation times , 1977, Memory & cognition.

[35]  A. J. Mistlin,et al.  Visual neurones responsive to faces , 1987, Trends in Neurosciences.

[36]  Leslie G. Ungerleider.  Two cortical visual systems , 1982 .

[37]  K. Grill-Spector,et al.  fMR-adaptation: a tool for studying the functional properties of human cortical neurons. , 2001, Acta psychologica.

[38]  M. Torrens.  Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[39]  M. Tarr,et al.  The Fusiform Face Area is Part of a Network that Processes Faces at the Individual Level , 2000, Journal of Cognitive Neuroscience.

[40]  A. Nobre,et al.  Where and When to Pay Attention: The Neural Systems for Directing Attention to Spatial Locations and to Time Intervals as Revealed by Both PET and fMRI , 1998, The Journal of Neuroscience.

[41]  F. Peronnet,et al.  Mental Rotation and Mirror-Image Discrimination , 1994, Perceptual and motor skills.

[42]  B. J. McCurtain,et al.  Dorsal cortical regions subserving visually guided saccades in humans: an fMRI study. , 1998, Cerebral cortex.

[43]  W. Hayward,et al.  Viewpoint Dependence and Object Discriminability , 2000, Psychological science.

[44]  M. Corbetta,et al.  A Common Network of Functional Areas for Attention and Eye Movements , 1998, Neuron.

[45]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[46]  Peter Andersen,et al.  Quantitative relations between parietal activation and performance in mental rotation , 1996, Neuroreport.

[47]  H. Stenson.  The psychophysical dimensions of similarity among random shapes , 1968 .

[48]  M. Petrides,et al.  Functional activation of the human brain during mental rotation , 1997, Neuropsychologia.

[49]  D. Perrett,et al.  Evidence accumulation in cell populations responsive to faces: an account of generalisation of recognition without mental transformations , 1998, Cognition.

[50]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.