Distinct neural substrates for the perception of real and virtual visual worlds

Virtual environments have been frequently used for training and skill improvement. However, do real and virtual worlds engage the same brain states in human perceivers? We measured brain activity using functional magnetic resonance imaging (fMRI) while adults watched movie and cartoon clips, simulating real and virtual visual worlds, respectively. Relative to baselines using random static images, the medial prefrontal cortex (MPFC) and the cerebellum were activated only by movie clips of other humans. In contrast, cartoon clips of human and non-human agents activated the superior parietal lobes, while movie clips of animals also activated the superior parietal lobes. Our fMRI findings suggest that the perception of real-world humans is characterised by the involvement of MPFC and the cerebellum, most likely for on-line representation of the mental states of others, whereas the perception of virtual-world agents engages the parietal cortex in attention to actions.

[1]  Uta Frith,et al.  Theory of mind , 2001, Current Biology.

[2]  Irvin Rock,et al.  The description and analysis of object and event perception. , 1986 .

[3]  R. Knight,et al.  Frontal Lobe Contributions to Theory of Mind , 1998, Journal of Cognitive Neuroscience.

[4]  K. Nakayama,et al.  The effect of face inversion on the human fusiform face area , 1998, Cognition.

[5]  Richard S. J. Frackowiak,et al.  Other minds in the brain: a functional imaging study of “theory of mind” in story comprehension , 1995, Cognition.

[6]  Karl J. Friston,et al.  Attention to Action: Specific Modulation of Corticocortical Interactions in Humans , 2001, NeuroImage.

[7]  D. Stuss,et al.  The frontal lobes are necessary for 'theory of mind'. , 2001, Brain : a journal of neurology.

[8]  Istvan Molnar-Szakacs,et al.  Watching social interactions produces dorsomedial prefrontal and medial parietal BOLD fMRI signal increases compared to a resting baseline , 2004, NeuroImage.

[9]  J. Decety,et al.  The effects of learning and intention on the neural network involved in the perception of meaningless actions. , 1999, Brain : a journal of neurology.

[10]  R Saxe,et al.  People thinking about thinking people The role of the temporo-parietal junction in “theory of mind” , 2003, NeuroImage.

[11]  T. Allison,et al.  Temporal Cortex Activation in Humans Viewing Eye and Mouth Movements , 1998, The Journal of Neuroscience.

[12]  R. Miall,et al.  A system in the human brain for predicting the actions of others , 2004, Nature Neuroscience.

[13]  Dana Samson,et al.  Left temporoparietal junction is necessary for representing someone else's belief , 2004, Nature Neuroscience.

[14]  Robert J. Seidel,et al.  Virtual Reality Training's Future: Perspectives on Virtual Reality and Related Emerging Technologies , 1997 .

[15]  B. Bower A Child's Theory of Mind , 1993 .

[16]  W. Lewis Johnson,et al.  Animated Agents for Procedural Training in Virtual Reality: Perception, Cognition, and Motor Control , 1999, Appl. Artif. Intell..

[17]  J. Desmond,et al.  Neuroimaging studies of the cerebellum: language, learning and memory , 1998, Trends in Cognitive Sciences.

[18]  C. Frith,et al.  Movement and Mind: A Functional Imaging Study of Perception and Interpretation of Complex Intentional Movement Patterns , 2000, NeuroImage.

[19]  M. Pihlajamäki,et al.  Visual Processing of Coherent Rotation in the Central Visual Field: An fMRI Study , 2003, Perception.

[20]  C. Frith,et al.  Reading the mind in cartoons and stories: an fMRI study of ‘theory of mind’ in verbal and nonverbal tasks , 2000, Neuropsychologia.

[21]  C. Frith,et al.  Interacting minds--a biological basis. , 1999, Science.

[22]  L. Beutler,et al.  Virtual reality in psychotherapy training. , 2004, Journal of clinical psychology.

[23]  J. Decety,et al.  A PET Investigation of the Attribution of Intentions with a Nonverbal Task , 2000, NeuroImage.

[24]  J. Decety,et al.  Effect of subjective perspective taking during simulation of action: a PET investigation of agency , 2001, Nature Neuroscience.

[25]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[26]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[27]  R. Andersen,et al.  Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  D. Premack,et al.  Does the chimpanzee have a theory of mind? , 1978, Behavioral and Brain Sciences.

[29]  C. D. Frith,et al.  Brain Activations during Visual Search: Contributions of Search Efficiency versus Feature Binding , 2003, NeuroImage.

[30]  C. Koch,et al.  Brain Areas Specific for Attentional Load in a Motion-Tracking Task , 2001, Journal of Cognitive Neuroscience.

[31]  M. Farah,et al.  What causes the face inversion effect? , 1995, Journal of experimental psychology. Human perception and performance.

[32]  G. Mangun,et al.  The neural mechanisms of top-down attentional control , 2000, Nature Neuroscience.

[33]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[34]  M. Raichle,et al.  Searching for a baseline: Functional imaging and the resting human brain , 2001, Nature Reviews Neuroscience.

[35]  Christopher D. Frith,et al.  Imaging the Intentional Stance in a Competitive Game , 2002, NeuroImage.