Simulation, situated conceptualization, and prediction

Based on accumulating evidence, simulation appears to be a basic computational mechanism in the brain that supports a broad spectrum of processes from perception to social cognition. Further evidence suggests that simulation is typically situated, with the situated character of experience in the environment being reflected in the situated character of the representations that underlie simulation. A basic architecture is sketched of how the brain implements situated simulation. Within this framework, simulators implement the concepts that underlie knowledge, and situated conceptualizations capture patterns of multi-modal simulation associated with frequently experienced situations. A pattern completion inference mechanism uses current perception to activate situated conceptualizations that produce predictions via simulations on relevant modalities. Empirical findings from perception, action, working memory, conceptual processing, language and social cognition illustrate how this framework produces the extensive prediction that characterizes natural intelligence.

[1]  U. Neisser Concepts and Conceptual Development: Ecological and Intellectual Factors in Categorization , 1989 .

[2]  Friedemann Pulverm Uuml,et al.  Words in the brain's language , 1999 .

[3]  JamesW. Lewis Cortical Networks Related to Human Use of Tools , 2006, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[4]  Linda B. Smith Cognition as a dynamic system: Principles from embodiment , 2005 .

[5]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[6]  Rick Grush,et al.  The emulation theory of representation: Motor control, imagery, and perception , 2004, Behavioral and Brain Sciences.

[7]  D. Medin,et al.  The specific character of abstract thought: Categorization, problem-solving, and induction: Volume 5 , 1989 .

[8]  Daniel L. Schacter,et al.  Specificity of priming: a cognitive neuroscience perspective , 2004, Nature Reviews Neuroscience.

[9]  Rolf A. Zwaan,et al.  Seeing, acting, understanding: motor resonance in language comprehension. , 2006, Journal of experimental psychology. General.

[10]  M. Shiffrar,et al.  New aspects of motion perception: selective neural encoding of apparent human movements , 2000, Neuroreport.

[11]  Bruno H Repp,et al.  Perceiving Action Identity , 2004, Psychological science.

[12]  Sergio E Chaigneau,et al.  Situational information contributes to object categorization and inference. , 2009, Acta psychologica.

[13]  Ken McRae,et al.  Category - Specific semantic deficits , 2008 .

[14]  D. Proffitt Embodied Perception and the Economy of Action , 2006, Perspectives on psychological science : a journal of the Association for Psychological Science.

[15]  Sian L. Beilock,et al.  Expertise and its embodiment: Examining the impact of sensorimotor skill expertise on the representation of action-related text , 2006, Psychonomic bulletin & review.

[16]  Sergio E. Chaigneau,et al.  THE SIMILARITY-IN-TOPOGRAPHY PRINCIPLE: RECONCILING THEORIES OF CONCEPTUAL DEFICITS , 2003, Cognitive neuropsychology.

[17]  J. Decety,et al.  Functional anatomy of execution, mental simulation, observation, and verb generation of actions: A meta‐analysis , 2001, Human brain mapping.

[18]  Lawrence W. Barsalou,et al.  The instability of graded structure: implications for the nature of concepts , 1987 .

[19]  Markus Graf,et al.  The role of action representations in visual object recognition , 2006, Experimental Brain Research.

[20]  L. Barsalou,et al.  Embodiment in Attitudes, Social Perception, and Emotion , 2005, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[21]  George S. Cree,et al.  Evocation of functional and volumetric gestural knowledge by objects and words , 2008, Cognition.

[22]  J. Freyd,et al.  Timing and Apparent Motion Path Choice With Human Body Photographs , 1993 .

[23]  R. Zatorre,et al.  Behavioral and neural correlates of perceived and imagined musical timbre , 2004, Neuropsychologia.

[24]  C. Reed,et al.  Conceptual effects on representational momentum. , 1996, Journal of experimental psychology. Human perception and performance.

[25]  A. Gregg An integration. , 1953, Journal of the Mount Sinai Hospital, New York.

[26]  F. Pulvermüller,et al.  Words in the brain's language , 1999, Behavioral and Brain Sciences.

[27]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[28]  S. Thompson-Schill Neuroimaging studies of semantic memory: inferring “how” from “where” , 2003, Neuropsychologia.

[29]  L. Barsalou Situated simulation in the human conceptual system , 2003 .

[30]  Robert L. Goldstone,et al.  The development of features in object concepts , 1998, Behavioral and Brain Sciences.

[31]  Lawerence W. Barsalou Intraconcept similarity and its implications for interconcept similarity , 1989 .

[32]  T. Matlock Fictive motion as cognitive simulation , 2004, Memory & cognition.

[33]  Teenie Matlock,et al.  The integration of figurative language and static depictions: An eye movement study of fictive motion , 2007, Cognition.

[34]  S. Kosslyn Image and brain: the resolution of the imagery debate , 1994 .

[35]  R. Ilmoniemi,et al.  Functional links between motor and language systems , 2005, The European journal of neuroscience.

[36]  James L. McClelland,et al.  A computational model of semantic memory impairment: modality specificity and emergent category specificity. , 1991, Journal of experimental psychology. General.

[37]  A. Damasio Time-locked multiregional retroactivation: A systems-level proposal for the neural substrates of recall and recognition , 1989, Cognition.

[38]  I. Biederman Perceiving Real-World Scenes , 1972, Science.

[39]  R. Finke,et al.  Principles of mental imagery , 1989 .

[40]  G. Rizzolatti,et al.  Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. , 2005, Brain research. Cognitive brain research.

[41]  Katja Wiemer-Hastings,et al.  Imagery, Context Availabilty, Contextual Constraint and Abstractness , 2001 .

[42]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[43]  S. Kosslyn Image and Brain , 1994 .

[44]  tephen E. Palmer The effects of contextual scenes on the identification of objects , 1975, Memory & cognition.

[45]  J. Freyd Dynamic mental representations. , 1987, Psychological review.

[46]  Robert L. Goldstone Effects of Categorization on Color Perception , 1995 .

[47]  Michael Gasser,et al.  The Development of Embodied Cognition: Six Lessons from Babies , 2005, Artificial Life.

[48]  M. Jeannerod Mental imagery in the motor context , 1995, Neuropsychologia.

[49]  W. Prinz,et al.  Inferring another's expectation from action: the role of peripheral sensation , 2005, Nature Neuroscience.

[50]  L. Jacoby Remembering the data: analyzing interactive processes in reading , 1983 .

[51]  R. Gibbs Embodiment and Cognitive Science: Concepts , 2005 .

[52]  L M Parsons,et al.  Imagined spatial transformation of one's body. , 1987, Journal of experimental psychology. General.

[53]  L. Jacoby,et al.  Specific Visual Transfer in Word Identification , 1987 .

[54]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[55]  H. Roediger Implicit memory in normal human subjects , 1993 .

[56]  L. Parsons Imagined spatial transformations of one's hands and feet , 1987, Cognitive Psychology.

[57]  K. Gegenfurtner,et al.  Memory modulates color appearance , 2006, Nature Neuroscience.

[58]  B. G. Sidharth,et al.  Effects of Varying , 1999 .

[59]  Piotr Winkielman,et al.  Embodied Grounding Social , Cognitive , Affective , and Neuroscientific Approaches , 2009 .

[60]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[61]  L. Barsalou Flexibility, Structure, and Linguistic Vagary in Concepts: Manifestations of a Compositional System of Perceptual Symbols , 2019, Theories of Memory.

[62]  R. M. Warren Perceptual Restoration of Missing Speech Sounds , 1970, Science.

[63]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[64]  Cynthia Breazeal,et al.  Cognition as coordinated non-cognition , 2007, Cognitive Processing.

[65]  A. Samuel Lexical Activation Produces Potent Phonemic Percepts , 1997, Cognitive Psychology.

[66]  H L Roediger,et al.  Effects of varying modality, surface features, and retention interval on priming in word-fragment completion , 1987, Memory & cognition.

[67]  Lawrence W Barsalou,et al.  Abstraction in perceptual symbol systems. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[68]  Rolf A. Zwaan,et al.  Embodied Sentence Comprehension , 2005 .

[69]  Jerome S. Bruner,et al.  Going Beyond the Information Given , 2006 .

[70]  L. Barsalou,et al.  Perceptual simulation in conceptual combination: evidence from property generation. , 2009, Acta psychologica.

[71]  Kim Kirsner,et al.  Domain-specific resources in word recognition , 1989 .

[72]  P. Benner The Cambridge Handbook of Situated Cognition: Book Review , 2010 .

[73]  Michael P. Kaschak,et al.  The Body's Contribution to Language , 2003 .

[74]  Ravi S. Menon,et al.  Motor Area Activity During Mental Rotation Studied by Time-Resolved Single-Trial fMRI , 2000, Journal of Cognitive Neuroscience.

[75]  D L Schacter,et al.  Modality specificity of implicit memory for new associations. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[76]  G. Knoblich,et al.  The case for motor involvement in perceiving conspecifics. , 2005, Psychological bulletin.

[77]  W. K. Simmons,et al.  Pictures of appetizing foods activate gustatory cortices for taste and reward. , 2005, Cerebral cortex.

[78]  J. Freyd,et al.  Apparent Motion of the Human Body , 1990 .

[79]  R. Ellis,et al.  The potentiation of grasp types during visual object categorization , 2001 .

[80]  L. Barsalou,et al.  Situating Abstract Concepts , 2004 .

[81]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[82]  S. Kosslyn Image and mind , 1982 .

[83]  Lawrence W. Barsalou,et al.  Being there conceptually: simulating categories in preparation for situated action , 2002 .

[84]  Lawrence W. Barsalou,et al.  Continuity of the conceptual system across species , 2005, Trends in Cognitive Sciences.

[85]  Daniel C. Richardson,et al.  Spatial representations activated during real-time comprehension of verbs , 2003, Cogn. Sci..

[86]  S. Ullman,et al.  Spatial Context in Recognition , 1996, Perception.

[87]  P. Jolicoeur The time to name disoriented natural objects , 1985, Memory & cognition.

[88]  L. Barsalou,et al.  The situated nature of concepts. , 2006, The American journal of psychology.

[89]  Alex Martin,et al.  Representation of Manipulable Man-Made Objects in the Dorsal Stream , 2000, NeuroImage.

[90]  Alex Martin,et al.  Functional Neuroimaging of Semantic Memory , 2001 .

[91]  P. Robbins,et al.  The Cambridge Handbook of Situated Cognition , 2001 .