Emulation as an Integrating Principle for Cognition

Emulations, defined as ongoing internal representations of potential actions and the futures those actions are expected to produce, play a critical role in directing human bodily activities. Studies of gross motor behavior, perception, allocation of attention, response to errors, interoception, and homeostatic activities, and higher cognitive reasoning suggest that the proper execution of all these functions relies on emulations. Further evidence supports the notion that reinforcement learning in humans is aimed at updating emulations, and that action selection occurs via the advancement of preferred emulations toward realization of their action and environmental prediction. Emulations are hypothesized to exist as distributed active networks of neurons in cortical and sub-cortical structures. This manuscript ties together previously unrelated theories of the role of prediction in different aspects of human information processing to create an integrated framework for cognition.

[1]  L. Christensen,et al.  University of Birmingham Disruption of state estimation in the human lateral cerebellum , 2007 .

[2]  Jennifer A. Mangels,et al.  Predictive Codes for Forthcoming Perception in the Frontal Cortex , 2006, Science.

[3]  Karl J. Friston,et al.  Predictive coding under the free-energy principle , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[4]  Horst-Michael Groß,et al.  Generative character of perception: a neural architecture for sensorimotor anticipation , 1999, Neural Networks.

[5]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[6]  Udo Rudolph,et al.  An experimental analysis of surprise , 1991 .

[7]  Jeffrey M. Zacks,et al.  Event perception: a mind-brain perspective. , 2007, Psychological bulletin.

[8]  W. Prinz Perception and Action Planning , 1997 .

[9]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[10]  Tom Ziemke,et al.  Representation as Internal Simulation: A Minimalistic Robotic Model , 2009 .

[11]  P. Cisek Integrated Neural Processes for Defining Potential Actions and Deciding between Them: A Computational Model , 2006, The Journal of Neuroscience.

[12]  Moshe Bar,et al.  Predictions: a universal principle in the operation of the human brain , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[13]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[14]  Stephen M. Kosslyn,et al.  Visual mental images in the brain: Current issues , 1994 .

[15]  Daniel L. Schwartz,et al.  Analog Imagery in Mental Model Reasoning: Depictive Models , 1996, Cognitive Psychology.

[16]  Martin P. Paulus,et al.  Anterior insular cortex anticipates impending stimulus significance , 2009, NeuroImage.

[17]  R. Schubotz Prediction of external events with our motor system: towards a new framework , 2007, Trends in Cognitive Sciences.

[18]  Michael A. Arbib,et al.  Perceptual Structures and Distributed Motor Control , 1981 .

[19]  Clay B. Holroyd,et al.  The feedback correct-related positivity: sensitivity of the event-related brain potential to unexpected positive feedback. , 2008, Psychophysiology.

[20]  Phan Luu,et al.  The Anterior Cingulate Cortex : Regulating Actions in Context , 2004 .

[21]  Donna Rose Addis,et al.  Mental time travel and the shaping of the human mind , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[22]  J. Hohnsbein,et al.  Effects of crossmodal divided attention on late ERP components. II. Error processing in choice reaction tasks. , 1991, Electroencephalography and clinical neurophysiology.

[23]  Rajesh P. N. Rao,et al.  Decision Making Under Uncertainty: A Neural Model Based on Partially Observable Markov Decision Processes , 2010, Front. Comput. Neurosci..

[24]  M. Raichle The Brain's Dark Energy , 2006, Science.

[25]  Richard J. Davidson,et al.  Functional neuroanatomy of aversion and its anticipation , 2006, NeuroImage.

[26]  A. Craig How do you feel? Interoception: the sense of the physiological condition of the body , 2002, Nature Reviews Neuroscience.

[27]  M. Bar The proactive brain: using analogies and associations to generate predictions , 2007, Trends in Cognitive Sciences.

[28]  C. J. S. Collins,et al.  Target selection for predictive smooth pursuit eye movements , 2004, Experimental Brain Research.

[29]  G. Rizzolatti,et al.  Object representation in the ventral premotor cortex (area F5) of the monkey. , 1997, Journal of neurophysiology.

[30]  D. Schacter,et al.  On the nature of medial temporal lobe contributions to the constructive simulation of future events , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[31]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[32]  D. Wolpert,et al.  The cerebellum is involved in predicting the sensory consequences of action , 1999, Neuroreport.

[33]  Keith L. Downing,et al.  Predictive models in the brain , 2009, Connect. Sci..

[34]  M. Jeannerod Neural Simulation of Action: A Unifying Mechanism for Motor Cognition , 2001, NeuroImage.

[35]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[36]  Sisir Roy,et al.  The ‘prediction imperative’ as the basis for self-awareness , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[37]  Tom Ziemke,et al.  Neural Pathways of Embodied Simulation , 2009, ABiALS.

[38]  D. Long I of the Vortex: From Neurons to Self , 2002 .

[39]  Cynthia Breazeal,et al.  Cognition as coordinated non-cognition , 2007, Cognitive Processing.

[40]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[41]  Jörn Diedrichsen,et al.  Illusions of force perception: the role of sensori-motor predictions, visual information, and motor errors. , 2007, Journal of neurophysiology.

[42]  W. H. F. Barnes The Nature of Explanation , 1944, Nature.

[43]  P. Nixon,et al.  The role of the cerebellum in preparing responses to predictable sensory events , 2008, The Cerebellum.

[44]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[45]  R. Andersen,et al.  Memory related motor planning activity in posterior parietal cortex of macaque , 1988, Experimental Brain Research.

[46]  E. Keller,et al.  Characterization of prediction in the primate visual smooth pursuit system. , 1995, Bio Systems.

[47]  Markus Knauff,et al.  A Neuro-Cognitive Theory of Deductive Relational Reasoning with Mental Models and Visual Images , 2009, Spatial Cogn. Comput..

[48]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[49]  Armin Stock,et al.  A short history of ideo-motor action , 2004, Psychological research.

[50]  Jeremy M. Wolfe,et al.  Guided Search 4.0: Current Progress With a Model of Visual Search , 2007, Integrated Models of Cognitive Systems.

[51]  Timothy E. J. Behrens,et al.  Optimal decision making and the anterior cingulate cortex , 2006, Nature Neuroscience.

[52]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[53]  J. Hawkins,et al.  On Intelligence , 2004 .

[54]  Brian Knutson,et al.  Anticipatory affect: neural correlates and consequences for choice , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[55]  S. Quartz,et al.  Human Insula Activation Reflects Risk Prediction Errors As Well As Risk , 2008, The Journal of Neuroscience.

[56]  M. Paulus,et al.  An Insular View of Anxiety , 2006, Biological Psychiatry.

[57]  María Herrojo Ruiz,et al.  Detecting wrong notes in advance: neuronal correlates of error monitoring in pianists. , 2009, Cerebral cortex.

[58]  Rocky Ross,et al.  Mental models , 2004, SIGA.

[59]  J. Grafman,et al.  Structured event complexes in the medial prefrontal cortex support counterfactual representations for future planning , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[60]  A. Nobre,et al.  The hazards of time , 2007, Current Opinion in Neurobiology.

[61]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[62]  M. Botvinick,et al.  Anterior cingulate cortex, error detection, and the online monitoring of performance. , 1998, Science.

[63]  Mark F Bear,et al.  Reward timing in the primary visual cortex. , 2006, Science.

[64]  R. Dolan,et al.  Reward Facilitates Tactile Judgments and Modulates Hemodynamic Responses in Human Primary Somatosensory Cortex , 2008, The Journal of Neuroscience.

[65]  David Goodman,et al.  Performance Monitoring in the Anterior Cingulate is Not All Error Related: Expectancy Deviation and the Representation of Action-Outcome Associations , 2007, Journal of Cognitive Neuroscience.

[66]  Tomifusa Kuboki,et al.  Error-related negativity reflects detection of negative reward prediction error , 2004, Neuroreport.

[67]  D. Meyer,et al.  A Neural System for Error Detection and Compensation , 1993 .

[68]  Demis Hassabis,et al.  The construction system of the brain , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[69]  Wilfried Kunde,et al.  No anticipation–no action: the role of anticipation in action and perception , 2007, Cognitive Processing.

[70]  Rick Grush,et al.  The emulation theory of representation: Motor control, imagery, and perception , 2004, Behavioral and Brain Sciences.

[71]  Ravi S. Menon,et al.  Dissociating pain from its anticipation in the human brain. , 1999, Science.

[72]  M. Hegarty Mechanical reasoning by mental simulation , 2004, Trends in Cognitive Sciences.

[73]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[74]  Martin V. Butz,et al.  Introduction: Anticipation in Natural and Artificial Cognition , 2008, The Challenge of Anticipation.

[75]  W. Meyer,et al.  Toward a Process Analysis of Emotions: The Case of Surprise , 1997 .

[76]  Mary Hayhoe,et al.  The role of internal models and prediction in catching balls , 2005, AAAI 2005.

[77]  Michael J. Frank,et al.  Error-Related Negativity Predicts Reinforcement Learning and Conflict Biases , 2005, Neuron.

[78]  J. Fuster The prefrontal cortex, mediator of cross-temporal contingencies. , 1985, Human neurobiology.

[79]  Dana H. Ballard,et al.  Modeling embodied visual behaviors , 2007, TAP.

[80]  H. Critchley,et al.  Neural systems supporting interoceptive awareness , 2004, Nature Neuroscience.

[81]  G. Hesslow Conscious thought as simulation of behaviour and perception , 2002, Trends in Cognitive Sciences.

[82]  J M Fuster,et al.  Neuronal firing in the inferotemporal cortex of the monkey in a visual memory task , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[83]  M. Roesch,et al.  Orbitofrontal Cortex, Associative Learning, and Expectancies , 2005, Neuron.

[84]  Lorna C. Quandt,et al.  Anxiety and error monitoring: Increased error sensitivity or altered expectations? , 2007, Brain and Cognition.

[85]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[86]  Gernot Horstmann,et al.  The time course of intended and unintended allocation of attention , 2006, Psychological research.

[87]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[88]  M. Kawato,et al.  Internal forward models in the cerebellum: fMRI study on grip force and load force coupling. , 2003, Progress in brain research.

[89]  Timothy D. Wilson,et al.  Prospection: Experiencing the Future , 2007, Science.

[90]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[91]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[92]  M. Posner,et al.  Localization of a Neural System for Error Detection and Compensation , 1994 .

[93]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[94]  P. R. Davidson,et al.  Widespread access to predictive models in the motor system: a short review , 2005, Journal of neural engineering.

[95]  Antonio Torralba,et al.  Top-down control of visual attention in object detection , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[96]  L. Itti,et al.  Search Goal Tunes Visual Features Optimally , 2007, Neuron.

[97]  Lawrence W Barsalou,et al.  Simulation, situated conceptualization, and prediction , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[98]  Karl J. Friston,et al.  Influence of Uncertainty and Surprise on Human Corticospinal Excitability during Preparation for Action , 2008, Current Biology.

[99]  W. James,et al.  The Principles of Psychology. , 1983 .

[100]  Stephen M. Kosslyn,et al.  Roles of imagery in perception: Or, there is no such thing as immaculate perception , 1995 .

[101]  Stefan Schaal,et al.  Forward models in visuomotor control. , 2002, Journal of neurophysiology.

[102]  Karl J. Friston,et al.  Free-energy and the brain , 2007, Synthese.

[103]  George I. Christopoulos,et al.  Risk-dependent reward value signal in human prefrontal cortex , 2009, Proceedings of the National Academy of Sciences.

[104]  G. Horstmann Attentional capture by an unannounced color singleton depends on expectation discrepancy. , 2005, Journal of experimental psychology. Human perception and performance.

[105]  Jonathan Evans Dual-processing accounts of reasoning, judgment, and social cognition. , 2008, Annual review of psychology.

[106]  G. Mangun,et al.  Brain regions activated by endogenous preparatory set shifting as revealed by fMRI , 2006, Cognitive, affective & behavioral neuroscience.

[107]  Ricarda I. Schubotz,et al.  Prediction, Cognition and the Brain , 2009, Front. Hum. Neurosci..

[108]  Cristiano Castelfranchi,et al.  The symbol detachment problem , 2007, Cognitive Processing.

[109]  D. Ingvar "Memory of the future": an essay on the temporal organization of conscious awareness. , 1985, Human neurobiology.

[110]  M. Bar A Cortical Mechanism for Triggering Top-Down Facilitation in Visual Object Recognition , 2003, Journal of Cognitive Neuroscience.

[111]  F. Garbarini,et al.  At the root of embodied cognition: Cognitive science meets neurophysiology , 2004, Brain and Cognition.

[112]  W. Schultz,et al.  Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[113]  V. Srinivasa Chakravarthy,et al.  What do the basal ganglia do? A modeling perspective , 2010, Biological Cybernetics.

[114]  Martin V. Butz,et al.  The Challenge of Anticipation, A Unifying Framework for the Analysis and Design of Artificial Cognitive Systems , 2008, The Challenge of Anticipation.

[115]  R. Buckner,et al.  Self-projection and the brain , 2007, Trends in Cognitive Sciences.

[116]  A. Nobre,et al.  Dissociating explicit timing from temporal expectation with fMRI , 2008, Current Opinion in Neurobiology.

[117]  Tom Ziemke,et al.  Internal simulation of perception: a minimal neuro-robotic model , 2005, Neurocomputing.

[118]  Samuel T. Moulton,et al.  Imagining predictions: mental imagery as mental emulation , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[119]  Brian Knutson,et al.  Individual Differences in Insular Sensitivity During Loss Anticipation Predict Avoidance Learning , 2008, Psychological science.

[120]  Michael X. Cohen,et al.  Behavioral / Systems / Cognitive Reinforcement Learning Signals Predict Future Decisions , 2007 .

[121]  J. Fuster The cognit: a network model of cortical representation. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[122]  E. Bizzi,et al.  The Cognitive Neurosciences , 1996 .

[123]  Philip N. Johnson-Laird,et al.  Mental Models in Cognitive Science , 1980, Cogn. Sci..

[124]  M. Hayhoe,et al.  Adaptive Gaze Control in Natural Environments , 2009, The Journal of Neuroscience.

[125]  J. Bruner,et al.  On the perception of incongruity; a paradigm. , 1949, Journal of personality.

[126]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[127]  D. Schacter,et al.  The cognitive neuroscience of constructive memory: remembering the past and imagining the future , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[128]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[129]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[130]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[131]  Giovanni Pezzulo,et al.  DiPRA: a layered agent architecture which integrates practical reasoning and sensorimotor schemas , 2009, Connect. Sci..

[132]  D. Schacter,et al.  The Brain's Default Network , 2008, Annals of the New York Academy of Sciences.

[133]  Moshe Bar,et al.  See it with feeling: affective predictions during object perception , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[134]  J. Lupiáñez,et al.  A review of attentional capture: On its automaticity and sensitivity to endogenous control. , 2002 .

[135]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[136]  L. Itti,et al.  Modeling the influence of task on attention , 2005, Vision Research.

[137]  Karl J. Friston The free-energy principle: a rough guide to the brain? , 2009, Trends in Cognitive Sciences.