A parallel framework for interactive behavior.

Although theoretical models often assume that the basic organization of the nervous system involves separate systems for perception, cognition, and action, neural data often does not fit into any of these conceptual categories. Here, an alternative framework is described, which focuses on interactive behavior and treats it as a continuous competition between representations of currently available potential actions. This suggests a neural organization consisting of two parallel systems: a system for action specification, which uses sensory information to represent currently available potential actions, and a system for action selection, which involves attentional and decisional mechanisms which determine the action that will be performed. It is proposed that neural processing occurs through two waves of activation: an early wave which specifies several potential actions and a later wave of biasing influences which selects one action for execution. A computational model of decision making is described within the context of this proposal, and simulations of neural and behavioral phenomena are presented.

[1]  Ranulfo Romo,et al.  Flexible Control of Mutual Inhibition: A Neural Model of Two-Interval Discrimination , 2005, Science.

[2]  P. Glimcher.  The neurobiology of visual-saccadic decision making. , 2003, Annual review of neuroscience.

[3]  M. Shadlen,et al.  A representation of the hazard rate of elapsed time in macaque area LIP , 2005, Nature Neuroscience.

[4]  J. Stein.  The representation of egocentric space in the posterior parietal cortex. , 1992, The Behavioral and brain sciences.

[5]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[6]  J. Ewert,et al.  Neural modulation of visuomotor functions underlying prey-catching behaviour in anurans: perception, attention, motor performance, learning. , 2001, Comparative biochemistry and physiology. Part A, Molecular & integrative physiology.

[7]  P. Glimcher,et al.  Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action , 2004, Neuron.

[8]  R. Desimone.  Visual attention mediated by biased competition in extrastriate visual cortex. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[9]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[10]  Paul Cisek,et al.  Embodiment is all in the head , 2001, Behavioral and Brain Sciences.

[11]  G. Rizzolatti,et al.  Visuomotor neurons: ambiguity of the discharge or 'motor' perception? , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[12]  M. A. Basso,et al.  Modulation of Neuronal Activity in Superior Colliculus by Changes in Target Probability , 1998, The Journal of Neuroscience.

[13]  A. Osman,et al.  Dimensional overlap: cognitive basis for stimulus-response compatibility--a model and taxonomy. , 1990, Psychological review.

[14]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[15]  M Favilla,et al.  Reaching movements: concurrency of continuous and discrete programming , 1997, Neuroreport.

[16]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[17]  Stephen Grossberg,et al.  Contour Enhancement, Short Term Memory, and Constancies in Reverberating Neural Networks , 1973 .

[18]  R. Romo,et al.  Neuronal Correlates of a Perceptual Decision in Ventral Premotor Cortex , 2004, Neuron.

[19]  R. Ratcliff,et al.  A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. , 2003, Journal of neurophysiology.

[20]  M. Platt,et al.  Neural correlates of decisions , 2002, Current Opinion in Neurobiology.

[21]  E. Miller,et al.  The prefontral cortex and cognitive control , 2000, Nature Reviews Neuroscience.

[22]  N. Kanwisher,et al.  Neuroimaging of cognitive functions in human parietal cortex , 2001, Current Opinion in Neurobiology.

[23]  S. Grossberg,et al.  A Cortico-Spinal Model of Reaching and Proprioception under Multiple Task Constraints , 1998, Journal of Cognitive Neuroscience.

[24]  Y. Rossetti,et al.  The timing of color and location processing in the motor context , 1998, Experimental Brain Research.

[25]  S. Bressler,et al.  Large-scale visuomotor integration in the cerebral cortex. , 2007, Cerebral cortex.

[26]  G. E. Alexander,et al.  Neural correlates of a spatial sensory-to-motor transformation in primary motor cortex. , 1997, Journal of neurophysiology.

[27]  S. Wise,et al.  Rule-dependent neuronal activity in the prefrontal cortex , 1999, Experimental Brain Research.

[28]  Christopher A. Buneo,et al.  Direct visuomotor transformations for reaching , 2002, Nature.

[29]  R. H. S. Carpenter,et al.  Neural computation of log likelihood in control of saccadic eye movements , 1995, Nature.

[30]  B A J Reddi,et al.  Accuracy, information, and response time in a saccadic decision task. , 2003, Journal of neurophysiology.

[31]  Steven W. Keele,et al.  Movement control in skilled motor performance. , 1968 .

[32]  Peter Redgrave,et al.  Layered Control Architectures in Robots and Vertebrates , 1999, Adapt. Behav..

[33]  M. Goodale,et al.  The visual brain in action , 1995 .

[34]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[35]  Ned Block,et al.  The Mind as the Software of the Brain , 1995 .

[36]  John McCarthy,et al.  A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955 , 2006, AI Mag..

[37]  W. Hodos,et al.  Comparative Vertebrate Neuroanatomy: Evolution and Adaptation , 2005 .

[38]  Daniel Bullock,et al.  Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation , 1988 .

[39]  S. P. Wise,et al.  Primate frontal cortex: effects of stimulus and movement , 2004, Experimental Brain Research.

[40]  P. Glimcher,et al.  Responses of intraparietal neurons to saccadic targets and visual distractors. , 1997, Journal of neurophysiology.

[41]  G E Alexander,et al.  Neural representations of the target (goal) of visually guided arm movements in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[42]  G. Miller,et al.  Plans and the structure of behavior , 1960 .

[43]  J. Townsend,et al.  Multialternative Decision Field Theory: A Dynamic Connectionist Model of Decision Making , 2001 .

[44]  Philip N. Johnson-Laird,et al.  The computer and the mind - An introduction to cognitive science [Book Review] , 1989, Proceedings of the IEEE.

[45]  J. Kalaska,et al.  Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action , 2005, Neuron.

[46]  J. Driver,et al.  Control of Cognitive Processes: Attention and Performance XVIII , 2000 .

[47]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[48]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[49]  H. Hendriks-Jansen.  Catching Ourselves in the Act: Situated Activity, Interactive Emergence, Evolution, and Human Thought , 1996 .

[50]  P. Strick,et al.  Basal ganglia and cerebellar loops: motor and cognitive circuits , 2000, Brain Research Reviews.

[51]  O. Hikosaka,et al.  Visual and Anticipatory Bias in Three Cortical Eye Fields of the Monkey during an Adaptive Decision-Making Task , 2002, The Journal of Neuroscience.

[52]  R. Harris-Warrick,et al.  The evolution of neuronal circuits underlying species-specific behavior , 1999, Current Opinion in Neurobiology.

[53]  N. P. Bichot,et al.  Perceptual and motor processing stages identified in the activity of macaque frontal eye field neurons during visual search. , 1996, Journal of neurophysiology.

[54]  Paul Cisek,et al.  Neural representations of motor plans, desired trajectories, and controlled objects , 2005, Cognitive Processing.

[55]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[56]  J. Tanji,et al.  Neuronal activity in the primate prefrontal cortex in the process of motor selection based on two behavioral rules. , 2000, Journal of neurophysiology.

[57]  Leslie G. Ungerleider.  Two cortical visual systems , 1982 .

[58]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[59]  Christopher D. Carello,et al.  Manipulating Intent Evidence for a Causal Role of the Superior Colliculus in Target Selection , 2004, Neuron.

[60]  J. Kalaska,et al.  Deciding not to GO: neuronal correlates of response selection in a GO/NOGO task in primate premotor and parietal cortex. , 1995, Cerebral cortex.

[61]  J. Gold,et al.  Representation of a perceptual decision in developing oculomotor commands , 2000, Nature.

[62]  Jacqueline Gottlieb,et al.  The lateral intraparietal area as a salience map: the representation of abrupt onset, stimulus motion, and task relevance , 2000, Vision Research.

[63]  A. Reiner,et al.  Do birds possess homologues of mammalian primary visual, somatosensory and motor cortices? , 2000, Trends in Neurosciences.

[64]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[65]  S P Wise,et al.  Primate premotor cortex: dissociation of visuomotor from sensory signals. , 1992, Journal of neurophysiology.

[66]  S. Grossberg,et al.  Cortical networks for control of voluntary arm movements under variable force conditions. , 1998, Cerebral cortex.

[67]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[68]  L. Bianchi,et al.  Posterior parietal cortex: functional properties of neurons in area 5 during an instructed-delay reaching task within different parts of space , 2004, Experimental Brain Research.

[69]  W. Newsome,et al.  Representation of an abstract perceptual decision in macaque superior colliculus. , 2004, Journal of neurophysiology.

[70]  J. Kalaska,et al.  Prior information in motor and premotor cortex: activity during the delay period and effect on pre-movement activity. , 2000, Journal of neurophysiology.

[71]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[72]  J. McIntyre,et al.  Servo Hypotheses for the Biological Control of Movement. , 1993, Journal of motor behavior.

[73]  P. Glimcher.  Making choices: the neurophysiology of visual-saccadic decision making , 2001, Trends in Neurosciences.

[74]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[75]  N. P. Bichot,et al.  Neural correlates of visual and motor decision processes , 1998, Current Opinion in Neurobiology.

[76]  G E Alexander,et al.  Preferential representation of instructed target location versus limb trajectory in dorsal premotor area. , 1997, Journal of neurophysiology.

[77]  Otmar Bock,et al.  The mechanisms of movement preparation: a precuing study , 2000, Behavioural Brain Research.

[78]  C. Ghez,et al.  Discrete and continuous planning of hand movements and isometric force trajectories , 1997, Experimental Brain Research.

[79]  Nicholas Port,et al.  A Neural Network Model of Cortical Activity during Reaching , 1993, Journal of Cognitive Neuroscience.

[80]  M. Gazzaniga,et al.  The new cognitive neurosciences , 2000 .

[81]  A. Barto,et al.  Distributed motor commands in the limb premotor network , 1993, Trends in Neurosciences.

[82]  P. Cisek.  Integrated Neural Processes for Defining Potential Actions and Deciding between Them: A Computational Model , 2006, The Journal of Neuroscience.

[83]  M. Goldberg,et al.  Space and attention in parietal cortex. , 1999, Annual review of neuroscience.

[84]  J. Tanji,et al.  Behavioral planning in the prefrontal cortex , 2001, Current Opinion in Neurobiology.

[85]  Terence D Sanger,et al.  Neural population codes , 2003, Current Opinion in Neurobiology.

[86]  J. Hollerman,et al.  Reward processing in primate orbitofrontal cortex and basal ganglia. , 2000, Cerebral cortex.

[87]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[88]  R. Andersen,et al.  Intention-related activity in the posterior parietal cortex: a review , 2000, Vision Research.

[89]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[90]  J. Kalaska,et al.  Common codes for situated interaction , 2001 .

[91]  G. Boynton.  Attention and visual perception , 2005, Current Opinion in Neurobiology.

[92]  Roberta L. Klatzky,et al.  Embodiment, ego-space, and action , 2008 .

[93]  Jun Tanji,et al.  Integration of target and body-part information in the premotor cortex when planning action , 2000, Nature.

[94]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[95]  R. Andersen,et al.  Coding of intention in the posterior parietal cortex , 1997, Nature.

[96]  S. Wise,et al.  Visuospatial versus visuomotor activity in the premotor and prefrontal cortex of a primate , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[97]  F. Toates.  The interaction of cognitive and stimulus–response processes in the control of behaviour , 1997, Neuroscience & Biobehavioral Reviews.

[98]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[99]  Earl K. Miller,et al.  Selective representation of relevant information by neurons in the primate prefrontal cortex , 1998, Nature.

[100]  Paul Cisek,et al.  Cortical mechanisms of action selection: the affordance competition hypothesis , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[101]  S. Wise.  The primate premotor cortex: past, present, and preparatory. , 1985, Annual review of neuroscience.

[102]  S. Treue.  Neural correlates of attention in primate visual cortex , 2001, Trends in Neurosciences.

[103]  S. Morris,et al.  Head and backbone of the Early Cambrian vertebrate Haikouichthys , 2003, Nature.

[104]  J F Kalaska,et al.  Cortical control of whole-arm motor tasks. , 1998, Novartis Foundation symposium.

[105]  Peter Slezak,et al.  Computers, Brains and Minds , 1989 .

[106]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[107]  Pat Murtagh.  Opposition to Oncomouse , 1993, Nature.

[108]  Kim Sterelny.  Computational Functional Psychology: Problems and Prospects , 1989 .

[109]  G. Schöner,et al.  Dynamic Field Theory of Movement Preparation , 2022 .

[110]  Nicholas D Holland,et al.  Chordate origins of the vertebrate central nervous system , 1999, Current Opinion in Neurobiology.