A dynamic field theoretic model of Iowa gambling task performance

Choice behaviour where outcome-contingencies vary or are probabilistic has been the focus of many benchmark tasks of infant to adult development in the psychology literature. Dynamic field theoretic (DFT) investigations of cognitive and behavioural competencies have been used in order to identify parameters critical to infant development. In this paper we report the findings of a DFT model that is able to replicate normal functioning adult performance on the Iowa gambling task (IGT). The model offers a simple demonstration proof of the parsimonious reversal learning alternative to Damasio's somatic marker explanation of IGT performance. Our simple model demonstrates a potentially important role for reinforcement/reward learning to generating behaviour that allows for advantageous performance. We compare our DFT modelling approach to one used on the A-not-B infant paradigm and suggest that a critical aspect of development lies in the ability to flexibly trade off perseverative versus exploratory behaviour in order to capture statistical choice-outcome contingencies. Finally, we discuss the importance of an investigation of the IGT in an embodied setting where reward prediction learning may provide critical means by which adaptive behavioural reversals can be enacted.

[1]  E. Thelen,et al.  The dynamics of embodiment: A field theory of infant perseverative reaching , 2001, Behavioral and Brain Sciences.

[2]  M. Farah,et al.  Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. , 2003, Brain : a journal of neurology.

[3]  Ulrich Müller,et al.  The development of executive function in early childhood: I. The development of executive function. , 2003 .

[4]  M. Posner The Brain and Emotion , 1999, Nature Medicine.

[5]  Anne R. Schutte,et al.  Testing the dynamic field theory: working memory for locations becomes more spatially precise over development. , 2003, Child development.

[6]  A. Lawrence,et al.  The somatic marker hypothesis: A critical evaluation , 2006, Neuroscience & Biobehavioral Reviews.

[7]  Adele Diamond,et al.  Looking closely at infants' performance and experimental procedures in the A-not-B task , 2001, Behavioral and Brain Sciences.

[8]  J. Fuster Prefrontal Cortex , 2018 .

[9]  Tom Ziemke,et al.  Modelling Coordination of Learning Systems: A Reservoir Systems Approach to Dopamine Modulated Pavlovian Conditioning , 2009, ECAL.

[10]  A. Damasio Descartes' error: emotion, reason, and the human brain. avon books , 1994 .

[11]  Hiroyuki Iizuka,et al.  Toward Spinozist Robotics: Exploring the Minimal Dynamics of Behavioral Preference , 2007, Adapt. Behav..

[12]  Antonio Damasio,et al.  The somatic marker hypothesis: A neural theory of economic decision , 2005, Games Econ. Behav..

[13]  Florentin Wörgötter,et al.  Temporal Sequence Learning, Prediction, and Control: A Review of Different Models and Their Relation to Biological Mechanisms , 2005, Neural Computation.

[14]  H. Wellman,et al.  Infant search and object permanence: a meta-analysis of the A-not-B error. , 1987, Monographs of the Society for Research in Child Development.

[15]  R. Bos,et al.  Toward a rodent model of the Iowa gambling task , 2006, Behavior research methods.

[16]  D. Tranel,et al.  Visceral and decision-making functions of the ventromedial prefrontal cortex , 2006 .

[17]  Anne R. Schutte,et al.  Generalizing the dynamic field theory of spatial cognition across real and developmental time scales , 2008, Brain Research.

[18]  Gregor Schöner,et al.  Development as Change of System Dynamics: Stability, Instability, and Emergence , 2009 .

[19]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[20]  Roland E. Suri,et al.  TD models of reward predictive responses in dopamine neurons , 2002, Neural Networks.

[21]  Graham V. Williams,et al.  Inverted-U dopamine D1 receptor actions on prefrontal neurons engaged in working memory , 2007, Nature Neuroscience.

[22]  Ulrich Müller,et al.  The development of executive function in early childhood. , 1991, Monographs of the Society for Research in Child Development.

[23]  T. Robbins,et al.  Serotonergic and Dopaminergic Modulation of Gambling Behavior as Assessed Using a Novel Rat Gambling Task , 2009, Neuropsychopharmacology.

[24]  Catalina J. Hooper,et al.  Adolescents' performance on the Iowa Gambling Task: implications for the development of decision making and ventromedial prefrontal cortex. , 2004, Developmental psychology.

[25]  A. Damasio,et al.  Insensitivity to future consequences following damage to human prefrontal cortex , 1994, Cognition.

[26]  G. Schoenbaum,et al.  Reconciling the Roles of Orbitofrontal Cortex in Reversal Learning and the Encoding of Outcome Expectancies , 2007, Annals of the New York Academy of Sciences.

[27]  J. Wallis Orbitofrontal cortex and its contribution to decision-making. , 2007, Annual review of neuroscience.

[28]  W. Overman,et al.  Performance on the IOWA card task by adolescents and adults , 2004, Neuropsychologia.

[29]  Tom Ziemke,et al.  On the Role of Emotion in Embodied Cognitive Architectures: From Organisms to Robots , 2009, Cognitive Computation.

[30]  M. Farah,et al.  Different underlying impairments in decision-making following ventromedial and dorsolateral frontal lobe damage in humans. , 2004, Cerebral cortex.

[31]  Xiao-Jing Wang,et al.  The Frontal Lobes: A microcircuit model of prefrontal functions: ying and yang of reverberatory neurodynamics in cognition , 2006 .

[32]  Geoffrey Schoenbaum,et al.  From associations to expectancies: orbitofrontal cortex as gateway between the limbic system and representational memory , 2006 .

[33]  Tom Ziemke,et al.  The dual-route hypothesis: evaluating a neurocomputational model of fear conditioning in rats , 2009, Connect. Sci..

[34]  G. Colombetti Complexity as a new framework for emotion theories , 2003 .

[35]  Tom Ziemke,et al.  Towards a cognitive robotics methodology for reward-based decision-making: dynamical systems modelling of the Iowa Gambling Task , 2010, Connect. Sci..

[36]  G. Fricchione Descartes’ Error: Emotion, Reason and the Human Brain , 1995 .

[37]  Xiao-Jing Wang,et al.  A Model of Visuospatial Working Memory in Prefrontal Cortex: Recurrent Network and Cellular Bistability , 1998, Journal of Computational Neuroscience.

[38]  A. Damasio,et al.  Decision making and the somatic marker hypothesis , 2000 .

[39]  A. Diamond,et al.  Prefrontal cortex cognitive deficits in children treated early and continuously for PKU. , 1991, Monographs of the Society for Research in Child Development.