A computational knowledge-based model for emulating human performance in the Iowa Gambling Task

A new computational knowledge-based model for emulating human performance in decision making tasks is proposed. This model is mainly based on the knowledge acquired through past experience, the knowledge extracted from the environment and the relationships between the concepts that represent these two kinds of knowledge. The proposed model divides the decision making process into two phases. The first phase lies in the estimation of the decision outcomes using a net of concepts. In the second phase, the proposed model uses a value function to score each possible alternative. The design of the model focuses on some psychological and neurophysiological evidence from current research. In order to validate the model, it is compared with other widely used models that implement different theories of decision making under risk and uncertainty. The model comparison is centered on a well defined task, the Iowa Gambling Task, used in several psychological experiments. The comparison applies an evaluation method based on the optimization of each model in order to emulate human performance individually starting both the participant and the model from the same environmentally available information. The results show that the performance of the proposed model is quantitatively better than the other compared models. Besides, using relevant concepts extracted from interviews with the participants increases the performance of the proposed model.

[1]  P. Glimcher,et al.  The Neurobiology of Decision: Consensus and Controversy , 2009, Neuron.

[2]  Matthias Brand,et al.  Neuropsychological correlates of decision-making in ambiguous and risky situations , 2006, Neural Networks.

[3]  N. Pierce Origin of Species , 1914, Nature.

[4]  T. Robbins,et al.  Choosing between Small, Likely Rewards and Large, Unlikely Rewards Activates Inferior and Orbital Prefrontal Cortex , 1999, The Journal of Neuroscience.

[5]  Steven W Anderson,et al.  Decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers , 2001, Neuropsychologia.

[6]  A. Lawrence,et al.  The somatic marker hypothesis: A critical evaluation , 2006, Neuroscience & Biobehavioral Reviews.

[7]  Ulrich Hoffrage,et al.  How causal knowledge simplifies decision-making , 2006, Minds and Machines.

[8]  A. Damasio,et al.  Insensitivity to future consequences following damage to human prefrontal cortex , 1994, Cognition.

[9]  D. Bernoulli Exposition of a New Theory on the Measurement of Risk , 1954 .

[10]  Howard Bowman,et al.  Using epsilon-greedy reinforcement learning methods to further understand ventromedial prefrontal patients' deficits on the Iowa Gambling Task. , 2007, Neural networks : the official journal of the International Neural Network Society.

[11]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[12]  L. Rydén,et al.  Long-term effects of lifestyle behavior change in coronary artery disease: effects on recurrent coronary events after percutaneous coronary intervention. , 2005, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[13]  Victor J. Rayward-Smith,et al.  Statistics to measure correlation for data mining applications , 2007, Comput. Stat. Data Anal..

[14]  G. Chapman Short-term cost for long-term benefit: time preference and cancer control. , 2005, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[15]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[16]  M. Brand,et al.  Personality and decision-making in laboratory gambling tasks : Evidence for a relationship between deciding advantageously under risk conditions and perfectionism , 2008 .

[17]  Edward T. Cokely,et al.  Cognitive abilities and superior decision making under risk: A protocol analysis and process model evaluation , 2009, Judgment and Decision Making.

[18]  D.S. Levine,et al.  Modeling emotional influences on human decision making under risk , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[19]  G. Gigerenzer Rationality for Mortals: How People Cope with Uncertainty , 2008 .

[20]  Walter Warwick,et al.  A Comparative Approach to Understanding General Intelligence: Predicting Cognitive Performance in an Open-ended Dynamic Task , 2009 .

[21]  D. Ellsberg Decision, probability, and utility: Risk, ambiguity, and the Savage axioms , 1961 .

[22]  I. Erev,et al.  Small feedback‐based decisions and their limited correspondence to description‐based decisions , 2003 .

[23]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[24]  G. Loewenstein,et al.  Neural Predictors of Purchases , 2007, Neuron.

[25]  Konrad Paul Kording,et al.  Decision Theory: What "Should" the Nervous System Do? , 2007, Science.

[26]  M. Allais Le comportement de l'homme rationnel devant le risque : critique des postulats et axiomes de l'ecole americaine , 1953 .

[27]  Jerome R. Busemeyer,et al.  Comparison of Decision Learning Models Using the Generalization Criterion Method , 2008, Cogn. Sci..

[28]  James L. McClelland,et al.  A reexamination of the evidence for the somatic marker hypothesis: what participants really know in the Iowa gambling task. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Andrea Stocco,et al.  The cognitive modeling of human behavior: Why a model is (sometimes) better than 10,000 words , 2007, Cognitive Systems Research.

[30]  K. Doya Modulators of decision making , 2008, Nature Neuroscience.

[31]  P. Thagard,et al.  Spiking Phineas Gage: a neurocomputational theory of cognitive-affective integration in decision making. , 2004, Psychological review.

[32]  Howard Bowman,et al.  Using epsiloon-greedy reinforcement learning methods to further understand ventromedial prefrontal patients' deficits on the Iowa Gambling Task , 2007, Neural Networks.

[33]  C. Starmer Developments in Non-expected Utility Theory: The Hunt for a Descriptive Theory of Choice under Risk , 2000 .

[34]  M. Dolores del Castillo,et al.  Connectionist Models of Decision Making , 2010 .

[35]  Vicente M. Simón Pérez Emotional participation in decision- making , 1998 .

[36]  G. Fricchione Descartes’ Error: Emotion, Reason and the Human Brain , 1995 .

[37]  B. Sahakian,et al.  The innovative brain , 2008, Nature.

[38]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[39]  S. Quartz,et al.  Reason, emotion and decision-making: risk and reward computation with feeling , 2009, Trends in Cognitive Sciences.

[40]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[41]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[42]  A. Cowey,et al.  Post-decision wagering objectively measures awareness , 2007, Nature Neuroscience.

[43]  Jerome R. Busemeyer,et al.  Integrating Emotional Processes Into DecisionMaking Models , 2007, Integrated Models of Cognitive Systems.

[44]  Joseph E LeDoux,et al.  Equipotentiality of thalamo-amygdala and thalamo-cortico-amygdala circuits in auditory fear conditioning , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  P. Glimcher Choice: Towards a Standard Back-pocket Model , 2009 .

[46]  Jerome R. Busemeyer,et al.  Using Cognitive Models to Map Relations Between Neuropsychological Disorders and Human Decision-Making Deficits , 2005, Psychological science.

[47]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Comparing Review , 2006, Towards a New Evolutionary Computation.

[48]  H. Damasio,et al.  The Iowa Gambling Task and the somatic marker hypothesis: some questions and answers , 2005, Trends in Cognitive Sciences.

[49]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[50]  S. Mobini,et al.  Theory and method in the quantitative analysis of ”impulsive choice” behaviour: implications for psychopharmacology , 1999, Psychopharmacology.

[51]  A. Tversky,et al.  Rational choice and the framing of decisions , 1990 .

[52]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[53]  M. Dolores del Castillo,et al.  A Comparison of Hybrid Decision Making Methods for Emergency Support , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[54]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .