Decision field theory extensions for behavior modeling in dynamic environment using Bayesian belief network

Decision field theory (DFT), widely known in the field of mathematical psychology, provides a mathematical model for the evolution of the preferences among options of a human decision-maker. The evolution is based on the subjective evaluation for the options and his/her attention on an attribute (interest). In this paper, we extend DFT to cope with the dynamically changing environment. The proposed extended DFT (EDFT) updates the subjective evaluation for the options and the attention on the attribute, where Bayesian belief network (BBN) is employed to infer these updates under the dynamic environment. Four important theorems are derived regarding the extension, which enhance the usability of EDFT by providing the minimum time steps required to obtain the stabilized results before running the simulation (under certain assumptions). A human-in-the-loop experiment is conducted for the virtual stock market to illustrate and validate the proposed EDFT. The preliminary result is quite promising.

[1]  D. Plaut,et al.  Learning in Dynamic Decision Tasks: Computational Model and Empirical Evidence , 1997 .

[2]  James T. Townsend,et al.  Dynamic representation of decision-making , 1996 .

[3]  W. Edwards Subjective probabilities inferred from decisions. , 1962, Psychological review.

[4]  Xiaobing Zhao,et al.  Extended BDI Framework for Modelling Human Decision-Making in Complex Automated Manufacturing Systems , 2008 .

[5]  B. C. Brookes,et al.  Information Sciences , 2020, Cognitive Skills You Need for the 21st Century.

[6]  Gia Sirbiladze,et al.  Restored fuzzy measures in expert decision-making , 2005, Inf. Sci..

[7]  Cleotilde Gonzalez,et al.  Learning in Dynamic Decision Making: The Recognition Process , 2003, Comput. Math. Organ. Theory.

[8]  Diederich,et al.  Dynamic Stochastic Models for Decision Making under Time Constraints , 1997, Journal of mathematical psychology.

[9]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[10]  R. Ratcliff,et al.  Multialternative decision field theory: a dynamic connectionist model of decision making. , 2001, Psychological review.

[11]  O. Svenson Differentiation and consolidation theory of human decision making: A frame of reference for the study of pre- and post-decision processes , 1992 .

[12]  E. Rowland Theory of Games and Economic Behavior , 1946, Nature.

[13]  Young-Jun Son,et al.  BDI-based Human Decision-Making Model in Automated Manufacturing Systems , 2005 .

[14]  Jing Yin,et al.  Integrating Compensatory and Noncompensatory Decision-Making Strategies in Dynamic Task Environments , 2008 .

[15]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[16]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[17]  Amit Konar,et al.  Reasoning and unsupervised learning in a fuzzy cognitive map , 2005, Inf. Sci..

[18]  Cleotilde Gonzalez,et al.  Instance-based learning in dynamic decision making , 2003, Cogn. Sci..

[19]  Frederick Mosteller,et al.  An Experimental Measurement of Utility , 1951, Journal of Political Economy.

[20]  H. J. Einhorn The use of nonlinear, noncompensatory models in decision making. , 1970, Psychological bulletin.

[21]  Adele Diederich,et al.  Survey of decision field theory , 2002, Math. Soc. Sci..

[22]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[23]  Anand S. Rao,et al.  Decision Procedures for BDI Logics , 1998, J. Log. Comput..

[24]  I. Janis,et al.  Decision Making: A Psychological Analysis of Conflict, Choice, and Commitment , 1977 .

[25]  John W. Payne,et al.  Contingent decision behavior. , 1982 .

[26]  Ramon J. Aldag,et al.  Decision Making: A Psychological Analysis of Conflict , 1980 .

[27]  Robert F. Port,et al.  MIND IN MOTION: , 2019, Dune.