A Connectionist Formulation of Learning in Dynamic Decision-Making Tasks

A formulation of learning in dynamic decision-making tasks is developed, building on the application of control theory to the study of human performance in dynamic decision making and a connectionist approach to motor control. The formulation is implemented as a connectionist model and compared with human subjects in learning a simulated dynamic decision-making task. When the model is pretrained with the prior knowledge that subjects are hypothesized to bring to the task, the model’s performance is broadly similar to that of subjects. Furthermore, individual runs of the model show variability in learning much like individual subjects. Finally, the effects of various manipulations of the task representation on model performance are used to generate predictions for future empirical work. In this way, the model provides a platform for developing hypotheses on how to facilitate learning in dynamic decision-making tasks.

[1]  R. Hogarth,et al.  Learning from feedback: exactingness and incentives. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[2]  Robin M. Hogarth,et al.  Generalization in Decision Research: The Role of Formal Models , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  D. Broadbent,et al.  Interactive tasks and the implicit‐explicit distinction , 1988 .

[4]  B. Brehmer Dynamic decision making: human control of complex systems. , 1992, Acta psychologica.

[5]  D. Broadbent,et al.  On the Relationship between Task Performance and Associated Verbalizable Knowledge , 1984 .

[6]  B Brehmer,et al.  Variable errors set a limit to adaptation. , 1990, Ergonomics.

[7]  James L. McClelland,et al.  Nature, nurture, and connections: Implications of connectionist models for cognitive development. , 1991 .

[8]  Ward Edwards,et al.  Dynamic Decision Theory and Probabilistic Information Processings1 , 1962 .

[9]  R. Hogarth Beyond discrete biases: Functional and dysfunctional aspects of judgmental heuristics. , 1981 .

[10]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[11]  J. Haldane The interaction of nature and nurture. , 1946, Annals of eugenics.

[12]  R. Mathews,et al.  Insight without Awareness: On the Interaction of Verbalization, Instruction and Practice in a Simulated Process Control Task , 1989 .

[13]  P. Frensch,et al.  Complex problem solving : the European perspective , 1995 .

[14]  Sebastian Thrun,et al.  Explanation-Based Neural Network Learning for Robot Control , 1992, NIPS.

[15]  Michael I. Jordan Constrained supervised learning , 1992 .

[16]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.