Learning in dynamic simulation games; using performance as a measure

In a dynamic simulation game portraying a multiplier-accelerator investment problem, there are major differences between high and low performers; high performers voice specific concerns for future states of the system, while low performers are less likely to think about the future. Planning, especially incorporating the deceptive nature of feedback, is necessary in systems that exhibit diverging long and short term behaviors. A comparison of game results with written reports shows that there is a positive relationship between performance and understanding of the game. These results are contrary to previous research where performance and understanding have been unrelated (Broadbent et al. 1978, 1986), but can be explained by the added complexity of non-linear feedback tasks with shifts in loop dominance. Such tasks are, in contrast to simple regression model tasks, non-routine and therefore verbal and behavior aspects of decision makers’ mental models correspond.

[1]  Berndt Brehmer Systems Design and the Psychology of Complex Systems , 1987 .

[2]  Kenneth R. Hammond,et al.  Negative effects of outcome-feedback in multiple-cue probability learning. , 1973 .

[3]  J. Sterman Misperceptions of feedback in dynamic decision making , 1989 .

[4]  Berndt Brehmer,et al.  Single-cue probability learning as a function of the sign and magnitude of the correlation between cue and criterion , 1973 .

[5]  J. Klayman,et al.  Confirmation, Disconfirmation, and Informa-tion in Hypothesis Testing , 1987 .

[6]  Jens Rasmussen,et al.  Outlines of a Hybrid Model of the Process Plant Operator , 1976 .

[7]  Donald E. Broadbent,et al.  Human Control of a Simulated Economic System , 1978 .

[8]  D. Broadbent,et al.  Implicit and explicit knowledge in the control of complex systems , 1986 .

[9]  R. Hogarth Beyond discrete biases: Functional and dysfunctional aspects of judgmental heuristics. , 1981 .

[10]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[11]  John D. Sterman,et al.  Testing Behavioral Simulation Models by Direct Experiment , 1987 .

[12]  R. Hogarth,et al.  Confidence in judgment: Persistence of the illusion of validity. , 1978 .

[13]  Dietrich Doerner,et al.  On the Difficulties People Have in Dealing With Complexity , 1980 .

[14]  Thomas B. Sheridan,et al.  Monitoring Behavior and Supervisory Control , 1976 .

[15]  James B. Thomas,et al.  The value of action and inference in dynamic decision making , 1987 .

[16]  B. Fischhoff,et al.  Behavioral Decision Theory , 1977 .

[17]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[18]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[19]  D. Sterman,et al.  Misperceptions of Feedback in a Dynamic Decision Making Experiment , 1989 .

[20]  David Mazursky,et al.  When Feedback is Ignored: Disutility of Outcome Feedback , 1984 .