Boom, bust, and failures to learn in experimental markets

Boom and bust is a pervasive dynamic for new products. Word of mouth, marketing, and learning curve effects can fuel rapid growth, often leading to overcapacity, price war, and bankruptcy. Previous experiments suggest such dysfunctional behavior can be caused by systematic "misperceptions of feedback," where decision makers do not adequately account for critical feedbacks, time delays, and nonlinearities which condition system dynamics. However, prior studies often failed to vary the strength of these feedbacks as treatments, omitted market processes, and failed to allow for learning. A decision making task portraying new product dynamics is used to test the theory by varying the strength of key feedback processes in a simulated market. Subjects performed the task repeatedly, encouraging learning. Nevertheless, performance relative to potential is poor and is severely degraded when the feedback complexity of the environment is high, supporting the misperception of feedback hypothesis. The negative effects of feedback complexity on performance were not moderated by experience, even though average performance improved. Models of the subjects' decision making heuristics are estimated; changes over trials in estimated cue weights explain why subjects improve on average but fail to gain insight into the dynamics of the system. Though conditions for learning are excellent, experience does not appear to mitigate the misperceptions of feedback or systematic dysfunction they cause in dynamic decision making tasks. We discuss implications for educational use of simulations and games.

[1]  Vijay Mahajan,et al.  Innovation Diffusion Models of New Product Acceptance: A Reexamination , 1985 .

[2]  W. A. Wagenaar,et al.  Misperception of exponential growth , 1975 .

[3]  Mark Paich.  Boom and bust : decision making in a dynamic market environment , 1994 .

[4]  Donald A. Schön.  The Theory of Inquiry: Dewey's Legacy to Education , 1992 .

[5]  Colin Camerer.  Do Biases in Probability Judgment Matter in Markets? Experimental Evidence , 1987 .

[6]  A. Tversky,et al.  Rational choice and the framing of decisions , 1990 .

[7]  Peter M. Senge,et al.  A system dynamics approach to investment-function formulation and testing , 1980 .

[8]  B. Brehmer.  In one word: Not from experience. , 1980 .

[9]  Paul B. Andreassen.  Judgmental extrapolation and market overreaction: On the use and disuse of news , 1990 .

[10]  Don N. Kleinmuntz,et al.  Information processing and misperceptions of the implications of feedback in dynamic decision making , 1993 .

[11]  D. Sterman,et al.  Misperceptions of Feedback in a Dynamic Decision Making Experiment , 1989 .

[12]  Jack Homer,et al.  A diffusion model with application to evolving medical technologies , 1987 .

[13]  John D. Sterman,et al.  Expectation formation in behavioral simulation models , 1986 .

[14]  R. Hogarth,et al.  Learning from feedback: exactingness and incentives. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[15]  S. Oster,et al.  Modern Competitive Analysis , 1989 .

[16]  Hilde Haider,et al.  Modelling the process of complex system control , 1989 .

[17]  Michael E. Porter,et al.  Cases In Competitive Strategy , 1983 .

[18]  Jay W. Forrester,et al.  Policies, decisions and information sources for modeling☆ , 1992 .

[19]  J. Sterman,et al.  Systems thinking and organizational learning: Acting locally and thinking globally in the organization of the future , 1992 .

[20]  M. Doherty,et al.  Effects of cognitive feedback on performance. , 1989 .

[21]  V. Smith,et al.  Bubbles, Crashes, and Endogenous Expectations in Experimental Spot Asset Markets , 1988 .

[22]  Joachim Funke,et al.  Solving complex problems: Exploration and control of complex systems , 1991 .

[23]  James B. Thomas,et al.  The value of action and inference in dynamic decision making , 1987 .

[24]  Vijay Mahajan,et al.  New Product Diffusion Models in Marketing: A Review and Directions for Research: , 1990 .

[25]  B. Brehmer.  Dynamic decision making: human control of complex systems. , 1992, Acta psychologica.

[26]  G. Loewenstein,et al.  Decision making over time and under uncertainty: a common approach , 1991 .

[27]  Bent Erik Bakken.  Learning and transfer of understanding in dynamic decision environments , 1993 .

[28]  V. Zarnowitz.  Recent Work on Business Cycles in Historical Perspective: Review of Theories and Evidence , 1984 .

[29]  Spyros Makridakis,et al.  The Value of Decision Making in a Complex Environment: An Experimental Approach , 1981 .

[30]  John D. Sterman,et al.  Testing Behavioral Simulation Models by Direct Experiment , 1987 .

[31]  E. Diehl.  Effects of feedback structure on dynamic decision making , 1992 .

[32]  Han Timmers,et al.  The pond-and-duckweed problem; Three experiments on the misperception of exponential growth , 1979 .

[33]  J. Sterman.  Misperceptions of feedback in dynamic decision making , 1989 .

[34]  S. Klepper,et al.  Time Paths in the Diffusion of Product Innovations , 1982 .

[35]  Homer Hoyt,et al.  One hundred years of land values in Chicago , 1970 .

[36]  John D. W. Morecroft,et al.  Rationality in the Analysis of Behavioral Simulation Models , 1985 .

[37]  Shlomo Zilberstein,et al.  Models of Bounded Rationality , 1995 .

[38]  P. Senge.  The fifth discipline : the art and practice of the learning organization/ Peter M. Senge , 1991 .

[39]  R. Hogarth.  Beyond discrete biases: Functional and dysfunctional aspects of judgmental heuristics. , 1981 .

[40]  Steven Klepper,et al.  The Evolution of New Industries and the Determinants of Market Structure , 1990 .

[41]  H. J. Einhorn,et al.  Linear regression and process-tracing models of judgment. , 1979 .

[42]  Arnoldo C. Hax,et al.  Strategic Management: An Integrative Perspective , 1984 .

[43]  V. Mahajan,et al.  Innovation Diffusion Models of New Product Acceptance. , 1987 .

[44]  Donald E. Broadbent,et al.  Human Control of a Simulated Economic System , 1978 .

[45]  Albert Josiah Harris,et al.  Worlds of wonder , 1970 .

[46]  Erik Reimer Larsen,et al.  Nonlinear mode-interaction in the macroeconomy , 1992, Ann. Oper. Res..

[47]  Vernon L. Smith,et al.  Rational Choice: The Contrast between Economics and Psychology , 1991, Journal of Political Economy.

[48]  R. Thaler,et al.  Laboratory experimentation in economics: The psychology of choice and the assumptions of economics , 1987 .

[49]  Gary L. Lilien,et al.  A market entry timing model for new techniques , 1986 .

[50]  K. Sengupta,et al.  Alternative conceptions of feedback in dynamic decision environments: an experimental investigation , 1993 .

[51]  Paul B. Andreassen,et al.  Judgmental extrapolation and the salience of change , 1990 .