Information systems design: an empirical study of feedback effects

Abstract Feedback is an important component of any dynamic system, and should receive attention as a design issue in information systems. The study presents a model which shows the function of feedback in management information systems. The potential effect of task-specific feedback on the judgement of the decision-maker is tested empirically. Both the model and empirical results provide guidance about the role of feedback in information systems design. Empirical results demonstrate that there remains a strong bias towards overconfidence even with feedback. However, the presence of immediate feedback does lower confidence and raise decision quality.

[1]  Jerald Greenberg,et al.  The College Sophomore as Guinea Pig: Setting the Record Straight , 1987 .

[2]  D. Krantz,et al.  The use of statistical heuristics in everyday inductive reasoning , 1983 .

[3]  Gideon Keren,et al.  Facing uncertainty in the game of bridge: A calibration study , 1987 .

[4]  Charles A.J. Vlek,et al.  Learning probabilities of events: An analysis of the problem and its relevance for the study of decision making , 1970 .

[5]  William R. King,et al.  Manager-analyst teamwork in MISCooperation vital in systems design , 1971 .

[6]  Robert T. Keim,et al.  An Experimental Study in Overcoming Hypothesis-confirming Search Strategies in Computerized Information Retrieval Systems , 1988, ICIS.

[7]  H. Arkes,et al.  Two methods of reducing overconfidence , 1987 .

[8]  R. L. Dipboye,et al.  Research settings in industrial and organizational psychology: Are findings in the field more generalizable than in the laboratory? , 1979 .

[9]  Dov Te'eni.  Determinants and Consequences of Perceived Complexity in Human-Computer Interaction* , 1989 .

[10]  Baruch Fischhoff,et al.  Focusing Techniques: A Shortcut to Improving Probability Judgments? , 1984 .

[11]  R. Hogarth,et al.  Confidence in judgment: Persistence of the illusion of validity. , 1978 .

[12]  Terry Connolly,et al.  Some Effects of Feedback Error BV Diagnostic Decision Tasks , 1978 .

[13]  A. H. Murphy,et al.  Scoring rules in probability assessment and evaluation , 1970 .

[14]  D. Krantz,et al.  The effects of statistical training on thinking about everyday problems , 1986, Cognitive Psychology.

[15]  Sara J. Czaja,et al.  Age related differences in learning to use a text-editing system , 1989 .

[16]  M. Gordon,et al.  The “Science of the Sophomore” Revisited: from Conjecture to Empiricism , 1986 .

[17]  Marya L. Leatherwood,et al.  Using Multiple Attributes to Assess Sources of Performance Feedback , 1987 .

[18]  William K. Estes,et al.  Research and Theory on the Learning of Probabilities , 1972 .

[19]  B. Fischhoff,et al.  Behavioral Decision Theory , 1977 .

[20]  F. J. McGuigan,et al.  Experimental psychology: A methodological approach , 1962 .

[21]  B. Fischhoff,et al.  Training for calibration. , 1980 .

[22]  D. M. Herold,et al.  Feedback the Definition of a Construct , 1977 .

[23]  G. W. Fischer,et al.  Scoring-rule feedback and the overconfidence syndrome in subjective probability forecasting , 1982 .

[24]  Joshua Klayman,et al.  Learning from feedback in probabilistic environments , 1984 .

[25]  B. Fischhoff,et al.  Reasons for confidence. , 1980 .

[26]  D. Campbell,et al.  EXPERIMENTAL AND QUASI-EXPERIMENT Al DESIGNS FOR RESEARCH , 2012 .

[27]  William G. Cochran,et al.  Experimental Designs, 2nd Edition , 1950 .

[28]  T S Wallsten,et al.  Stability and coherence of health experts' upper and lower subjective probabilities about dose-response functions. , 1983, Organizational behavior and human performance.

[29]  Neal Schmitt,et al.  Student Guinea Pigs: Porcine Predictors and Particularistic Phenomena , 1987 .

[30]  Thomas H. Wonnacott,et al.  Confidence intervals or hypothesis tests , 1987 .