The bootstrapped model--Lessons for the acceptance of intellectual technology.

This paper is intended as a non-technical introduction to a growing aspect of what has been termed 'intellectual technology'. The particular area chosen is the use of simple linear additive models for judgement and decision making purposes. Such models are said to either outperform, or perform at least as well as, the human judges on which they are based, hence they are said to 'bootstrap' such human inputs. Although the paper will provide a fairly comprehensive list of recent applications of such models, from postgraduate selection to judgements of marital happiness, the work will concentrate on the topic of Credit Scoring as an exemplar - that is, the assignment of credit by means of a simple additive rule. The paper will also present a simple system, due to Dawes, of classifying such models according to the form and source of their weights. The paper further discusses the reasons for bootstrapping and that other major phenomenon of such models - that is, the one can rarely distinguish between the prescriptions of such models, however the weights have been arrived at. It is argued that this 'principle of the flat maximum' allows us to develop a technology of judgement. The paper continues with a brief historical survey of the reactions of human experts to such models and their superiority, and suggestions for a better mix of expert and model on human engineering lines. Finally, after a brief comparison between expert systems and linear additive models, the paper concludes with a brief survey of possible future developments. A short Appendix describes two applications of such models.

[1]  Robert M. Pruzek,et al.  Weighting predictors in linear models: Alternatives to least squares and limitations of equal weights. , 1978 .

[2]  I. Chein.  The logic of prediction: some observations on Dr. Sarbin's exposition. , 1945 .

[3]  R. Dawes,et al.  Linear models in decision making. , 1974 .

[4]  Howard Wainer,et al.  Estimating Coefficients in Linear Models: It Don't Make No Nevermind , 1976 .

[5]  William F. Wright.  Properties of judgment models in a financial setting , 1979 .

[6]  Morris S. Viteles.  The clinical viewpoint in vocational selection. , 1925 .

[7]  H. J. Einhorn.  The use of nonlinear, noncompensatory models in decision making. , 1970, Psychological bulletin.

[8]  Ronald J. Ebert,et al.  Bootstrapping the security analyst. , 1978 .

[9]  David A. Pritchard,et al.  Apologia for clinical/configural decision making. , 1980 .

[10]  L. R. Goldberg.  Simple models or simple processes? Some research on clinical judgments. , 1968, The American psychologist.

[11]  R. Duda,et al.  Expert Systems Research. , 1983, Science.

[12]  T. Sarbin.  Clinical psychology—Art or science , 1941 .

[13]  Colin F. Camerer,et al.  General conditions for the success of bootstrapping models , 1981 .

[14]  R. Dawes.  A case study of graduate admissions: Application of three principles of human decision making. , 1971 .

[15]  N. Wiggins,et al.  Man versus model of man revisited: The forecasting of graduate school success. , 1971 .

[16]  R. Dawes.  Judgment under uncertainty: The robust beauty of improper linear models in decision making , 1979 .

[17]  Lewis R. Goldberg,et al.  Man versus model of man: A rationale, plus some evidence, for a method of improving on clinical inferences. , 1970 .

[18]  James E. Laughlin,et al.  Comment on "Estimating coefficients in linear models: It don't make no nevermind." , 1978 .

[19]  James L. Alty,et al.  Expert Systems: Concepts and Examples , 1984 .

[20]  Edward L. Thorndike,et al.  Fundamental theorems in judging men. , 1918 .

[21]  Paul Slovic,et al.  Comparison of Bayesian and Regression Approaches to the Study of Information Processing in Judgment. , 1971 .

[22]  Robert Libby,et al.  Man versus model of man: some conflicting evidence , 1976 .

[23]  H. Wainer.  Predicting the outcome of the senate trial of Richard M. Nixon , 1974 .

[24]  R. Holt.  Clinical and statistical prediction; a reformulation and some new data. , 1958, Journal of abnormal psychology.

[25]  L. R. Goldberg,et al.  DIAGNOSTICIANS VS. DIAGNOSTIC SIGNS: THE DIAGNOSIS OF PSYCHOSIS VS. NEUROSIS FROM THE MMPI. , 1965, Psychological monographs.

[26]  M. Freyd,et al.  The statistical viewpoint in vocational selection. , 1925 .

[27]  R. Flesch.  The Art of Readable Writing , 1974 .

[28]  Ward Edwards,et al.  Evaluating credit applications: A validation of multiattribute utility weight elicitation techniques , 1983 .

[29]  T. Sarbin,et al.  Clinical Inference And Cognitive Theory , 1960 .

[30]  W. T. Singleton,et al.  Man-machine systems , 1974 .

[31]  P. Meehl,et al.  Clinical versus Statistical Prediction. , 1955 .

[32]  P. Hoffman.  The paramorphic representation of clinical judgment. , 1960, Psychological bulletin.

[33]  Robert Libby,et al.  Man versus model of man: the need for a nonlinear model , 1976 .

[34]  T. Sarbin.  A Contribution to the Study of Actuarial and Individual Methods of Prediction , 1943, American Journal of Sociology.

[35]  L. R. Goldberg.  Man versus model of man: just how conflicting is that evidence? , 1976 .

[36]  Bruce G. Buchanan,et al.  The MYCIN Experiments of the Stanford Heuristic Programming Project , 1985 .

[37]  T. Sarbin.  The logic of prediction in psychology. , 1944 .

[38]  W. Edwards,et al.  Costs and payoffs in perceptual research. , 1982 .