Why we still use our heads instead of formulas: toward an integrative approach.

This review begins with a discussion of Meehl's (1957) query regarding when to use one's head (i.e., intuition) instead of the formula (i.e., statistical or mechanical procedure) for clinical prediction. It then describes the controversy that ensued and analyzes the complexity and contemporary relevance of the question itself. Going beyond clinical inference, it identifies select cognitive biases and constraints that cause decision errors, and proposes remedial correctives. Given that the evidence shows cognition to be flawed, the article discusses the linear regression, Bayesian, signal detection, and computer approaches as possible decision aids. Their cost-benefit trade-offs, when used either alone or as complements to one another, are examined and evaluated. The critique concludes with a note of cautious optimism regarding the formula's future role as a decision aid and offers several interim solutions.

[1]  R. Fildes Database models and managerial intuition: 50% model +50% manager : Robert C. Blattberg and Stephen J. Hoch, Management Science 36 (1990) 887-899 , 1991 .

[2]  D. Perkins,et al.  Informal reasoning and education , 1991 .

[3]  Robin M. Hogarth,et al.  Insights in decision making : a tribute to Hillel J. Einhorn , 1990 .

[4]  M. Doherty,et al.  Effects of cognitive feedback on performance. , 1989 .

[5]  H. Garb,et al.  Clinical judgment, clinical training, and professional experience. , 1989, Psychological bulletin.

[6]  Eric J. Johnson,et al.  The Adaptive Decision-Maker : Effort and Accuracy in Choice , 2022 .

[7]  A. D. Pearman,et al.  Judgment and Decision Making: An Interdisciplinary Reader , 1999 .

[8]  B. Fischhoff,et al.  KNOWING WHAT YOU WANT: MEASURING LABILE VALUES , 1988 .

[9]  J. Shanteau Psychological characteristics and strategies of expert decision makers , 1988 .

[10]  Eric J. Johnson,et al.  Adaptive Strategy Selection in Decision Making. , 1988 .

[11]  A. Tversky,et al.  Contingent weighting in judgment and choice , 1988 .

[12]  J A Swets,et al.  Measuring the accuracy of diagnostic systems. , 1988, Science.

[13]  E F Cook,et al.  A computer protocol to predict myocardial infarction in emergency department patients with chest pain. , 1988, The New England journal of medicine.

[14]  James O. Berger,et al.  Statistical Analysis and the Illusion of Objectivity , 1988 .

[15]  Robert S. Billings,et al.  The effects of response mode and importance on decision-making strategies: Judgment versus choice , 1988 .

[16]  Pawel Lewicki,et al.  Acquisition of procedural knowledge about a pattern of stimuli that cannot be articulated , 1988, Cognitive Psychology.

[17]  S. French Professional Judgment: A Reader in Clinical Decision Making , 1988 .

[18]  I. Solomon,et al.  Research opportunities in auditing : the second decade , 1988 .

[19]  R. Dawes You can't systematize human judgment: Dyslexia. , 1988 .

[20]  J. Klayman Cue discovery in probabilistic environments: Uncertainty and experimentation. , 1988 .

[21]  Peter Salovey,et al.  Reasoning, Inference, and Judgement in Clinical Psychology , 1988 .

[22]  Robert J. Sternberg,et al.  The Psychology of human thought , 1988 .

[23]  E. Shortliffe Computer programs to support clinical decision making. , 1990, JAMA.

[24]  J C Hershey,et al.  Clinical Reasoning and Cognitive Processes , 1987, Medical decision making : an international journal of the Society for Medical Decision Making.

[25]  David L. Ronis,et al.  Components of probability judgment accuracy: Individual consistency and effects of subject matter and assessment method. , 1987 .

[26]  T. Pearson,et al.  Direct comparison of the efficacy of intuitive and analytical cognition in expert judgment , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[27]  G. Barnett,et al.  DXplain. An evolving diagnostic decision-support system. , 1987, JAMA.

[28]  John R. Anderson,et al.  Effects of number of facts studied on recognition versus sensibility judgments. , 1987 .

[29]  P. Politser Medical education for a changing future: new concepts for revising texts , 1987, Medical education.

[30]  James B. Thomas,et al.  The value of action and inference in dynamic decision making , 1987 .

[31]  J. Klayman,et al.  Confirmation, Disconfirmation, and Informa-tion in Hypothesis Testing , 1987 .

[32]  L. Reder Strategy selection in question answering , 1987, Cognitive Psychology.

[33]  L. R. Huesmann,et al.  A process model of posthypnotic amnesia , 1987, Cognitive Psychology.

[34]  Robin M. Hogarth,et al.  Judgement and choice: The psychology of decision, 2nd ed. , 1987 .

[35]  L. Wrightsman Psychology and the legal system , 1987 .

[36]  Reinhard Viertl,et al.  Probability and Bayesian Statistics , 1987 .

[37]  Robert L. Winkler,et al.  Calibrating and Combining Precipitation Probability Forecasts , 1987 .

[38]  David Leinweber,et al.  Expert systems in space , 1987 .

[39]  D. N. Kleinmuntz Human decision processes: Heuristics and task structure , 1987 .

[40]  A S Elstein,et al.  Computer modeling of clinical judgment. , 1987, Critical reviews in medical informatics.

[41]  P. Hancock Human Factors Psychology , 1987 .

[42]  D. Funder,et al.  Errors and mistakes: evaluating the accuracy of social judgment. , 1987, Psychological bulletin.

[43]  Robert H. Ashton,et al.  Combining the judgments of experts: How many and which ones? , 1986 .

[44]  D. G. Swain Computer aided diagnosis of acute abdominal pain , 1986 .

[45]  I. Adams,et al.  Computer aided diagnosis of acute abdominal pain: a multicentre study. , 1986, British medical journal.

[46]  James H. Reynolds Computing in Psychology: An Introduction to Programming Methods and Concepts , 1986 .

[47]  J R Beck,et al.  Laboratory decision science applied to chemometrics: strategic testing of thyroid function. , 1986, Clinical chemistry.

[48]  W. Edwards,et al.  Decision Analysis and Behavioral Research , 1986 .

[49]  P Slovic,et al.  Perceived acceptability of risk analysis as a decision-making approach. , 1986, Risk analysis : an official publication of the Society for Risk Analysis.

[50]  Lance Eliot,et al.  Analogical Problem-Solving and Expert Systems , 1986, IEEE Expert.

[51]  Kenneth R. Hammond Generalization in Operational Contexts: What Does It Mean? Can It be Done? , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[52]  Peter Ayton,et al.  Subjective confidence in forecasts: A response to fischhoff and MacGregor , 1986 .

[53]  Peter A. Morris,et al.  Observations on expert aggregation , 1986 .

[54]  Robert L. Winkler,et al.  Expert resolution , 1986 .

[55]  Robert T. Clemen,et al.  Calibration and the aggregation of probabilities , 1986 .

[56]  J A Swets,et al.  Form of empirical ROCs in discrimination and diagnostic tasks: implications for theory and measurement of performance. , 1986, Psychological bulletin.

[57]  H. Arkes,et al.  Factors influencing the use of a decision rule in a probabilistic task , 1986 .

[58]  E H Shortliffe,et al.  Update on ONCOCIN: a chemotherapy advisor for clinical oncology. , 1984, Medical informatics = Medecine et informatique.

[59]  R. Hogarth,et al.  Judging probable cause. , 1986 .

[60]  H. J. Einhorn,et al.  Accepting error to make less error. , 1986, Journal of personality assessment.

[61]  T. Sarbin Prediction and clinical inference: forty years later. , 1986, Journal of personality assessment.

[62]  P. Meehl Causes and effects of my disturbing little book. , 1986, Journal of personality assessment.

[63]  R. Holt,et al.  Clinical and statistical prediction: a retrospective and would-be integrative perspective. , 1986, Journal of personality assessment.

[64]  Laurence R. Paquette,et al.  The effect of decision strategy and task complexity on decision performance in an accounting context , 1988 .

[65]  Robert H. Ashton,et al.  Aggregating Subjective Forecasts: Some Empirical Results , 1985 .

[66]  Ola Svenson,et al.  Cognitive strategies in a complex judgment task: Analyses of concurrent verbal reports and judgments of cumulated risk over different exposure times , 1985 .

[67]  Don N. Kleinmuntz,et al.  Cognitive Heuristics and Feedback in a Dynamic Decision Environment , 1985 .

[68]  W. Grove Bootstrapping diagnoses using Bayes's theorem: it's not worth the trouble. , 1985, Journal of consulting and clinical psychology.

[69]  Robert L. Winkler,et al.  Limits for the Precision and Value of Information from Dependent Sources , 1985, Oper. Res..

[70]  H. Simon,et al.  Why are some problems hard? Evidence from Tower of Hanoi , 1985, Cognitive Psychology.

[71]  Shawn P. Curley,et al.  Conditional distribution analyses of probabilistic forecasts , 1985 .

[72]  C. P. Ewing Psychology, Psychiatry and the Law: A Clinical and Forensic Handbook , 1985 .

[73]  Robert P. Abelson,et al.  A Variance Explanation Paradox: When a Little is a Lot , 1985 .

[74]  M. Wertheimer A Gestalt perspective on computer simulations of cognitive processes , 1985 .

[75]  Alex Goodall,et al.  The guide to expert systems , 1985 .

[76]  P. Farquhar State of the Art—Utility Assessment Methods , 1984 .

[77]  Roger C. Schank The Cognitive Computer: On Language, Learning, and Artificial Intelligence , 1984 .

[78]  A. H. Murphy,et al.  Probability Forecasting in Meteorology , 1984 .

[79]  Joshua Klayman,et al.  Learning from feedback in probabilistic environments , 1984 .

[80]  P. Politser Explanations of Statistical Concepts: Can they Penetrate the Haze of Bayes? , 1984, Methods of Information in Medicine.

[81]  Benjamin Kleinmuntz,et al.  A field study of the fallibility of polygraphic lie detection , 1984, Nature.

[82]  G. Pitz,et al.  Judgment and decision: theory and application. , 1984, Annual review of psychology.

[83]  L. Beach,et al.  The citation bias: Fad and fashion in the judgment and decision literature. , 1984 .

[84]  N. Pennington,et al.  Inside the Jury. , 1985 .

[85]  S. Pauker,et al.  The Markov Process in Medical Prognosis , 1983, Medical decision making : an international journal of the Society for Medical Decision Making.

[86]  M. Bazerman Negotiator Judgment , 1983 .

[87]  D. Krantz,et al.  The use of statistical heuristics in everyday inductive reasoning , 1983 .

[88]  R. L. Winkler,et al.  Averages of Forecasts: Some Empirical Results , 1983 .

[89]  B. Fischhoff,et al.  Hypothesis Evaluation from a Bayesian Perspective. , 1983 .

[90]  Peter A. Morris,et al.  An Axiomatic Approach to Expert Resolution , 1983 .

[91]  James A. Wise,et al.  Human decision making , 1983 .

[92]  Lola L. Lopes Doing the impossible: A note on induction and the experience of randomness. , 1982 .

[93]  Ralph L. Keeney,et al.  Feature Article - Decision Analysis: An Overview , 1982, Oper. Res..

[94]  John W. Payne,et al.  Contingent decision behavior. , 1982 .

[95]  H. Kunreuther,et al.  Decision Making: SOURCES OF BIAS IN ASSESSMENT PROCEDURES FOR UTILITY FUNCTIONS , 1982 .

[96]  L. G. Rorer,et al.  A base-rate bootstrap. , 1982 .

[97]  G. W. Hill Group versus individual performance: are n + 1 heads better than one?" psychological bulletin , 1982 .

[98]  B. Fischhoff,et al.  Subjective Confidence in Forecasts. , 1982 .

[99]  B. Fischhoff,et al.  Calibration of probabilities: the state of the art to 1980 , 1982 .

[100]  Baruch Fischhoff,et al.  Judgment under uncertainty: For those condemned to study the past: Heuristics and biases in hindsight , 1982 .

[101]  B. Kleinmuntz,et al.  On the fallibility of lie detection. , 1982 .

[102]  Lloyd G. Humphreys,et al.  Multivariate Applications in the Social Sciences , 1982 .

[103]  Hillel J. Einhorn,et al.  Judgment under uncertainty: Learning from experience and suboptimal rules in decision making , 1982 .

[104]  Paul Slovic,et al.  Toward understanding and improving decisions , 1982 .

[105]  R. Hogarth,et al.  Prediction, Diagnosis, and Causal Thinking in Forecasting , 1982 .

[106]  J. Showers,et al.  Reducing Uncollectible Revenue from Residential Telephone Customers , 1981 .

[107]  R. Hogarth Beyond discrete biases: Functional and dysfunctional aspects of judgmental heuristics. , 1981 .

[108]  Jay J.J. Christensen-Szalanski,et al.  Physicians' use of probabilistic information in a real clinical setting. , 1981 .

[109]  Colin F. Camerer,et al.  General conditions for the success of bootstrapping models , 1981 .

[110]  H. Arkes,et al.  Impediments to accurate clinical judgment and possible ways to minimize their impact. , 1981, Journal of consulting and clinical psychology.

[111]  A. Tversky,et al.  Evidential impact of base rates , 1981 .

[112]  Benjamin Kleinmuntz,et al.  Statistical versus clinical lie detection. , 1981 .

[113]  N. Charness Search in chess: Age and skill differences. , 1981 .

[114]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[115]  R. Hogarth,et al.  BEHAVIORAL DECISION THEORY: PROCESSES OF JUDGMENT AND CHOICE , 1981 .

[116]  Spyros Makridakis,et al.  The Value of Decision Making in a Complex Environment: An Experimental Approach , 1981 .

[117]  Barr and Feigenbaum Edward A. Avron,et al.  The Handbook of Artificial Intelligence , 1981 .

[118]  R. Hogarth Judgement and choice: The psychology of decision , 1982 .

[119]  David T. Lykken,et al.  A Tremor in the Blood: Uses and Abuses of the Lie Detector , 1980 .

[120]  B. Brehmer In one word: Not from experience. , 1980 .

[121]  M. S. Blois Clinical judgment and computers. , 1980, The New England journal of medicine.

[122]  Dorothea P. Simon,et al.  Expert and Novice Performance in Solving Physics Problems , 1980, Science.

[123]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[124]  Baruch Fischhoff,et al.  Clinical Decision Analysis , 1980, Oper. Res..

[125]  Michael J. Saks,et al.  Human Information Processing and Adjudication: Trial by Heuristics , 1980 .

[126]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[127]  H. J. Einhorn,et al.  Cognitive processes in choice and decision behavior , 1979 .

[128]  H. J. Einhorn,et al.  Linear regression and process-tracing models of judgment. , 1979 .

[129]  Scott H. Decker,et al.  Law and Society Review , 1979 .

[130]  R. Dawes Judgment under uncertainty: The robust beauty of improper linear models in decision making , 1979 .

[131]  L. Abt,et al.  Social Psychology and Discretionary Law , 1979 .

[132]  J. Kidd Decision Making and Change in Human Affairs , 1979 .

[133]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[134]  H. Simon,et al.  Information Processing Models of Cognition , 1979 .

[135]  Pamela McCorduck,et al.  Machines Who Think: A Personal Inquiry into the History and Prospects of Artificial Intelligence , 1979 .

[136]  R. Hogarth,et al.  Confidence in judgment: Persistence of the illusion of validity. , 1978 .

[137]  D. E. Bell,et al.  Conflicting Objectives in Decisions , 1978 .

[138]  Douglas N. Jackson,et al.  Problems in Human Assessment , 1978 .

[139]  Gordon Wood,et al.  The knew-it-all-along effect. , 1978 .

[140]  Roger K. Blashfield,et al.  Performance of a composite as a function of the number of judges , 1978 .

[141]  Robin M. Hogarth,et al.  A note on aggregating opinions , 1978 .

[142]  S. Lichtenstein,et al.  Do those who know more also know more about how much they know?*1 , 1977 .

[143]  B. Fischhoff,et al.  Knowing with Certainty: The Appropriateness of Extreme Confidence. , 1977 .

[144]  P. G. Moore,et al.  Modern decision analysis : selected readings , 1977 .

[145]  B. Fischhoff,et al.  Perceived Informativeness of Facts. , 1977 .

[146]  Ward Edwards,et al.  How to Use Multiattribute Utility Measurement for Social Decisionmaking , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[147]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[148]  B. Fischhoff,et al.  Behavioral Decision Theory , 1977 .

[149]  Baruch Fischhoff,et al.  Calibration of Probabilities: The State of the Art , 1977 .

[150]  S. Rosalki Frontiers of Gastrointestinal Research , 1976 .

[151]  J C Sisson,et al.  Clinical decision analysis. The hazard of using additional data. , 1976, JAMA.

[152]  U. Neisser Cognitive Psychology. (Book Reviews: Cognition and Reality. Principles and Implications of Cognitive Psychology) , 1976 .

[153]  Ebbe B. Ebbesen,et al.  Decision Making and Information Integration in the Courts: The Setting of Bail , 1975 .

[154]  Robin M. Hogarth,et al.  Cognitive Processes and the Assessment of Subjective Probability Distributions , 1975 .

[155]  Ward Edwards,et al.  1 – PUBLIC VALUES: MULTIATTRIBUTE-UTILITY MEASUREMENT FOR SOCIAL DECISION MAKING , 1975 .

[156]  T. R. Stewart,et al.  10 – SOCIAL JUDGMENT THEORY , 1975 .

[157]  M. Kaplan,et al.  Human judgment and decision processes , 1975 .

[158]  H. J. Einhorn Expert judgment: Some necessary conditions and an example. , 1974 .

[159]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[160]  R. Dawes,et al.  Linear models in decision making. , 1974 .

[161]  Lee W. Gregg,et al.  Knowledge and cognition , 1974 .

[162]  J. S. Wiggins,et al.  Personality and Prediction: Principles of Personality Assessment , 1973 .

[163]  L. Rappoport,et al.  Policy-capturing in the field: The nuclear safeguards problem☆ , 1973 .

[164]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[165]  Kenneth R. Hammond,et al.  Negative effects of outcome-feedback in multiple-cue probability learning. , 1973 .

[166]  P. Slovic Psychological Study of Human Judgment: Implications for Investment Decision-Making , 1972 .

[167]  B. Brehmer POLICY CONFLICT AS A FUNCTION OF POLICY SIMILARITY AND POLICY COMPLEXITY , 1972 .

[168]  J. Gani,et al.  Proceedings of the Fourth International Conference on Operational Research , 1972 .

[169]  Hillel J. Einhorn,et al.  Expert measurement and mechanical combination , 1972 .

[170]  I. Steiner Group process and productivity , 1972 .

[171]  Paul Slovic,et al.  Comparison of Bayesian and Regression Approaches to the Study of Information Processing in Judgment. , 1971 .

[172]  Ward Edwards,et al.  Bayesian and regression models of human information processing—A myopic perspective , 1971 .

[173]  Lewis R. Goldberg,et al.  Five models of clinical judgment: An empirical comparison between linear and nonlinear representations of the human inference process , 1971 .

[174]  R. Dawes A case study of graduate admissions: Application of three principles of human decision making. , 1971 .

[175]  Lewis R. Goldberg,et al.  Man versus model of man: A rationale, plus some evidence, for a method of improving on clinical inferences. , 1970 .

[176]  R. Holt Yet another look at clinical and statistical prediction: or, is clinical psychology worthwhile? , 1970, The American psychologist.

[177]  L. R. Goldberg THE SEARCH FOR CONFIGURAL RELATIONSHIPS IN PERSONALITY ASSESSMENT: THE DIAGNOSIS OF PSYCHOSIS vs. NEUROSIS FROM THE MMPI. , 1969, Multivariate behavioral research.

[178]  L. J. Chapman,et al.  Illusory correlation as an obstacle to the use of valid psychodiagnostic signs. , 1969, Journal of abnormal psychology.

[179]  L. R. Goldberg Simple models or simple processes? Some research on clinical judgments. , 1968, The American psychologist.

[180]  P. Hoffman,et al.  Three models of clinical judgment. , 1968, Journal of abnormal psychology.

[181]  R. Cattell,et al.  Formal representation of human judgment , 1968 .

[182]  C. G. Watson Relationship of distortion to DAP diagnostic accuracy among psychologists at three levels of sophistication. , 1967, Journal of Consulting Psychology.

[183]  J. C. Naylor,et al.  Characteristics of the human inference process in complex choice behavior situations , 1966 .

[184]  J. Sawyer,et al.  Measurement and prediction, clinical and statistical. , 1966, Psychological bulletin.

[185]  W. Edwards,et al.  Conservatism in a simple probability inference task. , 1966, Journal of experimental psychology.

[186]  D. Turner Predictive efficiency as a function of amount of information and level of professional experience. , 1966, Journal of projective techniques & personality assessment.

[187]  S. Oskamp OVERCONFIDENCE IN CASE-STUDY JUDGMENTS. , 1965, Journal of consulting psychology.

[188]  K. R. Hammond,et al.  COGNITIVE DEPENDENCE ON LINEAR AND NONLINEAR CUES. , 1965, Psychological review.

[189]  Paul E. Meehl,et al.  Seer over sign: The first good example. , 1965 .

[190]  G. Lindzey,et al.  Seer versus sign. , 1965 .

[191]  L. R. Goldberg,et al.  DIAGNOSTICIANS VS. DIAGNOSTIC SIGNS: THE DIAGNOSIS OF PSYCHOSIS VS. NEUROSIS FROM THE MMPI. , 1965, Psychological monographs.

[192]  L. Tucker A SUGGESTED ALTERNATIVE FORMULATION IN THE DEVELOPMENTS BY HURSCH, HAMMOND, AND HURSCH, AND BY HAMMOND, HURSCH, AND TODD. , 1964, Psychological review.

[193]  K. R. Hammond,et al.  ANALYZING THE COMPONENTS OF CLINICAL INFERENCE. , 1964, Psychological review.

[194]  J. Swets Signal detection and recognition by human observers : contemporary readings , 1964 .

[195]  Ward Edwards,et al.  Bayesian statistical inference for psychological research. , 1963 .

[196]  L. Grebstein Relative accuracy of actuarial prediction, experienced clinicians, and graduate students in a clinical judgment task. , 1963, Journal of consulting psychology.

[197]  B KLEINMUNTZ,et al.  Personality Test Interpretation by Digital Computer , 1963, Science.

[198]  E. H. Bowman Consistency and Optimality in Managerial Decision Making , 1963 .

[199]  Ward Edwards,et al.  Dynamic Decision Theory and Probabilistic Information Processings1 , 1962 .

[200]  B. Kleinmuntz,et al.  Computer Program for the Meehl-Dahlstrom MMPI Profile Rules , 1962 .

[201]  Stuart Oskamp,et al.  The relationship of clinical experience and training methods to several criteria of clinical prediction. , 1962 .

[202]  A NEWELL,et al.  Computer simulation of human thinking. , 1961, Science.

[203]  W. Edwards Behavioral decision theory. , 1961, Annual review of psychology.

[204]  P. Meehl,et al.  Objective configural rules for discriminating psychotic from neurotic MMPI profiles. , 1960, Journal of consulting psychology.

[205]  P. Hoffman The paramorphic representation of clinical judgment. , 1960, Psychological bulletin.

[206]  P. Meehl The cognitive activity of the clinician. , 1960 .

[207]  L. R. Goldberg,et al.  The effectiveness of clinicians' judgments; the diagnosis of organic brain damage from the Bender-Gestalt test. , 1959, Journal of consulting psychology.

[208]  Paul E. Meehl,et al.  A comparison of clinicians with five statistical methods of identifying psychotic MMPI profiles. , 1959 .

[209]  R. Holt Clinical and statistical prediction; a reformulation and some new data. , 1958, Journal of abnormal psychology.

[210]  E. Brunswik Perception and the Representative Design of Psychological Experiments , 1957 .

[211]  Paul E. Meehl,et al.  When shall we use our heads instead of the formula , 1957 .

[212]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[213]  Paul E. Meehl,et al.  Clinical Versus Statistical Prediction: A Theoretical Analysis and a Review of the Evidence , 1996 .

[214]  K. R. Hammond Probabilistic functioning and the clinical method. , 1955, Psychological review.

[215]  E. Brunswik Representative design and probabilistic theory in a functional psychology. , 1955, Psychological review.

[216]  P. Meehl,et al.  Antecedent probability and the efficiency of psychometric signs, patterns, or cutting scores. , 1955, Psychological bulletin.

[217]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[218]  L. J. Savage,et al.  The Foundations of Statistics , 1955 .

[219]  A. Rosen Detection of suicidal patients: an example of some limitations in the prediction of infrequent events. , 1954, Journal of consulting psychology.

[220]  J. Swets,et al.  A decision-making theory of visual detection. , 1954, Psychological review.

[221]  J. Phelan,et al.  The skills of clinicians in analysis of projective tests. , 1954, Journal of clinical psychology.

[222]  W. Edwards The theory of decision making. , 1954, Psychological bulletin.

[223]  E. Brunswik,et al.  The Conceptual Framework of Psychology , 1954 .