Published online in Wiley InterScience (www.interscience.wiley.com) DOI: 10.1002/bdm.481 Decision-making Competence: External Validation through an Individual-differences Approach

This study asks to what extent (a) individuals show consistent performance differences across typical behavioral decision-making tasks, and (b) how those differences correlate with plausible real-world correlates of good decision making. Seven tasks, chosen to span the domain of decision-making skills, were administered to participants in an ongoing longitudinal study providing extensive social, psychological, and behavioral measures. Performance scores on individual tasks generally showed small, positive inter-task correlations. An aggregate measure of decision-making competence (DMC) was appropriately correlated with plausible sources, concomitants, and outcomes of good decision making, suggesting the underlying construct’s external validity. Higher DMC scores were associated with more intact social environments, more constructive cognitive styles, and fewer ‘maladaptive’ risk behaviors. In each case, DMC adds to the predictive validity of general measures of cognitive ability. These results suggest that poor decision making on common laboratory tasks is related to real-world antecedents and consequences of poor decision making. Copyright# 2005 John Wiley & Sons, Ltd.

[1]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[2]  Thomas Oberlechner.  Psychology of Judgment and Decision-Making , 2006 .

[3]  Eric Johnson,et al.  Society for Judgment and Decision Making , 2005 .

[4]  T. Grisso,et al.  Juveniles' Competence to Stand Trial: A Comparison of Adolescents' and Adults' Capacities as Trial Defendants , 2003, Law and human behavior.

[5]  E. Weber,et al.  A Domain-Specific Risk-Attitude Scale: Measuring Risk Perceptions and Risk Behaviors , 2002 .

[6]  Sabina Kleitman,et al.  The Role of Individual Differences in the Accuracy of Confidence Judgments , 2002, The Journal of general psychology.

[7]  C. K. Mertz,et al.  Aging and decision‐making competence: an analysis of comprehension and consistency skills in older versus younger adults considering health‐plan options , 2002 .

[8]  B. Schwartz,et al.  Maximizing Versus Satisficing : Happiness Is a Matter of Choice , 2002 .

[9]  K. Stanovich,et al.  Heuristics and Biases: Individual Differences in Reasoning: Implications for the Rationality Debate? , 2002 .

[10]  B. Fischhoff,et al.  Teen expectations for significant life events. , 2000, Public opinion quarterly.

[11]  Levin,et al.  Information Processing at Successive Stages of Decision Making: Need for Cognition and Inclusion-Exclusion Effects. , 2000, Organizational behavior and human decision processes.

[12]  Gary Klein,et al.  Sources of Power: How People Make Decisions , 2017 .

[13]  Families.,et al.  Adolescent Decision Making , 1999 .

[14]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[15]  R. Tarter,et al.  Executive cognitive functioning, temperament, and antisocial behavior in conduct-disordered adolescent females. , 1998, Journal of abnormal psychology.

[16]  Schneider,et al.  All Frames Are Not Created Equal: A Typology and Critical Analysis of Framing Effects. , 1998, Organizational behavior and human decision processes.

[17]  Keith E. Stanovich,et al.  Individual differences in rational thought. , 1998 .

[18]  Catherine C. Eckel,et al.  Are Women Less Selfish Than Men?: Evidence From Dictator Experiments , 1998 .

[19]  M. F. Luce,et al.  Choosing to Avoid: Coping with Negatively Emotion-Laden Consumer Decisions , 1998 .

[20]  B. Fischhoff,et al.  Adolescent vulnerability: A framework for behavioral interventions , 1998 .

[21]  Lazar Stankov,et al.  Calibration curves, scatterplots and the distinction between general knowledge and perceptual tasks , 1998 .

[22]  C. Gilligan.  In a Different Voice: Psychological Theory and Women’s Development , 2009 .

[23]  P. Bearman,et al.  Protecting adolescents from harm: Findings from the National Longitudinal Study on Adolescent Health. , 1997 .

[24]  K. Stanovich,et al.  The domain specificity and generality of overconfidence: Individual differences in performance estimation bias , 1997 .

[25]  Steven K. Jones,et al.  The Effect of Outcome Information on the Evaluation and Recall of Individuals' Own Decisions , 1997 .

[26]  Nancy S. Cole,et al.  The ETS Gender Study: How Females and Males Perform in Educational Settings. , 1997 .

[27]  Kevin S. McGrew,et al.  Analysis of the major intelligence batteries according to a proposed comprehensive Gf-Gc framework. , 1997 .

[28]  L. Stankov,et al.  Self-confidence and performance on tests of cognitive abilities , 1997 .

[29]  Trish,et al.  Protecting adolescents from harm. Findings from the National Longitudinal Study on Adolescent Health. , 1997, JAMA.

[30]  L. Stankov,et al.  Confidence judgments in studies of individual differences , 1996 .

[31]  Irwin P. Levin,et al.  Need for Cognition and Choice Framing Effects , 1996 .

[32]  Catherine C. Eckel,et al.  The Relative Price of Fairness: Gender Differences in a Punishment Game , 1996 .

[33]  Christopher S Martin,et al.  Executive cognitive functioning and aggressive behavior in preadolescent boys at high risk for substance abuse/dependence. , 1996, Journal of studies on alcohol.

[34]  A. Jensen,et al.  The g factor , 1996, Nature.

[35]  Fischhoff,et al.  Organizational Behavior and Human Decision Processes the Real World: What Good Is It? Come with the Standardization and Experimentation 232 That We Prefer. Some Are so Comfortable with Studying , 2022 .

[36]  Lazar Stankov,et al.  Age differences in the realism of confidence judgements: A calibration study using tests of fluid and crystallized intelligence , 1996 .

[37]  R. DiClemente,et al.  Adolescents at Risk , 1996 .

[38]  Stuart J. Russell.  Rationality and Intelligence , 1995, IJCAI.

[39]  L. Hedges,et al.  Sex differences in mental test scores, variability, and numbers of high-scoring individuals. , 1995, Science.

[40]  J. Jacobs,et al.  Developmental differences in baserate estimates of social behaviors and attitudes , 1995 .

[41]  J. Woolard,et al.  Evaluating adolescent decision making in legal contexts , 1995 .

[42]  Howard Kunreuther,et al.  Decision making under ignorance: Arguing with yourself , 1995 .

[43]  G. Keren,et al.  Framing and time-inconsistent preferences , 1995 .

[44]  Jean-Paul Caverni,et al.  Contributions to decision making , 1995 .

[45]  Deborah Monique,et al.  Authors' addresses , 2004 .

[46]  A. Kruglanski,et al.  Individual differences in need for cognitive closure. , 1994, Journal of personality and social psychology.

[47]  Richard P. Larrick,et al.  Who uses the cost-benefit rules of choice? implications for the normative status of microeconomic theory , 1993 .

[48]  D. Önkal,et al.  An evaluation of the reliability of probability judgments across response modes and over time , 1993 .

[49]  T. Tourlentes.  Risk-Taking Behavior , 1993 .

[50]  Baruch Fischhoff.  Transaction analysis: A framework and an application to insurance decisions , 1993 .

[51]  Eldar Shafir,et al.  Choosing versus rejecting: Why some options are both better and worse than others , 1993, Memory & cognition.

[52]  P. Cole,et al.  Cognitive Risk and Its Association With Risk for Disruptive Behavior Disorder in Preschoolers , 1993 .

[53]  Baruch Fischhoff,et al.  Perceived consequences of risky behaviors: Adults and adolescents. , 1993 .

[54]  D. Frisch.  Reasons for framing effects. , 1993 .

[55]  J. M. Cortina,et al.  What Is Coefficient Alpha? An Examination of Theory and Applications , 1993 .

[56]  Deborah A. Prentice,et al.  Pluralistic ignorance and alcohol use on campus: some consequences of misperceiving the social norm. , 1993, Journal of personality and social psychology.

[57]  Baruch Fischhoff,et al.  AIDS risk perceptions and decision biases. , 1993 .

[58]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[59]  John W. Payne,et al.  The adaptive decision maker: Name index , 1993 .

[60]  M. J. Quadrel,et al.  Risk perception and communication , 2008 .

[61]  Jonathan Baron,et al.  Decision-making biases in children and early adolescents: exploratory studies , 1993 .

[62]  S Epstein,et al.  Cognitive-experiential self-theory and subjective probability: further evidence for two conceptual systems. , 1992, Journal of personality and social psychology.

[63]  I. Silverman,et al.  A short-term longitudinal study of the early development of self-regulation , 1992, Journal of abnormal child psychology.

[64]  H. Mano.  Judgments under distress: Assessing the role of unpleasantness and arousal in judgment formation , 1992 .

[65]  B Fischhoff,et al.  Giving advice. Decision theory perspectives on sexual assault. , 1992, The American psychologist.

[66]  Shawn P. Curley,et al.  Individual differences in risk taking. , 1992 .

[67]  Colin Camerer.  Recent Tests of Generalizations of Expected Utility Theory , 1992 .

[68]  S. Epstein,et al.  Constructive thinking and coping with laboratory-induced stress. , 1991, Journal of personality and social psychology.

[69]  G. Keren.  Calibration and probability judgements: Conceptual and methodological issues , 1991 .

[70]  B. Fischhoff,et al.  Value elicitation: Is there anything in there? , 1991 .

[71]  R. Wolfe,et al.  Personality Correlates of Confidence in One's Decisions , 1990 .

[72]  M. A. Metzger,et al.  Matemal Regulation of Children's Problem-solving Behavior and Its Impact on Children's Performance , 2022 .

[73]  Robyn M. Dawes,et al.  The potential nonfalsity of the false consensus effect. , 1990 .

[74]  Willis F. Overton,et al.  Competence and procedures: Constraints on the development of logical reasoning. , 1990 .

[75]  Gordon Miller,et al.  Decision Making: Descriptive, Normative, and Prescriptive Interactions , 1990 .

[76]  S. Epstein,et al.  Constructive thinking: a broad coping variable with specific components. , 1989, Journal of personality and social psychology.

[77]  J. Baron,et al.  Outcome bias in decision evaluation. , 1988, Journal of personality and social psychology.

[78]  J. Baron.  Thinking and Deciding , 2023 .

[79]  H. Brachinger,et al.  Decision analysis , 1997 .

[80]  Charles E. Miller,et al.  Group decision making and normative versus informational influence: Effects of type of issue and assigned decision rule. , 1987 .

[81]  Dale T. Miller,et al.  Pluralistic ignorance: When similarity is interpreted as dissimilarity. , 1987 .

[82]  Stephen J. Hoch,et al.  Perceived consensus and predictive accuracy: The pros and cons of projection. , 1987 .

[83]  W. Graziano,et al.  Self-monitoring in children: A differential approach to social development. , 1987 .

[84]  P. Slovic.  Perception of risk. , 1987, Science.

[85]  W. Graziano,et al.  Impact of Grade Retention on the Social Development of Elementary School Children. , 1987 .

[86]  Lola L. Lopes,et al.  [Advances in Experimental Social Psychology] Advances in Experimental Social Psychology Volume 20 Volume 20 || Between Hope and Fear: The Psychology of Risk , 1987 .

[87]  A. Tversky,et al.  Rational choice and the framing of decisions , 1990 .

[88]  R Jessor,et al.  Structure of problem behavior in adolescence and young adulthood. , 1985, Journal of consulting and clinical psychology.

[89]  Michael H. Birnbaum,et al.  Relationships Among Models of Salary Bias , 1985 .

[90]  M. Strube.  Combining and comparing significance levels from nonindependent hypothesis tests. , 1985 .

[91]  H. Arkes,et al.  The Psychology of Sunk Cost , 1985 .

[92]  Baruch Fischhoff,et al.  Judged Lethality: How Much People Seem to Know Depends Upon How They Are Asked , 1983 .

[93]  B. Fischhoff,et al.  Hypothesis Evaluation from a Bayesian Perspective. , 1983 .

[94]  C. Edelbrock,et al.  Manual for the Child: Behavior Checklist and Revised Child Behavior Profile , 1983 .

[95]  Sheldon Cohen,et al.  Positive Events and Social Supports as Buffers of Life Change Stress , 1983 .

[96]  David V. Budescu,et al.  Encoding subjective probabilities: A psychological and psychometric review , 1983 .

[97]  Baruch Fischhoff,et al.  Predicting Frames , 1983 .

[98]  S. Mclaughlin.  "Is there sex bias in salaries of psychologists?": Reply. , 1982 .

[99]  P. Schoemaker.  The Expected Utility Model: Its Variants, Purposes, Evidence and Limitations , 1982 .

[100]  J. Cacioppo,et al.  The need for cognition. , 1982 .

[101]  Charles Vlek,et al.  Judging risks and benefits in the small and in the large , 1981 .

[102]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[103]  M. Birnbaum.  Reply to McLaughlin : Proper Path Models for Theoretical Partialing , 1981 .

[104]  M. Snyder,et al.  Thinking about ourselves and others: Self-monitoring and social knowledge , 1980 .

[105]  I. Ajzen,et al.  Understanding Attitudes and Predicting Social Behavior , 1980 .

[106]  B. Fischhoff,et al.  Judged frequency of lethal events , 1978 .

[107]  J. Endicott,et al.  A diagnostic interview: the schedule for affective disorders and schizophrenia. , 1978, Archives of general psychiatry.

[108]  Melinda Parrill-Brunstein.  Teaching Kindergarten Children to Solve Problems: An Information-Processing Approach. , 1978 .

[109]  S. Lichtenstein,et al.  Do those who know more also know more about how much they know?*1 , 1977 .

[110]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[111]  W. F. Vonderhaar.  A COMPARATIVE STUDY OF PERFORMANCE SCALE IQ'S AND SUBTEST SCORES OF DEAF CHILDREN ON THE WECHSLER INTELLIGENCE SCALE FOR CHILDREN AND THE WECHSLER INTELLIGENCE SCALE FOR CHILDREN-REVISED , 1977 .

[112]  M. Scheier,et al.  Public and private self-consciousness: Assessment and theory. , 1975 .

[113]  A. B. Hollingshead,et al.  Four factor index of social status , 1975 .

[114]  M. Snyder.  Self-monitoring of expressive behavior. , 1974 .

[115]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[116]  H. Brinton.  Adolescents at risk. , 1973, Community health.

[117]  A. K. Basu.  A Theory of Decision-Making , 1973, The Journal of Sociology & Social Welfare.

[118]  R. Edelberg,et al.  Altered motor control in chronic alcoholics. , 1972, Journal of abnormal psychology.

[119]  J. A. Robinson.  Reply to Birnbaum , 1970 .

[120]  Margaret Martin,et al.  The Bureau of Labor Statistics. , 1970 .

[121]  Z. J. Ulehla,et al.  Internal consistency of subjective probabilities. , 1965, Journal of Experimental Psychology.

[122]  S. D. Porteus.  Porteus Maze Test: Fifty Years Application , 1965 .

[123]  P. Slovic.  Convergent validation of risk taking measures. , 1962, Journal of abnormal and social psychology.

[124]  J. Easterbrook.  The effect of emotion on cue utilization and the organization of behavior. , 1959, Psychological review.

[125]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[126]  N. L. Johnson,et al.  Multivariate Analysis , 1958, Nature.

[127]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[128]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .