Do the Big Five personality traits interact to predict life outcomes? Systematically testing the prevalence, nature, and effect size of trait-by-trait moderation

Personality researchers have posited multiple ways in which the relations between personality traits and life outcomes may be moderated by other traits, but there are well-known difficulties in reliable detection of such trait-by-trait interaction effects. Estimating the prevalence and magnitude base rates of trait-by-trait interactions would help to assess whether a given study is suited to detect interaction effects. We used the Life Outcomes of Personality Replication Project dataset to estimate the prevalence, nature, and magnitude of trait-by-trait interactions across 81 self-reported life outcomes ( n ≥ 1350 per outcome). Outcome samples were divided into two halves to examine the replicability of observed interaction effects using both traditional and machine learning indices. The study was adequately powered (1 − β ≥ .80) to detect the smallest interaction effects of interest (interactions accounting for a Δ R2 of approximately .01) for 78 of the 81 (96%) outcomes in each of the partitioned samples. Results showed that only 40 interactions (5.33% of the original 750 tests) showed evidence of strong replicability through robustness checks (i.e., demographic covariates, Tobit regression, and ordinal regression). Interactions were also uniformly small in magnitude. Future directions for research on trait-by-trait interactions are discussed.

[1]  Torrin M. Liddell,et al.  Analyzing Ordinal Data with Metric Models: What Could Possibly Go Wrong? , 2017, Journal of Experimental Social Psychology.

[2]  D. Jelliffe,et al.  Reference weights. Practical considerations. , 1984, The American journal of medicine.

[3]  B. O'Connor,et al.  Conditional Associations between Parental Behavior and Adolescent Problems: A Search for Personality– Environment Interactions , 2001 .

[4]  G. J. Lewis,et al.  Personality links to anger: Evidence for trait interaction and differentiation across expression style , 2015 .

[5]  Jo-Ann Tsang,et al.  The grateful disposition: a conceptual and empirical topography. , 2002, Journal of personality and social psychology.

[6]  Megan C Finsaas,et al.  Do simple slopes follow-up tests lead us astray? Advancements in the visualization and reporting of interactions. , 2020, Psychological methods.

[7]  H. Locke,et al.  SHORT MARITAL ADJUSTMENT AND PREDICTION TESTS: THEIR RELIABILITY AND VALIDITY , 1959 .

[8]  A. Greenwald Consequences of Prejudice Against the Null Hypothesis , 1975 .

[9]  K. E. Barron,et al.  Testing Moderator and Mediator Effects in Counseling Psychology Research. , 2004 .

[10]  W. Chaplin,et al.  The next generation of moderator research in personality psychology. , 1991, Journal of personality.

[11]  S. Hart,et al.  Examining the incremental and interactive effects of boldness with meanness and disinhibition within the triarchic model of psychopathy. , 2016, Personality disorders.

[12]  E. Wagenmakers,et al.  OR PART OF THE FOLLOWING SOURCE ) : Type article Title On the interpretation of removable interactions : a survey of the field 33 years after Loftus , 2012 .

[13]  M. Sellbom,et al.  Hypersexuality in college students: The role of psychopathy , 2012 .

[14]  Thomas W. Yee,et al.  Vector Generalized Linear and Additive Models , 2015 .

[15]  L. Simms,et al.  Three-way Interaction of Neuroticism, Extraversion, and Conscientiousness in the Internalizing Disorders: Evidence of Disorder Specificity in a Psychiatric Sample. , 2017, Journal of research in personality.

[16]  Herman Aguinis,et al.  Statistical Power with Moderated Multiple Regression in Management Research , 1995 .

[17]  Herman Aguinis,et al.  Best-practice recommendations for estimating interaction effects using moderated multiple regression , 2010 .

[18]  J. M. Digman Higher-order factors of the Big Five. , 1997, Journal of personality and social psychology.

[19]  M. Vasey,et al.  Reactive and self-regulatory dimensions of temperament: Interactive relations with symptoms of general distress and anhedonia. , 2011, Journal of research in personality.

[20]  David Watson,et al.  The Hierarchical Taxonomy of Psychopathology (HiTOP): A Dimensional Alternative to Traditional Nosologies , 2017, Journal of abnormal psychology.

[21]  D. Lynam,et al.  Identifying Essential Features of Juvenile Psychopathy in the Prediction of Later Antisocial Behavior , 2016, Clinical psychological science : a journal of the Association for Psychological Science.

[22]  A. Terracciano,et al.  The Five-Factor Model of Personality and Physical Inactivity: A Meta-Analysis of 16 Samples. , 2016, Journal of research in personality.

[23]  Einar B. Thorsteinsson,et al.  The Five-Factor Model of personality and relationship satisfaction of intimate partners: A meta-analysis , 2010 .

[24]  Reginald B. Adams,et al.  Many Labs 2: Investigating Variation in Replicability Across Sample and Setting , 2018 .

[25]  H. Cooper,et al.  The happy personality: a meta-analysis of 137 personality traits and subjective well-being. , 1998, Psychological bulletin.

[26]  C. Soto Do Links Between Personality and Life Outcomes Generalize? Testing the Robustness of Trait–Outcome Associations Across Gender, Age, Ethnicity, and Analytic Approaches , 2021 .

[27]  A. Hayes,et al.  Temperament synergies in risk for and protection against depressive symptoms: A prospective replication of a three-way interaction , 2014 .

[28]  Leif D. Nelson,et al.  False-Positive Psychology , 2011, Psychological science.

[29]  J. E. Kurtz,et al.  Internal Consistency, Retest Reliability, and Their Implications for Personality Scale Validity , 2011, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[30]  Marco Perugini,et al.  Only three factors of personality description are fully replicable across languages: a comparison of 14 trait taxonomies. , 2010, Journal of personality and social psychology.

[31]  Jason E. Neufeld,et al.  Dispositional forgiveness of self, others, and situations. , 2005, Journal of personality.

[32]  D. A. MacDonald Spirituality: description, measurement, and relation to the five factor model of personality. , 2000, Journal of personality.

[33]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[34]  S. Folkman,et al.  [An analysis of coping in a middle-aged community sample]. , 1980, Kango kenkyu. The Japanese journal of nursing research.

[35]  Andrew C. Leon,et al.  Computational Statistics and Data Analysis Sample Sizes Required to Detect Interactions between Two Binary Fixed-effects in a Mixed-effects Linear Regression Model , 2022 .

[36]  J. Edens,et al.  Fearless Dominance and Self-Centered Impulsivity Interact to Predict Predatory Aggression among Forensic Psychiatric Inpatients , 2013 .

[37]  Michael D. Robinson,et al.  Can One's Temper be Cooled?: A Role for Agreeableness in Moderating Neuroticism's Influence on Anger and Aggression. , 2008, Journal of research in personality.

[38]  Simine Vazire,et al.  The N-Pact Factor: Evaluating the Quality of Empirical Journals with Respect to Sample Size and Statistical Power , 2014, PloS one.

[39]  Anne M. Scheel,et al.  Equivalence Testing for Psychological Research: A Tutorial , 2018, Advances in Methods and Practices in Psychological Science.

[40]  C. Judd,et al.  Avoid Cohen’s ‘Small’, ‘Medium’, and ‘Large’ for Power Analysis , 2020, Trends in Cognitive Sciences.

[41]  Khandis R. Blake,et al.  On Attenuated Interactions, Measurement Error, and Statistical Power: Guidelines for Social and Personality Psychologists , 2020, Personality & social psychology bulletin.

[42]  A. Terracciano,et al.  Five-factor model personality traits and inflammatory markers: New data and a meta-analysis , 2014, Psychoneuroendocrinology.

[43]  Kohske Takahashi,et al.  Welcome to the Tidyverse , 2019, J. Open Source Softw..

[44]  D. K. Marcus,et al.  A new measure of attitudes toward sexually predatory tactics and its relation to the triarchic model of psychopathy. , 2014, Journal of personality disorders.

[45]  C. Judd,et al.  Statistical difficulties of detecting interactions and moderator effects. , 1993, Psychological bulletin.

[46]  G. Wilson,et al.  A new measure of conservatism. , 1968, The British journal of social and clinical psychology.

[47]  Gerald R. Adams,et al.  A Revision of the Extended Version of the Objective Measure of Ego Identity Status: An Identity Instrument for Use with Late Adolescents , 1986 .

[48]  S. Gosling,et al.  Small Effects: The Indispensable Foundation for a Cumulative Psychological Science , 2021, Perspectives on psychological science : a journal of the Association for Psychological Science.

[49]  Dirk Eddelbuettel,et al.  Rcpp: Seamless R and C++ Integration , 2011 .

[50]  John P. Meyer,et al.  Commitment to organizations and occupations: Extension and test of a three-component conceptualization. , 1993 .

[51]  Nathan T. Carter,et al.  Fearless Dominance/Boldness Is Not Strongly Related to Externalizing Behaviors: An Item Response-Based Analysis , 2020, Assessment.

[52]  Denis Bratko,et al.  Heritability of personality: A meta-analysis of behavior genetic studies. , 2015, Psychological bulletin.

[53]  James C. Beaty,et al.  Effect size and power in assessing moderating effects of categorical variables using multiple regression: a 30-year review. , 2005, The Journal of applied psychology.

[54]  P. Costa,et al.  Normal Personality Assessment in Clinical Practice: The NEO Personality Inventory. , 1992 .

[55]  S. Paunonen,et al.  Big Five factors of personality and replicated predictions of behavior. , 2003, Journal of personality and social psychology.

[56]  D. Lynam,et al.  The "core" of the dark triad: A test of competing hypotheses. , 2019, Personality disorders.

[57]  Jessica L Maples,et al.  A Comparison of Agreeableness Scores From the Big Five Inventory and the NEO PI-R: Consequences for the Study of Narcissism and Psychopathy , 2011, Assessment.

[58]  L. Jensen‐Campbell,et al.  Do Big Five personality traits associated with self-control influence the regulation of anger and aggression?☆ , 2007 .

[59]  Herman Aguinis,et al.  Methodological Artifacts in Moderated Multiple Regression and Their Effects on Statistical Power , 1997 .

[60]  Gillian Khoo,et al.  The Suinn-Lew Asian Self-Identity Acculturation Scale: Concurrent and Factorial Validation , 1992 .

[61]  Connor McCabe,et al.  Improving Present Practices in the Visual Display of Interactions , 2018, Advances in methods and practices in psychological science.

[62]  V. Benet‐Martínez,et al.  Personality and the prediction of consequential outcomes. , 2006, Annual review of psychology.

[63]  Edward A. Smith,et al.  Forms, Importance, and Ineffability of Factor Interactions to Define Personality Disorders. , 2019, Journal of personality disorders.

[64]  C. Ferguson,et al.  Publication bias in psychological science: prevalence, methods for identifying and controlling, and implications for the use of meta-analyses. , 2012, Psychological methods.

[65]  A. Tellegen,et al.  An alternative "description of personality": the big-five factor structure. , 1990, Journal of personality and social psychology.

[66]  Timothy M. Errington,et al.  Initial evidence of research quality of registered reports compared with the standard publishing model , 2021, Nature Human Behaviour.

[67]  B. Neugarten,et al.  The measurement of life satisfaction. , 1961, Journal of gerontology.

[68]  Marco Perugini,et al.  A six-factor structure of personality-descriptive adjectives: solutions from psycholexical studies in seven languages. , 2004, Journal of personality and social psychology.

[69]  O. John,et al.  The Next Big Five Inventory (BFI-2): Developing and Assessing a Hierarchical Model With 15 Facets to Enhance Bandwidth, Fidelity, and Predictive Power , 2017, Journal of personality and social psychology.

[70]  Ruben C. Arslan,et al.  Precise Answers to Vague Questions: Issues With Interactions , 2020, Advances in Methods and Practices in Psychological Science.

[71]  Robert W. Norton,et al.  Measuring marital quality, A critical look at the dependent variable , 1983 .

[72]  D. Lynam,et al.  A Comparison of the Validity of Very Brief Measures of the Big Five/Five-Factor Model of Personality , 2020, Assessment.

[73]  Terry E. Duncan,et al.  Approaches to Testing Interaction Effects Using Structural Equation Modeling Methodology. , 1998, Multivariate behavioral research.

[74]  C. Judd,et al.  Adjusting researchers' approach to adjustment: On the use of covariates when testing interactions , 2004 .

[75]  David C. Funder,et al.  Evaluating Effect Size in Psychological Research: Sense and Nonsense , 2019, Advances in Methods and Practices in Psychological Science.

[76]  D. Lynam,et al.  Using Bayesian methods to update and expand the meta-analytic evidence of the five-factor model's relation to antisocial behavior. , 2019, Clinical psychology review.

[77]  Brian A. Nosek,et al.  Many Labs 3: Evaluating participant pool quality across the academic semester via replication , 2016 .

[78]  K. Murphy,et al.  Mend It or End It , 2017 .

[79]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[80]  Aaron R. Caldwell,et al.  Simulation-Based Power Analysis for Factorial Analysis of Variance Designs , 2021, Advances in Methods and Practices in Psychological Science.

[81]  Matthew T. McBee Modeling Outcomes With Floor or Ceiling Effects: An Introduction to the Tobit Model , 2010 .

[82]  M. Ashton,et al.  The HEXACO personality factors in the indigenous personality lexicons of English and 11 other languages. , 2008, Journal of personality.

[83]  Michael C. Frank,et al.  Estimating the reproducibility of psychological science , 2015, Science.

[84]  Ashley L. Watts,et al.  Personality Disorders as Emergent Interpersonal Syndromes: Psychopathic Personality as a Case Example. , 2019, Journal of personality disorders.

[85]  C. Soto,et al.  How Replicable Are Links Between Personality Traits and Consequential Life Outcomes? The Life Outcomes of Personality Replication Project , 2019, Psychological science.

[86]  Jennifer L. Skeem,et al.  Examining hypothesized interactive and curvilinear relations between psychopathic traits and externalizing problems in an offender sample using item response-based analysis. , 2019, Journal of abnormal psychology.

[87]  A. Terracciano,et al.  Personality characteristics below facets: A replication and meta-analysis of cross-rater agreement, rank-order stability, heritability, and utility of personality nuances. , 2019, Journal of personality and social psychology.

[88]  P. Vernon,et al.  Heritability of the big five personality dimensions and their facets: a twin study. , 1996, Journal of personality.