Construct validity: advances in theory and methodology.

Measures of psychological constructs are validated by testing whether they relate to measures of other constructs as specified by theory. Each test of relations between measures reflects on the validity of both the measures and the theory driving the test. Construct validation concerns the simultaneous process of measure and theory validation. In this article, we review the recent history of validation efforts in clinical psychological science that has led to this perspective, and we review the following recent advances in validation theory and methodology of importance for clinical researchers. These are: the emergence of nonjustificationist philosophy of science; an increasing appreciation for theory and the need for informative tests of construct validity; valid construct representation in experimental psychopathology; the need to avoid representing multidimensional constructs with a single score; and the emergence of effective new statistical tools for the evaluation of convergent and discriminant validity.

[1]  D. Laird.  A mental hygiene and vocational test. , 2022 .

[2]  A Study of the Discriminative Value of the Woodworth Personal Data Sheet , 1928 .

[3]  E. Fleming,et al.  The validity of the Matthews' revision of the Woodworth personal data questionnaire. , 1929 .

[4]  K. Maccorquodale,et al.  On a distinction between hypothetical constructs and intervening variables. , 1948, Psychological review.

[5]  Anne Anastasi,et al.  The Concept of Validity in the Interpretation of Test Scores , 1950 .

[6]  E. Brunswik,et al.  The Conceptual Framework of Psychology , 1954 .

[7]  J. Loevinger,et al.  The attenuation paradox in test theory. , 1954, Psychological bulletin.

[8]  J. Becker,et al.  The Aim and Structure of Physical Theory , 1955 .

[9]  D. Wechsler.  Manual for the Wechsler Adult Intelligence Scale. , 1955 .

[10]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[11]  W. R. Garner,et al.  Operationism and the concept of perception. , 1956, Psychological review.

[12]  J. Loevinger.  Objective Tests as Instruments of Psychological Theory , 1957 .

[13]  E. Brunswik.  Perception and the Representative Design of Psychological Experiments , 1957 .

[14]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[15]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[16]  D T Campbell,et al.  Methods Factors In Multitrait-Multimethod Matrices : Multiplicative Rather Than Additive? , 1967, Multivariate behavioral research.

[17]  I. Lakatos.  II-CRITICISM AND THE METHODOLOGY OF SCIENTIFIC RESEARCH PROGRAMMES , 1969 .

[18]  R. Manderscheid,et al.  The California Psychological Inventory: Reappraisal of Reliability , 1975 .

[19]  M. Posner.  Chronometric explorations of mind , 1978 .

[20]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[21]  Walter B. Weimer.  Notes on the methodology of scientific research , 1979 .

[22]  W. W. Bartley,et al.  Philosophy of biology versus philosophy of physics. , 1982, Fundamenta scientiae.

[23]  S. Embretson.  CONSTRUCT VALIDITY: CONSTRUCT REPRESENTATION VERSUS NOMOTHETIC SPAN , 1983 .

[24]  W. W. Bartley.  The Retreat to Commitment , 1984 .

[25]  M. Browne,et al.  The decomposition of multitrait-multimethod matrices. , 1984, The British journal of mathematical and statistical psychology.

[26]  K. Widaman.  Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data , 1985 .

[27]  K. R. Hammond,et al.  Generalizing over conditions by combining the multitrait-multimethod matrix and the representative design of experiments. , 1986, Psychological bulletin.

[28]  Frank J. Landy,et al.  Stamp collecting versus science: Validation as hypothesis testing. , 1986 .

[29]  W. W. Bartley,et al.  Evolutionary Epistemology, Rationality, and the Sociology of Knowledge , 1987 .

[30]  R. Cudeck.  Msultiplicative Models and MTMM Matrices , 1988 .

[31]  D. Watson,et al.  Positive and negative affectivity and their relation to anxiety and depressive disorders. , 1988, Journal of abnormal psychology.

[32]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[33]  D. Ozer.  Construct Validity in Personality Assessment , 1989 .

[34]  P. Meehl.  Appraising and Amending Theories: The Strategy of Lakatosian Defense and Two Principles that Warrant It , 1990 .

[35]  M A Just,et al.  From the SelectedWorks of Marcel Adam Just 1990 What one intelligence test measures : A theoretical account of the processing in the Raven Progressive Matrices Test , 2016 .

[36]  D. Campbell.  The Meehilan Corroboration-Verisimilitude Theory of Science , 1990 .

[37]  K. Nuechterlein.  Vigilance of schizophrenia and related disorders , 1991 .

[38]  J. Richters.  Depressed mothers as informants about their children: a critical review of the evidence for distortion. , 1992, Psychological bulletin.

[39]  P. Meehl.  Factors and Taxa, Traits and Types, Differences of Degree and Differences in Kind , 1992 .

[40]  D. A. Kenny,et al.  Analysis of the multitrait^multimethod matrix by confirmatory factor analysis , 1992 .

[41]  M. Linehan,et al.  Naturalistic follow-up of a behavioral treatment for chronically parasuicidal borderline patients. , 1993, Archives of general psychiatry.

[42]  Keith F. Widaman,et al.  Studying Lives Through Time: Personality and Development , 1993 .

[43]  Lewis R. Goldberg,et al.  The structure of personality traits: Vertical and horizontal aspects. , 1993 .

[44]  A. Caspi.  Why maladaptive behaviors persist: Sources of continuity and change across the life course. , 1993 .

[45]  B. Cornblatt,et al.  Impaired attention, genetics, and the pathophysiology of schizophrenia. , 1994, Schizophrenia bulletin.

[46]  M. Strauss,et al.  Response to Serper and Harvey , 1994 .

[47]  S. Messick.  Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[48]  D. Watson,et al.  Constructing validity: Basic issues in objective scale development , 1995 .

[49]  J. Butcher.  Clinical personality assessment : practical approaches , 1995 .

[50]  Use of the MMPI-2 in correctional settings. , 1995 .

[51]  Gregory T. Smith,et al.  Methodological considerations in the refinement of clinical assessment instruments. , 1995 .

[52]  Theodore Millon,et al.  Disorder of personality: DSM-IV and beyond , 1995 .

[53]  Lee J. Cronbach,et al.  Giving method variance its due. , 1995 .

[54]  Herbert W. Marsh,et al.  Latent variable models of multitrait-multimethod data. , 1995 .

[55]  P. Costa,et al.  Domains and facets: hierarchical personality assessment using the revised NEO personality inventory. , 1995, Journal of personality assessment.

[56]  C. S. Reichardt,et al.  The Criteria for Convergent and Discriminant Validity in a Multitrait-Multimethod Matrix. , 1995, Multivariate behavioral research.

[57]  Werner Wothke,et al.  Covariance components analysis of the multitrait-multimethod matrix. , 1995 .

[58]  M. D. Dunnette,et al.  Broadsided by broad traits: How to sink science in five dimensions or less , 1996 .

[59]  P. Costa,et al.  Evaluating replicability of factors in the Revised NEO Personality Inventory: Confirmatory factor analysis versus Procrustes rotation. , 1996 .

[60]  R. Hoyle.  Structural equation modeling: concepts, issues, and applications , 1997 .

[61]  J. Conway.  Understanding Method Variance in Multitrait-Multirater Performance Appraisal Matrices: Examples Using General Impressions and Interpersonal Affect as Measured Method Factors , 1998 .

[62]  Lynda A. King,et al.  Confirmatory Factor Analysis of the Clinician-Administered PTSD Scale: Evidence for the Dimensionality of Posttraumatic Stress Disorder. , 1998 .

[63]  S. Embretson.  A cognitive design system approach to generating valid tests : Application to abstract reasoning , 1998 .

[64]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[65]  I. Hacking.  The Social Construction of What , 1999 .

[66]  Michael Eid,et al.  Latent state–trait theory and research in personality and individual differences , 1999 .

[67]  J. Cohen,et al.  Context-processing deficits in schizophrenia: converging evidence from three theoretically motivated cognitive tasks. , 1999, Journal of abnormal psychology.

[68]  Randall W Engle,et al.  Working memory, short-term memory, and general fluid intelligence: a latent-variable approach. , 1999, Journal of experimental psychology. General.

[69]  R. Depue,et al.  Neurobiology of the structure of personality: Dopamine, facilitation of incentive motivation, and extraversion , 1999, Behavioral and Brain Sciences.

[70]  W. Grove,et al.  Clinical versus mechanical prediction: a meta-analysis. , 2000, Psychological assessment.

[71]  William M. Grove,et al.  Clinical versus mechanical prediction , 2000 .

[72]  Fred B. Bryant,et al.  Assessing the validity of measurement. , 2000 .

[73]  Joel Michell,et al.  Normal Science, Pathological Science and Psychometrics , 2000 .

[74]  J A Swets,et al.  Psychological Science Can Improve Diagnostic Decisions , 2000, Psychological science in the public interest : a journal of the American Psychological Society.

[75]  B. Roberts,et al.  The rank-order consistency of personality traits from childhood to old age: a quantitative review of longitudinal studies. , 2000, Psychological bulletin.

[76]  M. Ashton,et al.  Big five factors and facets and the prediction of behavior. , 2001, Journal of personality and social psychology.

[77]  S. Whiteside,et al.  The Five Factor Model and impulsivity: using a structural model of personality to understand impulsivity , 2001 .

[78]  M. Kane.  Current Concerns in Validity Theory , 2001 .

[79]  A. Caspi,et al.  Personality Development Across the Life Course:The Argument for Change and Continuity , 2001 .

[80]  Demonstrating specific cognitive deficits: a psychometric perspective. , 2001 .

[81]  J. Michell.  Teaching and misteaching measurement in psychology , 2001 .

[82]  S M Silverstein,et al.  A process-oriented approach for averting confounds resulting from general performance deficiencies in schizophrenia. , 2001, Journal of abnormal psychology.

[83]  J. Edwards.  Multidimensional Constructs in Organizational Behavior Research: An Integrative Analytical Framework , 2001 .

[84]  Sampo V. Paunonen,et al.  Hierarchical Organization of Personality and Prediction of Behavior , 1998 .

[85]  R. Krueger,et al.  The higher-order structure of common DSM mental disorders: internalization, externalization, and their connections to personality , 2001 .

[86]  J. Butcher.  Assessing Pilots with 'the Wrong Stuff': A Call for Research on Emotional Health Factors in Commercial Aviators , 2002 .

[87]  D. Ones.  Introduction to the Special Issue on Counterproductive Behaviors at Work , 2002 .

[88]  B. Doebbeling,et al.  Confirmatory factor analyses of posttraumatic stress symptoms in deployed and nondeployed veterans of the Gulf War. , 2002, Journal of abnormal psychology.

[89]  M. Kusch.  Metaphysical déjà vu: Hacking and Latour on science studies and metaphysics , 2002 .

[90]  D. Borsboom,et al.  The Theoretical Status of Latent Variables , 2003 .

[91]  Gregory T. Smith,et al.  Incremental validity principles in test construction. , 2003, Psychological assessment.

[92]  Deanna M Barch,et al.  Context-processing deficits in schizophrenia: diagnostic specificity, 4-week course, and relationships to clinical symptoms. , 2003, Journal of abnormal psychology.

[93]  W. A. Phillips,et al.  Where the rubber meets the road: The importance of implementation , 2003, Behavioral and Brain Sciences.

[94]  M. Eid,et al.  Separating trait effects from trait-specific method effects in multitrait-multimethod models: a multiple-indicator CT-C(M-1) model. , 2003, Psychological methods.

[95]  D. Borsboom,et al.  The concept of validity. , 2004, Psychological review.

[96]  P. Meehl.  Theoretical Risks and Tabular Asterisks: Sir Karl, Sir Ronald, and the Slow Progress of Soft Psychology , 2004 .

[97]  Vasilis Z. Marmarelis,et al.  A Practitioner's Guide , 2004 .

[98]  M. Stein,et al.  Heritability of individual depressive symptoms. , 2004, Journal of affective disorders.

[99]  A. Serretti,et al.  Dimensions of major psychoses: a confirmatory factor analysis of six competing models , 2004, Psychiatry Research.

[100]  P. Uhlhaas,et al.  Perceptual organization in schizophrenia spectrum disorders: empirical research and theoretical implications. , 2005, Psychological bulletin.

[101]  T. Widiger,et al.  Alternative dimensional models of personality disorder: finding a common ground. , 2005, Journal of personality disorders.

[102]  D. Barch,et al.  The Cognitive Neuroscience of Schizophrenia , 2005 .

[103]  Cameron S Carter,et al.  A convergent-divergent approach to context processing, general intellectual functioning, and the genetic liability to schizophrenia. , 2005, Neuropsychology.

[104]  Gregory T. Smith.  On construct validity: issues of method and measurement. , 2005, Psychological assessment.

[105]  R. McGrath.  Conceptual Complexity and Construct Validity , 2005, Journal of personality assessment.

[106]  Gregory T. Smith.  On the Complexity of Quantifying Construct Validity: Reply. , 2005 .

[107]  M. Battaglia,et al.  Taxonic structure of schizotypal personality disorder: A multiple-instrument, multi-sample study based on mixture models , 2005, Psychiatry Research.

[108]  M. Maraun,et al.  What Does It Mean That an Issue Is Conceptual in Nature? , 2005, Journal of personality assessment.

[109]  P. Barrett.  What If There Were No Psychometrics?: Constructs, Complexity, and Measurement , 2005, Journal of personality assessment.

[110]  On the complexity of quantifying construct validity. , 2005, Psychological assessment.

[111]  Robert Krueger,et al.  Personality disorder research agenda for the DSM-V. , 2005, Journal of personality disorders.

[112]  Treatment Planning With the MMPI-2. , 2006 .

[113]  David C. Atkins,et al.  Randomized trial of behavioral activation, cognitive therapy, and antidepressant medication in the acute treatment of adults with major depression. , 2006, Journal of consulting and clinical psychology.

[114]  D. S. Nichols,et al.  Use of the MMPI-2 in Inpatient Mental Health Settings. , 2006 .

[115]  M. Kane,et al.  In Praise of Pluralism. A Comment on Borsboom , 2006, Psychometrika.

[116]  Lee Anna Clark,et al.  When a Psychometric Advance Falls in the Forest , 2006, Psychometrika.

[117]  D. Lynam,et al.  Two Approaches to Parsing the Heterogeneity of Psychopathy , 2006 .

[118]  Denny Borsboom,et al.  The attack of the psychometricians , 2006, Psychometrika.

[119]  J. Butcher.  MMPI-2 : a practitioner's guide , 2006 .

[120]  Use of the MMPI-2 in Outpatient Mental Health Settings. , 2006 .

[121]  Sarah Fischer,et al.  On the Validity and Utility of Discriminating Among Impulsivity-Like Traits , 2007, Assessment.

[122]  D. Lynam,et al.  Using a general model of personality to identify the basic elements of psychopathy. , 2007, Journal of personality disorders.

[123]  T. Trull,et al.  Plate tectonics in the classification of personality disorder: shifting to a dimensional model. , 2007, The American psychologist.

[124]  S. Silverstein.  Measuring specific, rather than generalized, cognitive deficits and maximizing between-group effect size in studies of cognition and cognitive change. , 2007, Schizophrenia bulletin.

[125]  M. Eid,et al.  Analyzing the convergent and discriminant validity of states and traits: development and applications of multimethod latent state-trait models. , 2008, Psychological assessment.

[126]  E. Megargee.  The California Psychological Inventory , 2009 .