Measurement Errors in the Behavioral Sciences: The Case of Personality/Attitude Research

It has been established that construct measures often contain measurement error and method effects. However, the extent of these measurement problems and their effects on personality constructs has not been fully examined. In this study, an analysis of published data sets affords estimates of the amount of trait, method, and error variance of measures used in the social/behavioral sciences. It was found that traits accounted for less than 50 percent of the variance in construct measures among the entire group of data sets included in the study. Measures of attitudes and personality variables contain considerably less trait variance. Implications for theory testing are discussed.

[1]  M. Ronald Buckley,et al.  Measurement Error and Theory Testing in Consumer Research: An Illustration of the Importance of Construct Validation , 1988 .

[2]  Joseph A. Cote,et al.  Estimating Trait, Method, and Error Variance: Generalizing across 70 Construct Validation Studies: , 1987 .

[3]  William R. Dillon,et al.  Offending Estimates in Covariance Structure Analysis: Comments on the Causes of and Solutions to Heywood Cases , 1987 .

[4]  Gilbert A. Churchill,et al.  Relationships among research design choices and psychometric properties of rating scales: A meta-analysis. , 1986 .

[5]  A. Boomsma.  Nonconvergence, improper solutions, and starting values in lisrel maximum likelihood estimation , 1985 .

[6]  K. Widaman.  Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data , 1985 .

[7]  Daniel Seymour,et al.  Spousal Conflict Arousal: Scale Development , 1984 .

[8]  C. Saylor,et al.  Construct validity for measures of childhood depression: application of multitrait-multimethod methodology. , 1984, Journal of consulting and clinical psychology.

[9]  H. Marsh,et al.  Evaluating Reading Diagnostic Tests: An Application of Confirmatory Factor Analysis To Multitrait-Multimethod Data , 1984 .

[10]  James C. Anderson,et al.  The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis , 1984 .

[11]  S Flamer,et al.  Assessment of the Multitrait-Multimethod Matrix Validity of Likert Scales Via Confirmatory Factor Analysis. , 1983, Multivariate behavioral research.

[12]  S. Wirth,et al.  Convergent and Discriminant Validity of the Iowa Social Competency Scale for Preschool Children , 1983 .

[13]  D. J. Lamont.  A three dimensional test for White's effectance motive. , 1983, Journal of personality assessment.

[14]  Ian D. Smith,et al.  Multitrait-Multimethod Analyses of the Self-description Questionnaire: Student-Teacher Agreement on Multidimensional Ratings of Student Self-concept , 1983 .

[15]  John R. Nesselroade,et al.  Examination of personality-ability relationships in the elderly: The role of the contextual (interface) assessment mode , 1982 .

[16]  Raj Arora,et al.  Validation of an S-O-R Model for Situation, Enduring, and Response Components of Involvement , 1982 .

[17]  R. Bagozzi,et al.  Representing and testing organizational theories: A holistic construal. , 1982 .

[18]  Stephen M. Johnson,et al.  Response format of the Job Descriptive Index: Assessment of reliability and validity by the multitrait–multimethod matrix. , 1982 .

[19]  H. Marsh.  Validity of Students' Evaluations of College Teaching: A Multitrait-Multimethod Analysis. , 1982 .

[20]  John P. Campbell,et al.  Measurement Theory for the Behavioral Sciences. , 1983 .

[21]  J. Hattie,et al.  An investigation of the construct validity of three recently developed personality instruments: An application of confirmatory multimethod factor analysis , 1981 .

[22]  R. Milich,et al.  A multitrait-multimethod analysis of variance of teachers' ratings of aggression, hyperactivity, and inattention , 1981, Journal of abnormal child psychology.

[23]  J. Paul Peter,et al.  Construct Validity: A Review of Basic Issues and Marketing Practices , 1981 .

[24]  Douglas N. Jackson,et al.  Maximum-likelihood estimation in common factor analysis: A cautionary note , 1980 .

[25]  Joel Lefkowitz,et al.  The redundancy of work alienation and job satisfaction: Some evidence of convergent and discriminant validity , 1980 .

[26]  Timothy W. Elig,et al.  Measuring Causal Attributions for Success and Failure , 1980 .

[27]  John W. Bajtelsmit.  Convergent and Discriminant Validation of Chartered Life Underwriter (CLU) Examinations by the Multitrait-Multimethod Matrix , 1979 .

[28]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[29]  Charles M. Futrell.  Measurement of Salespeople's Job Satisfaction: Convergent and Discriminant Validity of Corresponding INDSALES and Job Descriptive Index Scales , 1979 .

[30]  Norbert F. Elbert,et al.  QUESTIONNAIRE VALIDATION BY CONFIRMATORY FACTOR ANALYSIS: AN IMPROVEMENT OVER MULTITRAIT-MULTIMETHOD MATRICES* , 1979 .

[31]  R. Kenneth Teas,et al.  A Path Analysis of Causes and Consequences of Salespeople's Perceptions of Role Clarity , 1979 .

[32]  Timothy W. Elig,et al.  Measuring causal attibutions for success and failure. , 1979 .

[33]  W. Avison.  Auxiliary Theory and Multitrait-Multimethod Validation: A Review of Two Approaches , 1978 .

[34]  O. P. V. Driel,et al.  On various causes of improper solutions in maximum likelihood factor analysis , 1978 .

[35]  Stephen A. Stumpf,et al.  Student Evaluations of Courses and Faculty Based on a Perceived Learning Criterion: Scale Construction, Validation, and Comparison of Results , 1978 .

[36]  S. B. Khan.  A COMPARATIVE STUDY OF ASSESSING CHILDREN'S SCHOOL‐RELATED ATTITUDES , 1978 .

[37]  Gerald L. Rose,et al.  Sex Effects on Managerial Hiring Decisions , 1978 .

[38]  Philip H. Winne,et al.  Construct Interpretations of Three Self-Concept Inventories , 1978 .

[39]  Bryan W. Coyle,et al.  A Review And Critique Of Analyses Of Multitrait-Multimethod Matrices. , 1977, Multivariate behavioral research.

[40]  Terence A. Shimp,et al.  An Experimental Test of the Harmful Effects of Premium-Oriented Commercials on Children , 1976 .

[41]  J. Ysseldyke,et al.  Convergent and Discriminant Validation of the Trait of Visual Figure-Ground Perception , 1976 .

[42]  D. Jackson,et al.  Is achievement a unitary construct , 1976 .

[43]  Michael J. Ryan,et al.  The Fishbein Extended Model and Consumer Behavior , 1975 .

[44]  David A. Nadler,et al.  Standardized observations: An approach to measuring the nature of jobs. , 1975 .

[45]  Jon G. Allen,et al.  The Development and Validation of a Test of Emotional Styles. , 1974 .

[46]  J. R. Barclay,et al.  Convergent and Discriminant Validity of the Barclay Classroom Climate Inventory , 1974 .

[47]  R. Most,et al.  A comparison of stress measures in an experimental analogue of public speaking. , 1973 .

[48]  T. Dickinson,et al.  A multitrait-multi method analysis of scales developed by retranslation , 1973 .

[49]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1973 .

[50]  Marvin D. Dunnette,et al.  The development and evaluation of behaviorally based rating scales , 1973 .

[51]  Robert J. House,et al.  Toward the measurement of organizational practices: Scale development and validation. , 1972 .

[52]  D N Jackson,et al.  A four-dimensional interpretation of risk taking. , 1972, Journal of personality.

[53]  S. Zedeck,et al.  Nursing performance as measured by behavioral expectation scales: A multitrait-multirater analysis , 1972 .

[54]  I. Frieze,et al.  A Multitrait-Multimethod Validation of Measures of Student Attitudes Toward School, Toward Learning, and Toward Technology in Sixth Grade Children , 1971 .

[55]  H. H. Kassarjian.  Personality and Consumer Behavior: A Review , 1971 .

[56]  V. Kothandapani,et al.  Validation of feeling, belief, and intention to act as three components of attitude and their contribution to prediction of contraceptive behavior. , 1971, Journal of personality and social psychology.

[57]  B. Schneider,et al.  Relationships between various criteria of leadership in small groups. , 1970, The Journal of social psychology.

[58]  G. Haley.  Item-Analysis Procedures for Enhancing Validity of Existing Personality Scales , 1970, Psychological reports.

[59]  L. Sechrest,et al.  A Multitrait-Multimethod Matrix Analysis of Sense of Humor , 1970 .

[60]  T. Mitchell.  The construct validity of three dimensions of leadership research. , 1970, The Journal of social psychology.

[61]  A. W. Wicker.  Attitudes Versus Actions: The Relationship of Verbal and Overt Behavioral Responses to Attitude Objects. , 1969 .

[62]  M. Evans.  Convergent and Discriminant Validities Between the Cornell Job Descriptive Index and a Measure of Goal Attainment. , 1969 .

[63]  T. Ostrom.  The relationship between the affective, behavioral, and cognitive components of attitude. , 1969 .

[64]  Convergent and Discriminant Validity of the Adjective Check List and Edwards Personal Preference Schedule , 1968 .

[65]  D. L. Mosher.  Measurement of guilt in females by self-report inventories. , 1968, Journal of consulting and clinical psychology.

[66]  J. M. Hicks.  Comparative Validation of Attitude Measures By The Multitrait-Multimethod Matrix , 1967 .

[67]  D T Campbell,et al.  Methods Factors In Multitrait-Multimethod Matrices : Multiplicative Rather Than Additive? , 1967, Multivariate behavioral research.

[68]  E. Lawler,et al.  The multitrait-multirater approach to measuring managerial job performance. , 1967, The Journal of applied psychology.

[69]  M. Zuckerman,et al.  A multitrait multimethod measurement approach to the traits (or states) of anxiety, depression and hostility. , 1967, Journal of Projective Techniques and Personality Assessment.

[70]  E. A. Locke,et al.  Convergent and discriminant validity for areas and methods of rating job satisfaction. , 1964 .

[71]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.