Alpha Inflation? The Impact of Eliminating Scale Items on Cronbach's Alpha

In this paper, we study the effect of the elimination of items from a scale so that only those items that correlate highly are chosen. Using a simulation, we estimate the impact on Cronbach's alpha as a function of the total number of items in a scale, the number of items chosen, the true correlation among the items, and the sample size. The results suggest that a substantial effect can exist. Not surprisingly, the effect is larger when sample sizes are smaller, when a smaller fraction of the original items is retained, and when there is greater variation in the true item-total correlations of the measures.

[1]  Sung-Mook Hong,et al.  Refinement of the Hong Psychological Reactance Scale , 1996 .

[2]  N. Smith-sebasto,et al.  Designing a likert-type scale to predict environmentally responsible behavior in undergraduate students: A multistep process. , 1995 .

[3]  J. Romans,et al.  Development of the Relationship Beliefs Questionnaire , 1995, Psychological reports.

[4]  Patricia L. Smith,et al.  The Development of the Opinions about Deaf People Scale: A Scale to Measure Hearing Adults' Beliefs about the Capabilities of Deaf Adults , 1995 .

[5]  R. Peterson.  A Meta-analysis of Cronbach's Coefficient Alpha , 1994 .

[6]  David A. Schkade,et al.  Effects of Attribute Scales on Process and Performance in Multiattribute Choice , 1994 .

[7]  Marcus O'Connor,et al.  Scale, Variability, and the Calibration of Judgmental Prediction Intervals , 1993 .

[8]  Bruno D. Zumbo,et al.  Coefficient Alpha as an Estimate of Test Reliability Under Violation of Two Assumptions , 1993 .

[9]  J. M. Cortina,et al.  What Is Coefficient Alpha? An Examination of Theory and Applications , 1993 .

[10]  T. Dickinson,et al.  Modifications in the format of the mixed standard scale , 1990 .

[11]  J. Sawyer.  Measuring attitudes across job levels: When are scale scores truly comparable? , 1988 .

[12]  Edward R. Kemery,et al.  Effects of predictor intercorrelations and reliabilities on moderated multiple regression , 1988 .

[13]  J. Murry,et al.  A Lifestyle Typology to Model Young Male Drinking and Driving , 1987 .

[14]  T. Dickinson.  Designs for evaluating the validity and accuracy of performance ratings , 1987 .

[15]  Michael R. Solomon,et al.  Predictability and Personalization in the Service Encounter , 1987 .

[16]  Gilbert A. Churchill,et al.  Relationships among research design choices and psychometric properties of rating scales: A meta-analysis. , 1986 .

[17]  R. Guion,et al.  A reevaluation of the absenteeism-job satisfaction relationship. , 1985, Organizational behavior and human decision processes.

[18]  J. D. Stowe,et al.  Univariate and multivariate distributions of the job descriptive index's measures of job satisfaction , 1985 .

[19]  Gilbert A. Churchill,et al.  Research Design Effects on the Reliability of Rating Scales: A Meta-Analysis: , 1984 .

[20]  M. Goldstein,et al.  Multivariate Analysis: Methods and Applications , 1984 .

[21]  Robert W. Ruekert,et al.  Reliability and Validity of Alternative Measures of Channel Member Satisfaction , 1984 .

[22]  S. Shacham,et al.  A shortened version of the Profile of Mood States. , 1983, Journal of personality assessment.

[23]  Barbara S. Plake,et al.  The Development and Validation of a Revised Version of the Mathematics Anxiety Rating Scale , 1982 .

[24]  L. Eron,et al.  Measuring patterns of fantasy behavior in children. , 1982 .

[25]  Naresh K. Malhotra,et al.  A Scale to Measure Self-Concepts, Person Concepts, and Product Concepts: , 1981 .

[26]  W. Bingham,et al.  Modified Questionnaire On the Occupational Status of Women , 1981 .

[27]  P. Gardner,et al.  A TRANSMISSION‐INTERPRETATION SCALE , 1980 .

[28]  G. Jenkins,et al.  A Monte Carlo study of factors affecting three indices of composite scale reliability. , 1977 .

[29]  R. Lissitz,et al.  Effect of the number of scale points on reliability: A Monte Carlo approach. , 1975 .

[30]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .