Determining the Significance of Correlations Corrected for Unreliability and Range Restriction

A new asymptotic formula for estimating the sampling variance of a correlation coefficient corrected for unreliability and range restriction was proposed. A Monte Carlo assessment of the new sampling variance formula has resulted in the following conclusions. First, the formula-based (analytical) sampling variances were very close to the empirically derived sampling variances based on 5,000 replications. Second, the sampling variance formula was quite robust against committing Type I errors. Third, the statistical power was low to moderate in distinguishing between two unattenuated and unrestricted population correlations. Fourth, the new formula produced smaller sampling variances; was closer to nominal alpha levels; and was more powerful when sample size increased, when the population correlation coefficient increased, when range restriction was less severe, and when both the criterion and predictor reliabilities increased.

[1]  William H. Press,et al.  Numerical recipes , 1990 .

[2]  Jorge L. Mendoza,et al.  Fisher transformations for correlations corrected for selection and missing data , 1993 .

[3]  L. Hedges.  The meta-analysis of test validity studies: Some new approaches , 1988 .

[4]  A new meta-analytic approach. , 1991 .

[5]  Interval Estimation of Correlation Coefficients Corrected for Restriction of Range , 1976 .

[6]  A. Hakstian,et al.  Inferential procedures for correlation coefficients corrected for attenuation , 1988 .

[7]  Philip Bobko,et al.  Large Sample Estimators for Standard Errors of Functions of Correlation Coefficients , 1980 .

[8]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[9]  J. Mendoza,et al.  Large-sample confidence intervals for validity and reliability coefficients. , 2000, Psychological methods.

[10]  M. Kendall,et al.  The advanced theory of statistics , 1945 .

[11]  W. Todd Rogers,et al.  Jackknifing disattenuated correlations , 1976 .

[12]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[13]  Robert A. Forsyth,et al.  An Investigation of Empirical Sampling Distributions of Correlation Coefficients Corrected for Attenuation , 1969 .

[14]  Nancy L. Allen,et al.  Standard Errors of Correlations Adjusted for Incidental Selection , 1989 .

[15]  J. Mendoza,et al.  Validity generalization procedures using sample-based estimates: A comparison of six procedures. , 1991 .

[16]  P. Bobko.  An analysis of correlations corrected for attenuation and range restriction. , 1983 .

[17]  J. Mendoza,et al.  The proper sequence for correcting correlation coefficients for range restriction and unreliability , 2001 .

[18]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[19]  M. L. Schroeder,et al.  Inferential theory for partially disattenuated correlation coefficients , 1989 .

[20]  H. Gulliksen.  Theory of mental tests , 1952 .

[21]  R. Forsyth.  An Empirical Note on Correlation Coefficients Corrected for Restriction in Range , 1971 .

[22]  John E. Hunter,et al.  Methods of Meta-Analysis , 1989 .