College Performance Predictions and the SAT

The methods used in most SAT validity studies cannot be justified by any sample selection assumptions and are uninformative about the source of the SAT's predictive power. A new omitted variables estimator is proposed; plausibly consistent estimates of the SAT's contribution to predictions of University of California freshman grade point averages are about 20% smaller than the usual methods imply. Moreover, much of the SAT's predictive power is found to derive from its correlation with high school demographic characteristics: The orthogonal portion of SAT scores is notably less predictive of future performance than is the unadjusted score.

[1]  Summary of Validity Data from the Admissions Testing Program Validity Study Service. , 1977 .

[2]  PLACEMENT VALIDITY OF A PROTOTYPE SAT WITH AN ESSAY , 1992 .

[3]  John W. Young.  Are validity coefficients understated due to correctable defects in the GPA? , 1990 .

[4]  Wayne J. Camara,et al.  The SAT[R] I and High School Grades: Utility in Predicting Success in College. Research Notes. , 2000 .

[5]  Robert Gibbons,et al.  Does Unmeasured Ability Explain Inter-Industry Wage Differentials? , 1992 .

[6]  James H. Crouse,et al.  Should We Relabel the SAT...Or Replace It , 1982 .

[7]  Warren W. Willingham,et al.  Success in College: The Role of Personal Qualities and Academic Ability , 1985 .

[8]  Jiming Jiang,et al.  GENDER BIAS AND THE COLLEGE PREDICTIONS OF THE SATS: A Cry of Despair , 1999 .

[9]  J. Heckman.  Sample selection bias as a specification error , 1979 .

[10]  H. Breland.  POPULATION VALIDITY AND COLLEGE ENTRANCE MEASURES , 1978 .

[11]  Warner V. Slack,et al.  The Scholastic Aptitude Test: A Critical Appraisal , 1980 .

[12]  R. Nader,et al.  The Reign of ETS: The Corporation That Makes up Minds. , 1981 .

[13]  D. Woodruff,et al.  The Shape of the River: Long-Term Consequences of Considering Race in College and University Admissions , 1998 .

[14]  R. Elliott,et al.  Effects of Improving the Reliability of the GPA on Prediction Generally and on Comparative Predictions for Gender and Race Particularly , 1988 .

[15]  Brent Bridgeman,et al.  Predictions of Freshman Grade-Point Average from the Revised and Recentered SAT[R] I: Reasoning Test. College Board Research Report. , 2000 .

[16]  John W. Young.  Grade Adjustment Methods , 1993 .

[17]  Saul Geiser,et al.  UC and the SAT: Predictive Validity and Differential Impact of the SAT I and SAT II at the University of California , 2001 .

[18]  R. Goldman,et al.  A Within-Subjects Technique for Comparing College Grading Standards: Implications in the Validity of the Evaluation of College Achievement , 1976 .

[19]  Dale Trusheim,et al.  The Case against the SAT , 1988 .

[20]  J. Hunter,et al.  Validity and Utility of Alternative Predictors of Job Performance , 1984 .

[21]  B. Bridgeman.  ESSAYS AND MULTIPLE‐CHOICE TESTS AS PREDICTORS OF COLLEGE FRESHMAN GPA , 1991 .

[22]  H. Breland,et al.  Personal qualities and college admissions , 1982 .

[23]  W. Greene.  Sample Selection Bias as a Specification Error: Comment , 1981 .

[24]  Joshua D. Angrist,et al.  Identification of Causal Effects Using Instrumental Variables , 1993 .

[25]  Nicholas Lemann,et al.  The Big Test: The Secret History of the American Meritocracy , 1999 .

[26]  Kenneth M. Wilson,et al.  A Review of Research on the Prediction of Academic Performance After the Freshman Year , 1983 .

[27]  H. James.  VARIETIES OF SELECTION BIAS , 1990 .

[28]  Gary Echternacht,et al.  The SAT ® I and High School Grades: Utility in Predicting Success in College , 2000 .

[29]  Christopher R. Taber,et al.  Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools , 2000, Journal of Political Economy.

[30]  L. J. Stricker.  Current Validity of 1975 and 1985 SATs: Implications for Validity Trends since the Mid-1970s. , 1991 .

[31]  A. Roy.  Some thoughts on the distribution of earnings , 1951 .

[32]  Frances K. Stage.  Predicting College Grades: An Analysis of Institutional Trends over Two Decades , 1993 .

[33]  Richard C. Atkinson,et al.  Standardized Tests And Access To American Universities , 2001 .