Prediction of 4-year college student performance using cognitive and noncognitive predictors and the impact on demographic status of admitted students.

This study was conducted to determine the validity of noncognitive and cognitive predictors of the performance of college students at the end of their 4th year in college. Results indicate that the primary predictors of cumulative college grade point average (GPA) were Scholastic Assessment Test/American College Testing Assessment (SAT/ACT) scores and high school GPA (HSGPA) though biographical data and situational judgment measures added incrementally to this prediction. SAT/ACT scores and HSGPA were collected and used in various ways by participating institutions in the admissions process while situational judgment measures and biodata were collected for research purposes only during the first few weeks of the participating students' freshman year. Alternative outcomes such as a self-report of performance on a range of student performance dimensions and a measure of organizational citizenship behavior, as well as class absenteeism, were best predicted by noncognitive measures. The racial composition of a student body selected with only cognitive measures or both cognitive and noncognitive measures under various levels of selectivity as well as the performance of students admitted under these scenarios is also reported. The authors concluded that both the biodata and situational judgment measures could be useful supplements to cognitive indexes of student potential in college admissions.

[1]  N. Kuncel,et al.  Study Habits, Skills, and Attitudes: The Third Pillar Supporting Collegiate Academic Performance , 2008, Perspectives on psychological science : a journal of the Association for Psychological Science.

[2]  Marinella Paciello,et al.  Assessing personality in early adolescence through self-report and other-ratings a multitrait-multimethod analysis of the BFQ-C , 2008 .

[3]  Filip Lievens,et al.  Combining predictors to achieve optimal trade-offs between selection quality and adverse impact. , 2007, The Journal of applied psychology.

[4]  F. Lievens,et al.  Situational judgment tests in high-stakes settings: issues and strategies with generating alternate forms. , 2007, The Journal of applied psychology.

[5]  Nathan S. Hartman,et al.  SITUATIONAL JUDGMENT TESTS, RESPONSE INSTRUCTIONS, AND VALIDITY: A META‐ANALYSIS , 2007 .

[6]  N. Kuncel,et al.  A Meta-Analysis of the Predictive Validity of the Graduate Management Admission Test (GMAT) and Undergraduate Grade Point Average (UGPA) for Graduate Student Academic Performance. , 2007 .

[7]  Sarah A. Hezlett,et al.  Standardized Tests Predict Graduate Students' Success , 2007, Science.

[8]  Fred A. Mael.  A CONCEPTUAL RATIONALE FOR THE DOMAIN AND ATTRIBUTES OF BIODATA ITEMS , 2006 .

[9]  R. Sternberg.  The Rainbow Project: Enhancing the SAT through assessments of analytical, practical, and creative skills , 2006 .

[10]  Robert E. Ployhart,et al.  Staffing Organizations: Contemporary Practice and Theory , 2005 .

[11]  R. Dalal.  A meta-analysis of the relationship between organizational citizenship behavior and counterproductive work behavior. , 2005, The Journal of applied psychology.

[12]  M. D. Dunnette.  Handbook of Industrial and Organizational Psychology , 2005 .

[13]  Filip Lievens,et al.  The operational validity of a video-based situational judgment test for medical college admissions: illustrating the importance of matching predictor and criterion construct domains. , 2005, The Journal of applied psychology.

[14]  Wayne J. Camara,et al.  Choosing students : higher education admissions tools for the 21st century , 2005 .

[15]  Nathan R. Kuncel,et al.  The Validity of Self-Reported Grade Point Averages, Class Ranks, and Test Scores: A Meta-Analysis and Review of the Literature , 2005 .

[16]  John W. Lounsbury,et al.  Predicting Academic Success: General Intelligence, "Big Five" Personality Traits, and Work Drive , 2004 .

[17]  N. Schmitt,et al.  Developing a biodata measure and situational judgment inventory as predictors of college student performance. , 2004, The Journal of applied psychology.

[18]  Kristy J. Lauver,et al.  Do psychosocial and study skill factors predict college outcomes? A meta-analysis. , 2004, Psychological bulletin.

[19]  N. Schmitt,et al.  Impact of elaboration on socially desirable responding and the validity of biodata measures. , 2003, The Journal of applied psychology.

[20]  Janet G. Melancon.  Reliability, Structure, and Correlates of Learning and Study Strategies Inventory Scores , 2002 .

[21]  K. E. Barron,et al.  Predicting Success in College: A Longitudinal Study of Achievement Goals and Ability Measures as Predictors of Interest and Performance From Freshman Year Through Graduation , 2002 .

[22]  Jill E. Ellingson,et al.  High-stakes testing in employment, credentialing, and higher education. Prospects in a post-affirmative-action world. , 2001, The American psychologist.

[23]  P. Zeegers,et al.  Approaches to learning in science: a longitudinal study. , 2001, The British journal of educational psychology.

[24]  Robert E. Ployhart,et al.  Determinants, Detection and Amelioration of Adverse Impact in Personnel Selection Procedures: Issues, Evidence and Lessons Learned , 2001 .

[25]  Brent Bridgeman,et al.  Predictions of Freshman Grade-Point Average from the Revised and Recentered SAT[R] I: Reasoning Test. College Board Research Report. , 2000 .

[26]  Philip L. Roth,et al.  DERIVATION AND IMPLICATIONS OF A META‐ANALYTIC MATRIX INCORPORATING COGNITIVE ABILITY, ALTERNATIVE PREDICTORS, AND JOB PERFORMANCE , 1999 .

[27]  Michael D. Mumford,et al.  Background Data and Autobiographical Memory: Effects of Item Types and Task Characteristics , 1999 .

[28]  Neil J. Dorans,et al.  Concordance Between SAT I and ACT Scores for Individual Students , 1999 .

[29]  H. Stumpf,et al.  A validation of the five-factor model of personality in academically talented youth across observers and instruments , 1998 .

[30]  Neal Schmitt,et al.  Adverse impact and predictive efficiency of various predictor combinations , 1997 .

[31]  Robert M. Guion,et al.  Assessment, Measurement, and Prediction for Personnel Decisions , 1997 .

[32]  Paul R. Sackett,et al.  THE EFFECTS OF FORMING MULTI‐PREDICTOR COMPOSITES ON GROUP DIFFERENCES AND ADVERSE IMPACT , 1997 .

[33]  Walter C. Borman,et al.  Task Performance and Contextual Performance: The Meaning for Personnel Selection Research , 1997 .

[34]  R. H. Moorman,et al.  Individualism‐collectivism as an individual difference predictor of organizational citizenship behavior , 1995 .

[35]  M. Mumford,et al.  Biodata Handbook: Theory, Research, and Use of Biographical Information in Selection and Performance Prediction , 1994 .

[36]  K. Murphy.  Personnel Selection in Organizations , 1992 .

[37]  M. D. Dunnette,et al.  An alternative selection procedure: The low-fidelity simulation. , 1990 .

[38]  Gerald V. Barrett,et al.  Validity of Personnel Decisions: A Conceptual Analysis of the Inferential and Evidential Bases , 1989 .

[39]  R. Bies,et al.  Organizational Citizenship Behavior: The Good Soldier Syndrome , 1989 .

[40]  W. Sedlacek,et al.  Noncognitive Predictors of Academic Success for International Students: A Longitudinal Study. Research Report #1-87. , 1988 .

[41]  Michael D. Mumford,et al.  Methodology Review: Principles, Procedures, and Findings in the Application of Background Data Measures , 1987 .

[42]  Philip Bobko,et al.  TESTING FOR FAIRNESS WITH A MODERATED MULTIPLE REGRESSION STRATEGY: AN ALTERNATIVE TO DIFFERENTIAL ANALYSIS , 1978 .

[43]  Timothy J. Pantages,et al.  Studies of College Attrition: 1950––1975 , 1978 .

[44]  W. Michael,et al.  The Validity of Traditional Cognitive Measures and of Scales of the Study Attitudes and Methods Survey in the Prediction of the Academic Success of Educational Opportunity Program Students , 1977 .

[45]  D. Payne.  Application of a Biographical Data Inventory to Estimate College Academic Achievement. , 1973 .

[46]  T. Cleary.  TEST BIAS: PREDICTION OF GRADES OF NEGRO AND WHITE STUDENTS IN INTEGRATED COLLEGES , 1968 .

[47]  J. L. Holland,et al.  Prediction of student accomplishment in college. , 1967, Journal of educational psychology.

[48]  Shonna D. Waters,et al.  Does socioeconomic status explain the relationship between admissions tests and post-secondary academic performance? , 2009, Psychological bulletin.

[49]  Neal Schmitt,et al.  The use of background and ability profiles to predict college student outcomes. , 2007, The Journal of applied psychology.

[50]  Jennifer Hedlund,et al.  Assessing Practical Intelligence in Business School Admissions: A Supplement to the Graduate Management Admissions Test. , 2006 .

[51]  N. Schmitt,et al.  Situational judgment tests: Method or construct? , 2006 .

[52]  Sarah A. Hezlett,et al.  Academic performance, career potential, creativity, and job performance: can one construct predict them all? , 2004, Journal of personality and social psychology.

[53]  Gretchen W. Rigol.  Admissions Decision-Making Models: How U.S. Institutions of Higher Education Select Undergraduate Students , 2003 .

[54]  Sarah A. Hezlett,et al.  A comprehensive meta-analysis of the predictive validity of the graduate record examinations: implications for graduate student selection and performance. , 2001, Psychological bulletin.

[55]  F. Schmidt,et al.  The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. , 1998 .

[56]  Mary Pommerich,et al.  Concordance Between ACT Assessment and Recentered SAT I Sum Scores. , 1997 .

[57]  W. Borman,et al.  Expanding the Criterion Domain to Include Elements of Contextual Performance , 1993 .

[58]  M. Mumford,et al.  Developmental determinants of individual action: Theory and practice in applying background measures. , 1992 .

[59]  Phillip L. Ackerman,et al.  Within-task intercorrelations of skilled performance: Implications for predicting individual differences? A comment on Henry & Hulin, 1987. , 1989 .

[60]  Rebecca A. Henry,et al.  Changing validities: Ability^performance relations and utilities. , 1989 .

[61]  R. Klimoski,et al.  Is it rational to be empirical? A test of methods for scoring biographical data. , 1982 .

[62]  H. Breland,et al.  Personal qualities and college admissions , 1982 .

[63]  Lyle F. Schoenfeldt,et al.  Toward a classification of persons. , 1979 .

[64]  Jeremy D. Finn,et al.  Measurement and Evaluation. , 1973 .

[65]  Anne Anastasi,et al.  The validation of a biographical inventory as a predictor of college success : development and validation of the scoring key , 1960 .