Predicting High School Graduation and College Enrollment: Comparing Early Warning Indicator Data and Teacher Intuition

Each year, more districts implement early warning systems (EWS). These EWS predict negative student outcomes, such as dropping out, before they occur. Predictions are then used to match at-risk students to appropriate supports and interventions. Research suggests that these systems are useful in ensuring educators respond to student needs early, generating conversation around specific students at risk of dropping out. However, no research considers what new information teachers gain from having a specific prediction for a student. This article bridges this gap by comparing teacher and EWS predictions of whether students will complete high school and enroll in college. Further, it assesses whether accuracy in teacher judgment stems from additional information not in models—especially related to academic tenacity—and biases like self-fulfilling prophecies. Generally, EWS can provide benefits both as organizational tools and by increasing the precision with which students are identified for supports and interventions.

[1]  R. Rosenthal,et al.  Pygmalion in the Classroom: Teacher Expectation and Pupils' Intellectual Development , 1968 .

[2]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[3]  C. Dweck,et al.  A social-cognitive approach to motivation and personality , 1988 .

[4]  R. Dawes,et al.  Heuristics and Biases: Clinical versus Actuarial Judgment , 2002 .

[5]  D. McClish,et al.  How Well Can Physicians Estimate Mortality in a Medical Intensive Care Unit? , 1989, Medical decision making : an international journal of the Society for Medical Decision Making.

[6]  Robert C. Blattberg,et al.  Database Models And Managerial Intuition: 50% Model + 50% Manager , 1990 .

[7]  B Kleinmuntz,et al.  Why we still use our heads instead of formulas: toward an integrative approach. , 1990, Psychological bulletin.

[8]  Robin M. Hogarth,et al.  Judgmental Versus Statistical Prediction: Information Asymmetry and Combination Rules , 1993 .

[9]  N. Ambady,et al.  Half a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. , 1993 .

[10]  Stephen J. Hoch,et al.  A psychological approach to decision support systems , 1996 .

[11]  Jacquelynne S. Eccles,et al.  Social Perception, Social Stereotypes, and Teacher Expectations: Accuracy and the Quest for the Powerful Self-Fulfilling Prophecy , 1996 .

[12]  J. Eccles,et al.  In search of the powerful self-fulfilling prophecy. , 1997, Journal of personality and social psychology.

[13]  Orley Ashenfelter,et al.  Income, Schooling, and Ability: Evidence from a New Sample of Identical Twins , 1997 .

[14]  Whitecotton,et al.  Improving Predictive Accuracy with a Combination of Human Intuition and Mechanical Decision Aids. , 1998, Organizational behavior and human decision processes.

[15]  R. Sawyer,et al.  Is High School GPA Better than Admission Test Scores for Predicting Academic Success in College , 2004 .

[16]  C. Adelman Executive Summary: The Toolbox Revisited--Paths to Degree Completion from High School through College. , 2006 .

[17]  Angela L. Duckworth,et al.  Self-Discipline Outdoes IQ in Predicting Academic Performance of Adolescents , 2005, Psychological science.

[18]  Lee Jussim,et al.  Teacher Expectations and Self-Fulfilling Prophecies: Knowns and Unknowns, Resolved and Unresolved Controversies , 2005, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[19]  Felix C. Freiling,et al.  Early warning system. , 2010, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[20]  T. Dee A Teacher Like Me: Does Race, Ethnicity, or Gender Matter? , 2005 .

[21]  Jennifer A. Mangels,et al.  Why do beliefs about intelligence influence learning success? A social cognitive neuroscience model. , 2006, Social cognitive and affective neuroscience.

[22]  R. Balfanz,et al.  Preventing Student Disengagement and Keeping Students on the Graduation Path in Urban Middle-Grades Schools: Early Identification and Effective Interventions , 2007 .

[23]  Saul Geiser,et al.  Validity of High-School Grades in Predicting Student Success beyond the Freshman Year: High-School Record vs. Standardized Tests as Indicators of Four-Year College Outcomes. Research & Occasional Paper Series: CSHE.6.07. , 2007 .

[24]  T. Dee Teachers and the Gender Gaps in Student Achievement , 2005, The Journal of Human Resources.

[25]  S. Therriault,et al.  Developing Early Warning Systems to Identify Potential High School Dropouts. Issue Brief. , 2008 .

[26]  Julian R. Betts,et al.  Predicting Success, Preventing Failure: An Investigation of the California High School Exit Exam , 2008 .

[27]  S. C. Wheeler,et al.  Contextual priming: Where people vote affects how they vote , 2008, Proceedings of the National Academy of Sciences.

[28]  Angela L. Duckworth,et al.  Development and Validation of the Short Grit Scale (Grit–S) , 2009, Journal of personality assessment.

[29]  John B Carlin,et al.  Multiple imputation for missing data: fully conditional specification versus multivariate normal imputation. , 2010, American journal of epidemiology.

[30]  Gregory M. Walton,et al.  A Brief Social-Belonging Intervention Improves Academic and Health Outcomes of Minority Students , 2011, Science.

[31]  Nettie Legters,et al.  Organizing Schools to Address Early Warning Indicators (EWIs): Common Practices and Challenges , 2013 .

[32]  M. M. Mac Iver,et al.  The ABCs of Keeping On Track to Graduation: Research Findings from Baltimore , 2013 .

[33]  Elaine Allensworth,et al.  The Use of Ninth-Grade Early Warning Indicators to Improve Chicago Schools , 2013 .

[34]  J. Kemple,et al.  Building On-Track Indicators for High School Graduation and College Readiness: Evidence from New York City , 2013 .

[35]  Robert H. Meyer,et al.  Theory and Application of Early Warning Systems for High School and Beyond , 2013 .

[36]  Geoffrey L. Cohen,et al.  Academic Tenacity: Mindsets and Skills that Promote Long-Term Learning. , 2014 .