Predicting key educational outcomes in academic trajectories: a machine-learning approach

Predicting and understanding different key outcomes in a student’s academic trajectory such as grade point average, academic retention, and degree completion would allow targeted intervention programs in higher education. Most of the predictive models developed for those key outcomes have been based on traditional methodological approaches. However, these models assume linear relationships between variables and do not always yield accurate predictive classifications. On the other hand, the use of machine-learning approaches such as artificial neural networks has been very effective in the classification of various educational outcomes, overcoming the limitations of traditional methodological approaches. In this study, multilayer perceptron artificial neural network models, with a backpropagation algorithm, were developed to classify levels of grade point average, academic retention, and degree completion outcomes in a sample of 655 students from a private university. Findings showed a high level of accuracy for all the classifications. Among the predictors, learning strategies had the greatest contribution for the prediction of grade point average. Coping strategies were the best predictors for degree completion, and background information had the largest predictive weight for the identification of students who will drop out or not from the university programs.

[1]  Brad E. Sheese,et al.  Developing Attention: Behavioral and Brain Mechanisms. , 2014, Advances in neuroscience.

[2]  Robert M. Gonyea,et al.  Unmasking the Effects of Student Engagement on First-Year College Grades and Persistence , 2008 .

[3]  Patricia A. Alexander,et al.  Learning and study strategies : issues in assessment, instruction, and evaluation , 1988 .

[4]  B. Compas,et al.  Coping with stress during childhood and adolescence: problems, progress, and potential in theory and research. , 2001, Psychological bulletin.

[5]  Reinhard Pekrun,et al.  Academic Control and Action Control in the Achievement of College Students: A Longitudinal Field Study. , 2001 .

[6]  F. Dochy,et al.  Individual differences in working memory capacity and attention, and their relationship with students’ approaches to learning , 2011, Higher Education.

[7]  Richard P. Heitz,et al.  Complex working memory span tasks and higher-order cognition: A latent-variable analysis of the relationship between processing and storage , 2009, Memory.

[8]  P. Pintrich,et al.  Handbook of self-regulation , 2000 .

[9]  Laura J. Summerfeldt,et al.  Emotional intelligence and academic success: examining the transition from high school to university , 2004 .

[10]  Hall P. Beck,et al.  Establishing an Early Warning System: Predicting Low Grades in College Students from Survey of Academic Orientations Scores , 2001 .

[11]  Philip L. Roth,et al.  Meta-Analyzing the Relation between Grades and Salary☆☆☆ , 1998 .

[12]  Eva Kyndt,et al.  Predicting Mathematical Performance: The Effect of Cognitive Processes and Self-Regulation Factors , 2012 .

[13]  Markku Niemivirta,et al.  Self-Regulated Learning: Finding a Balance between Learning Goals and Ego-Protective Goals , 2000 .

[14]  G. Zimet,et al.  The Multidimensional Scale of Perceived Social Support , 1988 .

[15]  Ray Kent.  Rethinking Data Analysis - Part Two: Some Alternatives to Frequentist Approaches , 2009 .

[16]  Jusung Jun.  Understanding dropout of adult learners in E-learning , 2005 .

[17]  G. David Garson,et al.  Neural Networks: An Introductory Guide for Social Scientists , 1999 .

[18]  M. Boekaerts,et al.  Individual differences in basic cognitive processes and self-regulated learning: Their interaction effects on math performance , 2019, Learning and Individual Differences.

[19]  Does working memory training promote the use of strategies on untrained working memory tasks? , 2014, Memory & cognition.

[20]  John Dunlosky,et al.  Causes and constraints of the shift-to-easier-materials effect in the control of study , 2004, Memory & cognition.

[21]  Pasquale Moliterni,et al.  Motivational and Self Regulated Learning Components of Academic Performance. , 2010 .

[22]  Bruce D. McCandliss,et al.  Testing the Efficiency and Independence of Attentional Networks , 2002, Journal of Cognitive Neuroscience.

[23]  Z. Ahmad,et al.  Prediction of Students' Academic Performance Using Artificial Neural Network. , 2018 .

[24]  M. Deberard,et al.  Predictors of Academic Achievement and Retention among College Freshmen: A Longitudinal Study. , 2004 .

[25]  Terrell L. Strayhorn.  An Examination of the Impact of First-Year Seminars on Correlates of College Student Retention. , 2009 .

[26]  Debra K. Meyer,et al.  Cognitive learning strategies and college teaching , 1991 .

[27]  S. He,et al.  Descriptive Summary of 1995-96 Beginning Postsecondary Students: Six Years Later. Statistical Analysis Report. , 2002 .

[28]  H. Markus,et al.  Feeling at Home in College: Fortifying School‐Relevant Selves to Reduce Social Class Disparities in Higher Education , 2015 .

[29]  Craig Zimitat,et al.  Future time orientation predicts academic engagement among first-year university students. , 2007, The British journal of educational psychology.

[30]  R. Engle,et al.  Executive Attention, Working Memory Capacity, and a Two-Factor Theory of Cognitive Control. , 2003 .

[31]  Andrew R. A. Conway,et al.  Variation in Working Memory Capacity as Variation in Executive Attention and Control , 2012 .

[32]  Michael F. Bunting,et al.  Working memory span tasks: A methodological review and user’s guide , 2005, Psychonomic bulletin & review.

[33]  R. Bhaskaran,et al.  A CHAID Based Performance Prediction Model in Educational Data Mining , 2010, ArXiv.

[34]  M. Boekaerts.  SELF-REGULATED LEARNING: A NEW CONCEPT EMBRACED BY RESEARCHERS, POLICY MAKERS, EDUCATORS, TEACHERS, AND STUDENTS , 1997 .

[35]  John Dunlosky,et al.  The Contributions of Strategy Use to Working Memory Span: A Comparison of Strategy Assessment Methods , 2007, Quarterly journal of experimental psychology.

[36]  Li-tze Hu,et al.  Academic self-efficacy and first year college student performance and adjustment. , 2001 .

[37]  Zlatko J. Kovacic,et al.  Early Prediction of Student Success: Mining Students Enrolment Data , 2010 .

[38]  Andrej-Nikolai Spiess,et al.  An evaluation of R2 as an inadequate measure for nonlinear models in pharmacological and biochemical research: a Monte Carlo approach , 2010, BMC pharmacology.

[39]  Elizabeth J. Whitt,et al.  Student Success in College: Creating Conditions That Matter , 2012 .

[40]  J. Harackiewicz,et al.  Improving Student Outcomes in Higher Education: The Science of Targeted Intervention. , 2018, Annual review of psychology.

[41]  Richard P. Heitz,et al.  An automated version of the operation span task , 2005, Behavior research methods.

[42]  M. Covington.  Goal theory, motivation, and school achievement: an integrative review. , 2000, Annual review of psychology.

[43]  Emily J. Shaw,et al.  The Redesigned SAT® Pilot Predictive Validity Study: A First Look. Research Report 2016-1. , 2016 .

[44]  Geoffrey L. Cohen,et al.  The Psychology of the Affirmed Learner: Spontaneous Self-Affirmation in the Face of Stress. , 2016 .

[45]  Matthias Stadler,et al.  The complex route to success: complex problem-solving skills in the prediction of university success , 2016 .

[46]  M. R. Rueda,et al.  Behavioral and Brain Measures of Executive Attention and School Competence in Late Childhood , 2011, Developmental neuropsychology.

[47]  P. Niedenthal,et al.  Life Tasks, Self-Concept Ideals, and Cognitive Strategies in a Life Transition , 1987 .

[48]  Sotiris B. Kotsiantis,et al.  PREDICTING STUDENTS' PERFORMANCE IN DISTANCE LEARNING USING MACHINE LEARNING TECHNIQUES , 2004, Appl. Artif. Intell..

[49]  E. T. Lau,et al.  Modelling, prediction and classification of student academic performance using artificial neural networks , 2019, SN Applied Sciences.

[50]  Fred S. Switzer,et al.  Meta-analyzing the relationship between grades and job performance. , 1996 .

[51]  Richard D. Roberts,et al.  Coping mediates the relationship between emotional intelligence (EI) and academic achievement , 2011 .

[52]  Nicole M. Stephens,et al.  Closing the Social-Class Achievement Gap , 2014, Psychological science.

[53]  P. Pintrich.  The role of goal orientation in self-regulated learning. , 2000 .

[54]  E. Rog,et al.  Facilitating the Transition to University: Evaluation of a Social Support Discussion Intervention Program. , 2000 .

[55]  Serge Herzog,et al.  Estimating Student Retention and Degree-Completion Time: Decision Trees and Neural Networks Vis-a-Vis Regression. , 2006 .

[56]  Sarah A. Hezlett,et al.  Academic performance, career potential, creativity, and job performance: can one construct predict them all? , 2004, Journal of personality and social psychology.

[57]  S. Mark Pancer,et al.  Cognitive Complexity of Expectations and Adjustment to University in the First Year , 2000 .

[58]  Henriette Tolstrup Holmegaard,et al.  What do we know about explanations for drop out/opt out among young people from STM higher education programmes? , 2010 .

[59]  C. A. Spagnol,et al.  USO DEL PLAN DE CUIDADO COMO ESTRATEGIA DE SISTEMATIZACIÓN DE LA ATENCIÓN DE ENFERMERÍA , 2002 .

[60]  F. Dochy,et al.  Predicting general academic performance and identifying the differential contribution of participating variables using artificial neural networks , 2013 .

[61]  Nathan R. Kuncel,et al.  The Validity of Self-Reported Grade Point Averages, Class Ranks, and Test Scores: A Meta-Analysis and Review of the Literature , 2005 .

[62]  M. R. Minzi.  Coping assessment in adolescents. , 2003 .

[63]  P. Pintrich,et al.  Motivational and self-regulated learning components of classroom academic performance. , 1990 .

[64]  David J. Therriault,et al.  A latent variable analysis of working memory capacity, short-term memory capacity, processing speed, and general fluid intelligence , 2002 .

[65]  B. Zimmerman,et al.  Handbook of Self-Regulation of Learning and Performance , 2011 .

[66]  D. Watson,et al.  Health complaints, stress, and distress: exploring the central role of negative affectivity. , 1989, Psychological review.

[67]  A. Kazdin.  Ethical Principles of Psychologists and Code of Conduct. , 2016 .

[68]  C. Weinstein,et al.  Self-Regulation Interventions with a Focus on Learning Strategies , 2000 .

[69]  Lieven Verschaffel,et al.  Self-regulation of mathematical knowledge and skills , 2011 .

[70]  S. Fisher,et al.  The stress of the transition to university: a longitudinal study of psychological disturbance, absent-mindedness and vulnerability to homesickness. , 1987, British journal of psychology.

[71]  R. Engle.  Working Memory Capacity as Executive Attention , 2002 .

[72]  Jo Morrison,et al.  Use of an aptitude test in University entrance: a validity study , 2010 .

[73]  Deanna C. Martin,et al.  Breaking the Attrition Cycle: The Effects of Supplemental Instruction on Undergraduate Performance and Attrition. , 1983 .

[74]  S. Folkman,et al.  Cognitive Theories of Stress and the Issue of Circularity , 1986 .

[75]  Thomas S. Redick,et al.  Measuring Working Memory Capacity With Automated Complex Span Tasks , 2012 .

[76]  M. Musso,et al.  Validation of a Spanish version of the Remoralization Scale , 2017 .

[77]  Al-Azhar University-Gaza,et al.  PREDICTING LEARNERS PERFORMANCE USING ARTIFICIAL NEURAL NETWORKS IN LINEAR PROGRAMMING INTELLIGENT TUTORING SYSTEM , 2012 .

[78]  D. DuBois,et al.  Individual and environmental predictors of adjustment during the first year of college. , 1995 .

[79]  Carolina Zambrano Matamala,et al.  Análisis de rendimiento académico estudiantil usando data warehouse y redes neuronales Analysis of students' academic performance using data warehouse and neural networks , 2011 .

[80]  M. C. A. Mantuliz,et al.  VALIDACION DE UNA ESCALA DE APOYO SOCIAL PERCIBIDO EN UN GRUPO DE ADULTOS MAYORES ADSCRITOS A UN PROGRAMA DE HIPERTENSION DE LA REGION METROPOLITANA , 2002 .

[81]  Sergio Escorial,et al.  Fluid intelligence, memory span, and temperament difficulties predict academic performance of young adolescents , 2007 .

[82]  Chris S. Hulleman,et al.  Using Design Thinking to Improve Psychological Interventions: The Case of the Growth Mindset During the Transition to High School. , 2016, Journal of educational psychology.