Engagement vs performance: using electronic portfolios to predict first semester engineering student retention

As providers of higher education begin to harness the power of big data analytics, one very fitting application for these new techniques is that of predicting student attrition. The ability to pinpoint students who might soon decide to drop out of a given academic program allows those in charge to not only understand the causes for this undesired outcome, but it also provides room for the development of early intervention systems. While making such inferences based on academic performance data alone is certainly possible, we claim that in many cases there is no substantial correlation between how well a student performs and his or her decision to withdraw. This is specially true when the overall set of students has a relatively similar academic performance. To address this issue, we derive measurements of engagement from students' electronic portfolios and show how these features can be effectively used to augment the quality of predictions.

[1]  Hariharan Swaminathan,et al.  Development of a Classification System for Engineering Student Characteristics Affecting College Enrollment and Retention , 2009 .

[2]  T. Bayes.  An essay towards solving a problem in the doctrine of chances , 2003 .

[3]  Alan Levine,et al.  The 2010 Horizon Report. , 2010 .

[4]  Phayung Meesad,et al.  A critical assessment of imbalanced class distribution problem: The case of predicting freshmen student attrition , 2014, Expert Syst. Appl..

[5]  Cindy P. Veenstra,et al.  A Model for Freshman engineering r etention , 2009 .

[6]  George D. Kuh,et al.  "They shall be known by what they do": An activities-based typology of college students , 2000 .

[7]  Jean MacGregor,et al.  Where are Learning Communities? Now: National Leaders Take Stock , 2005 .

[8]  Allan Gutjahr,et al.  Predicting Student Retention and Academic Success at New Mexico Tech , 2000 .

[9]  Matthew W. Ohland,et al.  Identifying Factors Influencing Engineering Student Graduation: A Longitudinal and Cross‐Institutional Study , 2004 .

[10]  J. J. Lin,et al.  Student Retention Modelling : An Evaluation of Different Methods and their Impact on Prediction Results , 2009 .

[11]  Milton D. Hakel,et al.  The Relationship Between Electronic Portfolio Participation and Student Success. Professional File Number 107, Spring 2008. , 2008 .

[12]  Jared Judd Anthony.  REFLECTION AND ELECTRONIC PORTFOLIOS , 2008 .

[13]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[14]  Panayiotis E. Pintelas,et al.  A survey on student dropout rates and dropout causes concerning the students in the Course of Informatics of the Hellenic Open University , 2002, Comput. Educ..

[15]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[16]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[17]  Charles C. Schroeder,et al.  Realizing the Educational Potential of Residence Halls , 1994 .

[18]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[19]  David A. Cieslak,et al.  Hellinger distance decision trees are robust and skew-insensitive , 2011, Data Mining and Knowledge Discovery.

[20]  Jose Luis Rodriguez-Illera,et al.  Investigating university students' adaptation to a digital learner course portfolio , 2009, Comput. Educ..

[21]  A. Astin,et al.  Undergraduate science education: the impact of different college environments on the educational pip , 1992 .

[22]  Tim Menzies,et al.  Learning patterns of university student retention , 2011, Expert Syst. Appl..

[23]  Eitel J. M. Lauría,et al.  Mining academic data to improve college student retention: an open source perspective , 2012, LAK.

[24]  Mykola Pechenizkiy,et al.  Predicting Students Drop Out: A Case Study , 2009, EDM.

[25]  Surjeet Kumar Yadav,et al.  Data Mining Applications: A comparative Study for Predicting Student's performance , 2012, ArXiv.

[26]  Milton D. Hakel,et al.  The Relationship between Electronic Portfolio Participation and Student Success , 2006 .

[27]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[28]  James Jones,et al.  Electronic Portfolios: Engaged Students Create Multimedia-Rich Artifacts , 2009 .

[29]  Tony Clark,et al.  Using data mining to improve student retention in HE: a case study. , 2010 .

[30]  Serge Herzog,et al.  Estimating Student Retention and Degree-Completion Time: Decision Trees and Neural Networks Vis-a-Vis Regression. , 2006 .

[31]  Dursun Delen,et al.  A comparative analysis of machine learning techniques for student retention management , 2010, Decis. Support Syst..

[32]  Helen C. Barrett.  Researching Electronic Portfolios and Learner Engagement: The REFLECT Initiative , 2007 .

[33]  Guillermo Mendez,et al.  Factors Associated With Persistence in Science and Engineering Majors: An Exploratory Study Using Classification Trees and Random Forests , 2008 .

[34]  金田 重郎,et al.  C4.5: Programs for Machine Learning (書評) , 1995 .

[35]  Lamont A. Flowers.  Effects of Living on Campus on African American Students' Educational Gains in College , 2004 .

[36]  Samuel DiGangi,et al.  A Data-Mining Approach to Differentiate Predictors of Retention. , 2007 .

[37]  G. Alex Ambrose,et al.  The Blended Advising Model: Transforming Advising with ePortfolios. , 2013 .

[38]  M. Deberard,et al.  Predictors of Academic Achievement and Retention among College Freshmen: A Longitudinal Study. , 2004 .

[39]  Margaret Price.  Purpose, Audience, and Engagement in Spelman College's eFolio Project , 2006 .

[40]  G. Alex Ambrose,et al.  Linking Advising and E-Portfolios for Engagement: Design, Evolution, Assessment, and University-Wide Implementation , 2014 .

[41]  DelenDursun.  A comparative analysis of machine learning techniques for student retention management , 2010, DSS 2010.

[42]  J. Burtner.  The Use of Discriminant Analysis to Investigate the Influence of Non‐Cognitive Factors on Engineering School Persistence , 2005 .

[43]  Helen L. Chen,et al.  Using E-Portfolios to Support an Undergraduate Learning Career: An Experiment with Academic Advising , 2010 .

[44]  L. R. Foulke.  ABET (Accreditation Board for Engineering and Technology) accreditation for engineering technology , 1989 .

[45]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[46]  S. F.R.,et al.  An Essay towards solving a Problem in the Doctrine of Chances . By the late Rev . Mr . Bayes , communicated by Mr . Price , in a letter to , 1999 .

[47]  Kathleen Pittman,et al.  Comparison of data mining techniques used to predict student retention , 2008 .

[48]  Ernest T. Pascarella.  How College Affects Students: Ten Directions for Future Research , 2006 .

[49]  S. Schwartz,et al.  Leaving College: Rethinking the Causes and Cures of Student Attrition , 1987 .

[50]  Ruba Alkhasawneh,et al.  Developing a Hybrid Model to Predict Student First Year Retention and Academic Success in STEM Disciplines Using Neural Networks , 2011 .

[51]  Nitesh V. Chawla,et al.  Integration of ePortfolios in a First-Year Engineering Course for Measuring Student Engagement , 2014, 2014 ASEE Annual Conference & Exposition Proceedings.

[52]  Shieu-Hong Lin.  Data mining for student retention management , 2012 .

[53]  Dursun Delen,et al.  Predicting Student Attrition with Data Mining Methods , 2011 .

[54]  D. Fike,et al.  Predictors of First-Year Student Retention in the Community College , 2008 .