Modern Artificial Intelligence Model Development for Undergraduate Student Performance Prediction: An Investigation on Engineering Mathematics Courses

A computationally efficient artificial intelligence (AI) model called Extreme Learning Machines (ELM) is adopted to analyze patterns embedded in continuous assessment to model the weighted score (WS) and the examination (EX) score in engineering mathematics courses at an Australian regional university. The student performance data taken over a six-year period in multiple courses ranging from the mid- to the advanced level and a diverse course offering mode (i.e., on-campus, ONC, and online, ONL) are modelled by ELM and further benchmarked against competing models: random forest (RF) and Volterra. With the assessments and examination marks as key predictors of WS (leading to a grade in the mid-level course), ELM (with respect to RF and Volterra) outperformed its counterpart models both for the ONC and the ONL offer. This generated relative prediction error in the testing phase, of only 0.74%, compared to about 3.12% and 1.06%, respectively, while for the ONL offer, the prediction errors were only 0.51% compared to about 3.05% and 0.70%. In modelling the student performance in advanced engineering mathematics course, ELM registered slightly larger errors: 0.77% (vs. 22.23% and 1.87%) for ONC and 0.54% (vs. 4.08% and 1.31%) for the ONL offer. This study advocates a pioneer implementation of a robust AI methodology to uncover relationships among student learning variables, developing teaching and learning intervention and course health checks to address issues related to graduate outcomes, and student learning attributes in the higher education sector.

[1]  Assem Shayakhmetova,et al.  The Information System of Distance Learning for People with Impaired Vision on the Basis of Artificial Intelligence Approaches , 2015 .

[2]  Vidushi Sharma,et al.  Smart Education with artificial intelligence based determination of learning styles , 2018 .

[3]  Du Q. Huynh,et al.  A supervised learning framework for learning management systems , 2018, DATA.

[4]  G. B. Moore,et al.  The Use of Advanced Technologies in Special Education , 1987 .

[5]  Mark R. Segal,et al.  Machine Learning Benchmarks and Random Forest Regression , 2004 .

[6]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[7]  Bandit Suksawat,et al.  Propose of fuzzy logic-based students' learning assessment , 2010, ICCAS 2010.

[8]  Wahidah Husain,et al.  A Review on Predicting Student's Performance Using Data Mining Techniques , 2015 .

[9]  Yan Li,et al.  Ensemble committee-based data intelligent approach for generating soil moisture forecasts with multivariate hydro-meteorological predictors , 2018, Soil and Tillage Research.

[10]  Marcia Devlin,et al.  Facilitating success for students from low socioeconomic status backgrounds at regional universities , 2017 .

[11]  Marcia Devlin,et al.  Widening participation in Australia: lessons on equity, standards, and institutional leadership , 2016 .

[12]  John P. Campbell,et al.  Academic Analytics: A New Tool for a New Era. , 2007 .

[13]  Dalit Contini,et al.  The Gender Gap in Mathematics Achievement: Evidence from Italian Data , 2016, SSRN Electronic Journal.

[14]  Shaobo Huang,et al.  Predicting student academic performance in an engineering dynamics course: A comparison of four types of predictive mathematical models , 2013, Comput. Educ..

[15]  Mahmoud Abu Ghosh,et al.  Predicting Student Performance Using Artificial Neural Network: in the Faculty of Engineering and Information Technology , 2015 .

[16]  Mohamad Mohd Saberi,et al.  A Review on Predictive Modeling Technique for Student Academic Performance Monitoring , 2019 .

[17]  O. C. Asogwa,et al.  Of Students Academic Performance Rates Using Artificial Neural Networks (ANNs) , 2015 .

[18]  Peter H. Farquhar,et al.  Applications of Utility Theory in Artificial Intelligence Research , 1987 .

[19]  Irma Becerra-Fernandez.  The role of artificial intelligence technologies in the implementation of People-Finder knowledge management systems , 2000, Knowl. Based Syst..

[20]  Rui Guo,et al.  Participation-based student final performance prediction model through interpretable Genetic Programming: Integrating learning analytics, educational data mining and theory , 2015, Comput. Hum. Behav..

[21]  Elyjoy Micheni,et al.  Big Data Analytics in Higher Education: A Review , 2017 .

[22]  T. Chai,et al.  Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature , 2014 .

[23]  Michael J. Lawson,et al.  EXPLORING COLLABORATIVE ONLINE LEARNING , 2019, Online Learning.

[24]  Jia Xu,et al.  Extreme learning machines: new trends and applications , 2014, Science China Information Sciences.

[25]  Marcia Devlin,et al.  Reframing ‘the problem’: students from low socio-economic status backgrounds transitioning to university , 2014 .

[26]  Kuo-An Hwang,et al.  Attentiveness assessment in learning based on fuzzy logic analysis , 2009, Expert Syst. Appl..

[27]  Tahir Cetin Akinci,et al.  Evaluation of student performance in laboratory applications using fuzzy logic , 2010 .

[28]  Sheng Chen,et al.  Identification of non-linear output-affine systems using an orthogonal least-squares algorithm , 1988 .

[29]  Srinivasan Ragothaman,et al.  Using Neural Networks to Predict MBA Student Success. , 2004 .

[30]  Christopher O'Neal,et al.  8: Action Research for Instructional Improvement: Using Data to Enhance Student Learning at Your Institution , 2007 .

[31]  Sean P. Goggins,et al.  Learning analytics in outer space: a Hidden Naïve Bayes model for automatic student off-task behavior detection , 2015, LAK.

[32]  Mohamed Medhat Gaber,et al.  Random forests: from early developments to recent advancements , 2014 .

[33]  Zhang Jia-shu,et al.  Neural Volterra filter for chaotic time series prediction , 2005 .

[34]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[35]  Kenneth David Strang.  Can online student performance be forecasted by learning analytics , 2016 .

[36]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[37]  Jean-Michel Poggi,et al.  Random Forests for Big Data , 2015, Big Data Res..

[38]  Danilo Comminiello,et al.  Online Sequential Extreme Learning Machine With Kernels , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[39]  R. Stevens,et al.  Artificial neural network-based performance assessments , 1999 .

[40]  Steve A. Billings,et al.  A unified wavelet-based modelling framework for non-linear system identification: the WANARX model structure , 2004 .

[41]  Markku Niemivirta,et al.  Consistency, longitudinal stability, and predictions of elementary school students' task interest, success expectancy, and performance in mathematics , 2018, Learning and Instruction.

[42]  Z. Allam,et al.  On big data, artificial intelligence and smart cities , 2019, Cities.

[43]  Min Han,et al.  Online sequential extreme learning machine with kernels for nonstationary time series prediction , 2014, Neurocomputing.

[44]  Wilpen L. Gorr,et al.  Comparative study of artificial neural network and statistical models for predicting student grade point averages , 1994 .

[45]  Shawn W. Ulrick,et al.  Explaining university course grade gaps , 2017 .

[46]  Alain Abran,et al.  Prediction of Online Students Performance by Means of Genetic Programming , 2018, Appl. Artif. Intell..

[47]  Rafael Molina-Carmona,et al.  Improving the expressiveness of black-box models for predicting student performance , 2017, Comput. Hum. Behav..

[48]  Guang-Bin Huang,et al.  An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels , 2014, Cognitive Computation.

[49]  Selma Vonderwell,et al.  Factors that Influence Participation In Online Learning , 2005 .

[50]  Stuart R. Palmer,et al.  Examining student satisfaction with wholly online learning , 2009, J. Comput. Assist. Learn..

[51]  George Siemens,et al.  Penetrating the fog: analytics in learning and education , 2014 .

[52]  John O’Donoghue,et al.  Mathematical under-preparedness: the influence of the pre-tertiary mathematics experience on students’ ability to make a successful transition to tertiary level mathematics courses in Ireland , 2007 .

[53]  Drainage Division,et al.  Criteria for Evaluation of Watershed Models , 1993 .

[54]  Koushal Kumar,et al.  Advanced Applications of Neural Networks and Artificial Intelligence: A Review , 2012 .

[55]  Holger R. Maier,et al.  DATA DIVISION FOR DEVELOPING NEURAL NETWORKS APPLIED TO GEOTECHNICAL ENGINEERING , 2004 .

[56]  Cosmin Popa,et al.  Adoption of Artificial Intelligence in Agriculture , 2011, Bulletin of University of Agricultural Sciences and Veterinary Medicine Cluj-Napoca. Agriculture.

[57]  Max Tegmark,et al.  The role of artificial intelligence in achieving the Sustainable Development Goals , 2019, Nature Communications.

[58]  Karen J. Nelson,et al.  A good practice guide : Safeguarding student learning engagement , 2013 .

[59]  Guang-Bin Huang,et al.  What are Extreme Learning Machines? Filling the Gap Between Frank Rosenblatt’s Dream and John von Neumann’s Puzzle , 2015, Cognitive Computation.

[60]  I. Ryabov,et al.  The Effect of Time Online on Grades in Online Sociology Courses , 2012 .

[61]  Vijendra Pratap Singh,et al.  Modeling Academic Performance Evaluation Using Soft Computing Techniques: A Fuzzy Logic Approach , 2011 .

[62]  Elana Joram,et al.  Elementary mathematics teachers’ judgment accuracy and calibration accuracy: Do they predict students’ mathematics achievement outcomes? , 2016 .