Discretization method to optimize logistic regression on classification of student’s cognitive domain

The accuracy level of the student determination in a class often has been paid less attention in educational data mining. So, this paper studies how to improve the performance of classification method to reach the higher of level accuracy. Therefore, we optimize logistic regression using equal frequency discretization method. Here, we test the student data by three intervals, four intervals, and five intervals. For logistic regression, we implement two regularization types, namely: lasso, ridge. Furthermore, to evaluate the results, we use the random sampling technique. Additionally, we measure the results by four classifier metrics, namely: F1, precision, accuracy, and recall. The experimental result shows that this method can be applied to optimize the logistic regression. On logistic regression_lasso and logistic regression_ridge, the three intervals achieve the highest of accuracy level. They can improve the accuracy level about 9% 9.4%, respectively.

[1]  Qing Zhou,et al.  Classification Algorithms to Predict Students' Extraversion-Introversion Traits , 2016, 2016 International Conference on Cyberworlds (CW).

[2]  Yuni Yamasari,et al.  Features extraction to improve performance of clustering process on student achievement , 2016, 2016 International Computer Science and Engineering Conference (ICSEC).

[3]  Febrianti Widyahastuti,et al.  Predicting students performance in final examination using linear regression and multilayer perceptron , 2017, 2017 10th International Conference on Human System Interactions (HSI).

[4]  Arthur E. Hoerl,et al.  Practical Use of Ridge Regression: A Challenge Met , 1985 .

[5]  Anjana Pradeep,et al.  Students dropout factor prediction using EDM techniques , 2015, 2015 International Conference on Soft-Computing and Networks Security (ICSNS).

[6]  Kevin Casey,et al.  Utilizing student activity patterns to predict performance , 2017, International Journal of Educational Technology in Higher Education.

[7]  Anwar Ali Yahya,et al.  Swarm intelligence-based approach for educational data classification , 2017, J. King Saud Univ. Comput. Inf. Sci..

[8]  Raheela Asif,et al.  Predicting Student Academic Performance at Degree Level: A Case Study , 2014 .

[9]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[10]  Kanokwan Kongsakun.  An improved recommendation model using linear regression and clustering for a private university in Thailand , 2013, 2013 International Conference on Machine Learning and Cybernetics.

[11]  Ioannis Hatzilygeroudis,et al.  An Educational System for Learning Search Algorithms and Automatically Assessing Student Performance , 2017, International Journal of Artificial Intelligence in Education.

[12]  Y. Yamasari,et al.  Predicting student's psychomotor domain on the vocational senior high school using linear regression , 2018, 2018 International Conference on Information and Communications Technology (ICOIACT).

[13]  Norman R. Draper,et al.  Ridge Regression and James-Stein Estimation: Review and Comments , 1979 .

[14]  M. H. Purnomo,et al.  Improving the cluster validity on student's psychomotor domain using feature selection , 2018, 2018 International Conference on Information and Communications Technology (ICOIACT).

[15]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[16]  David A. Freedman,et al.  Statistical Models: Theory and Practice: References , 2005 .

[17]  Laura Calvet Liñán,et al.  Educational Data Mining and Learning Analytics: differences, similarities, and time evolution , 2015 .

[18]  Zaidatun Tasir,et al.  An examination of online learning effectiveness using data mining , 2015 .