Classification of Learning Styles in Multimedia Learning Using Eye-Tracking and Machine Learning

The existence of a multimedia learning system still presents the same material for every student. Educational theory suggests that learning content ideally should be adaptive by considering each student’s learning style. To make learning more optimal, it is necessary to detect learning styles. Several learning detection approaches have been implemented. Conventional methods such as student assessment tests and interviews tend to be more subjective. An objective method of eye-tracking has been researched but limited as a validation tool for differentiating learning styles. To overcome the above mentioned problems, this study proposes a new approach using machine learning and eye-tracking techniques. The experiment and analysis involved 68 students. There were 23 male participants and 45 female participants. In the experiment, participants were assigned to interact with learning content and their eye movements were recorded using an eye-tracker sensor. From the experimental results using three classification algorithms — SVM, Naïve Bayes, and Logistic Regression — and using SVM-RFE as a feature selection method, the best model was achieved by Naïve Bayes algorithm through three features selected from SVM-RFE method. The model yielded 71% of accuracy, 60% of sensitivity, and 75% of specificity. This empirical study provides an opportunity for machine learning and eye-tracking approaches to automatically classify learning styles. These results can be used as guidelines for developing an adaptive multimedia learning system by considering students’ learning styles.

[1]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[2]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[3]  Analía Amandi,et al.  Automatic detection of learning styles: state of the art , 2014, Artificial Intelligence Review.

[4]  Dunja Mladenic,et al.  Feature Selection for Dimensionality Reduction , 2005, SLSFS.

[5]  Aga Bojko,et al.  Eye Tracking the User Experience: A Practical Guide to Research , 2013 .

[6]  Sabine Graf,et al.  AUTOMATIC STUDENT MODELLING FOR DETECTING LEARNING STYLE PREFERENCES IN LEARNING MANAGEMENT SYSTEMS * , 2007 .

[7]  Terence P. Speed,et al.  A comparison of normalization methods for high density oligonucleotide array data based on variance and bias , 2003, Bioinform..

[8]  Aixia Guo,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2014 .

[9]  R. Felder,et al.  Understanding Student Differences , 2005 .

[10]  Eugene Agichtein,et al.  Detecting cognitive impairment by eye movement analysis using automatic classification algorithms , 2011, Journal of Neuroscience Methods.

[11]  Ian Pitt,et al.  Using Biometrics to Support Affective eLearning for Users with Special Needs , 2016, ICCHP.

[12]  Yunqian Ma,et al.  Imbalanced Learning: Foundations, Algorithms, and Applications , 2013 .

[13]  Ian J. Pitt,et al.  Detecting Learning Style through Biometric Technology for Mobile GBL , 2012, Int. J. Game Based Learn..

[14]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[15]  Andreas Müller,et al.  Introduction to Machine Learning with Python: A Guide for Data Scientists , 2016 .

[16]  T. Pansell,et al.  Screening for Dyslexia Using Eye Tracking during Reading , 2016, PloS one.

[17]  R. Mayer,et al.  Maximizing Constructivist Learning From Multimedia Communications by Minimizing Cognitive Load , 1999 .

[18]  Arthur M. Jacobs,et al.  OGAMA (Open Gaze and Mouse Analyzer): Open-source software designed to analyze eye and mouse movements in slideshow study designs , 2008, Behavior research methods.

[19]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[20]  Hafizoah Kassim The Relationship between Learning Styles, Creative Thinking Performance and Multimedia Learning Materials , 2013 .

[21]  K. S. Lasith Gunawardena,et al.  Using Learning Styles to Enhance Learning Management Systems , 2014 .

[22]  Xingshan Li,et al.  Using support vector machines to identify literacy skills: Evidence from eye movements , 2017, Behavior research methods.

[23]  Paulus Insap Santosa,et al.  Examining the effect of website complexity and task complexity in web-based learning management system , 2017, 2017 1st International Conference on Informatics and Computational Sciences (ICICoS).

[24]  Paulus Insap Santosa,et al.  Model detecting learning styles with artificial neural network , 2019, Journal of Technology and Science Education.

[25]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[26]  R. Felder,et al.  Learning and Teaching Styles in Engineering Education. , 1988 .

[27]  E. Abt Understanding statistics 3 , 2010, Evidence-Based Dentistry.

[28]  Tibor Ujbanyi,et al.  Eye-tracking analysis of computer networks exam question besides different skilled groups , 2016, 2016 7th IEEE International Conference on Cognitive Infocommunications (CogInfoCom).

[29]  Trevor Kvaran,et al.  The effect of analytic and experiential modes of thought on moral judgment. , 2013, Progress in brain research.

[30]  Nitesh V. Chawla,et al.  3 IMBALANCED DATASETS: FROM SAMPLING TO CLASSIFIERS , 2013 .

[31]  Changqin Huang,et al.  A semantic web-based personalized learning service supported by on-line course resources , 2010, INC2010: 6th International Conference on Networked Computing.

[32]  Xin Yao,et al.  MWMOTE--Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning , 2014 .

[33]  R. Felder,et al.  Applications, Reliability and Validity of the Index of Learning Styles* , 2005 .

[34]  L. Råde,et al.  Mathematics handbook for science and engineering , 1995 .

[35]  Yunqian Ma,et al.  Imbalanced Datasets: From Sampling to Classifiers , 2013 .

[36]  Stephen Rayner,et al.  Style differences in cognition, learning, and management : theory, research, and practice , 2012 .

[37]  John D. Kelleher,et al.  Fundamentals of Machine Learning for Predictive Data Analytics: Algorithms, Worked Examples, and Case Studies , 2015 .

[38]  K M Søndergaard,et al.  [Understanding statistics?]. , 1995, Ugeskrift for laeger.

[39]  Mona Masood,et al.  Analysing the relationship of sequential and global learning styles on students’ historical thinking and understanding : a case study on form four secondary schools students in Malaysia , 2016 .

[40]  Allan Paivio,et al.  Imagery and synchronic thinking. , 1975 .

[41]  K. R. Kavitha,et al.  A correlation based SVM-recursive multiple feature elimination classifier for breast cancer disease using microarray , 2016, 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[42]  M S Hasibuan,et al.  Detecting learning style using hybrid model , 2016, 2016 IEEE Conference on e-Learning, e-Management and e-Services (IC3e).