Dyslexia Adaptive Learning Model: Student Engagement Prediction Using Machine Learning Approach

Education barriers are synonym with people with dyslexia life experience. People with dyslexia encounter barriers such as in academic related areas, mistreated with negative reaction on their behaviour and limitation to acquire a suitable support to overcome the barriers. Therefore, this work focus on giving the support to help students with dyslexia deal with their difficulty through adaptively sense their behaviour for engagement perspective. For that reason, we apply machine learning approach that utilises Bag of Features (BOF) image classification to predict student engagement towards the learning content. The engagement prediction was relatively using frontal face of the 30 students. We used Speeded-Up Robust Feature (SURF) key point descriptor and clustered using k-Means method for the codebook in this BOF model. Then, we classify the model using 3 types of classifier which are Support Vector Machine (SVM), Naive Bayes and K-Nearest Neighbour (k-NN) to find the best classification result. Through these methods, we managed to get high accuracy with 97–97.8%.

[1]  Chougrad Hiba,et al.  Bag of Features Model Using the New Approaches: A Comprehensive Study , 2016 .

[2]  B. Shaywitz,et al.  Dyslexia (Specific Reading Disability) , 2005, Biological Psychiatry.

[3]  Muhamad Taufik Abdullah,et al.  Evaluating Classification Strategies in Bag of SIFT Feature Method for Animal Recognition , 2015 .

[4]  Lin Wu,et al.  Bag of Visual Words Model with Deep Spatial Features for Geographical Scene Classification , 2017, Comput. Intell. Neurosci..

[5]  Facundo Bromberg,et al.  Image classification for detection of winter grapevine buds in natural conditions using scale-invariant features transform, bag of features and support vector machines , 2017, Comput. Electron. Agric..

[6]  Jack M. Fletcher,et al.  Developmental Lag versus Deficit Models of Reading Disability: A Longitudinal, Individual Growth Curves Analysis. , 1996 .

[7]  Yao-Ming Yeh,et al.  Adaptive Reading: A Design of Reading Browser with Dynamic Alternative Text Multimedia Dictionaries for the Text Reading Difficulty Readers , 2010, ICCHP.

[8]  Maria Rauschenberger,et al.  DysMusic: detecting dyslexia by web-based games with music elements: doctoral consortium , 2016, W4A.

[9]  Javier R. Movellan,et al.  The Faces of Engagement: Automatic Recognition of Student Engagementfrom Facial Expressions , 2014, IEEE Transactions on Affective Computing.

[10]  Ling Tan,et al.  Can Engagement be Compared? Measuring Academic Engagement for Comparison , 2014, EDM.

[11]  Juan Yang,et al.  A novel method for image classification based on bag of visual words , 2016, J. Vis. Commun. Image Represent..

[12]  Adel Said Elmaghraby,et al.  Intelligent serious games system for children with learning disabilities , 2012, 2012 17th International Conference on Computer Games (CGAMES).

[13]  Prabhas Chongstitvatana,et al.  Predicting types of clothing using SURF and LDP based on Bag of Features , 2015, 2015 12th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON).

[14]  Simone Gori,et al.  “Shall We Play a Game?”: Improving Reading Through Action Video Games in Developmental Dyslexia , 2015, Current Developmental Disorders Reports.

[15]  Supreeth M. Gowda,et al.  Affective States and State Tests: Investigating How Affect and Engagement during the School Year Predict End-of-Year Learning Outcomes , 2014, J. Learn. Anal..

[16]  David Benyon,et al.  Applying user modeling to human-computer interaction design , 1993, Artificial Intelligence Review.

[17]  Yongjie Chu,et al.  Effective face recognition using bag of features with additive kernels , 2016, J. Electronic Imaging.

[18]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  Chih-Jen Lin,et al.  Linear and Kernel Classification: When to Use Which? , 2016, SDM.

[20]  Aiza Johari,et al.  Improvising Reading Classes and Classroom Environment for Children with Reading Difficulties and Dyslexia Symptoms , 2012 .

[21]  Anastasios Karakostas,et al.  Adaptive and Intelligent Systems for Collaborative Learning Support: A Review of the Field , 2011, IEEE Transactions on Learning Technologies.

[22]  Isaac Olusegun Osunmakinde,et al.  An intelligent integrative assistive system for dyslexic learners , 2013 .

[23]  Novia Admodisastro,et al.  Computer-based learning model to improve learning of the malay language amongst dyslexic primary school students , 2015 .

[24]  Chan Oga,et al.  Life Experiences of Individuals Living with Dyslexia in Malaysia: A Phenomenological Study , 2012 .

[25]  P M Panchal,et al.  A Comparison of SIFT and SURF , 2013 .

[26]  Lixia Zhang,et al.  A new algorithm for image recognition and classification based on improved Bag of Features algorithm , 2016 .

[27]  Luo Si,et al.  Automatic Detection of Off-Task Behaviors in Intelligent Tutoring Systems with Machine Learning Techniques , 2010, IEEE Transactions on Learning Technologies.

[28]  Alberto Quattrini Li,et al.  PoliSpell: An Adaptive Spellchecker and Predictor for People with Dyslexia , 2013, UMAP.

[29]  Lambert Schomaker,et al.  Robust Face Identification with Small Sample Sizes using Bag of Words and Histogram of Oriented Gradients , 2016, VISIGRAPP.

[30]  Nanik Suciati,et al.  Batik Image Classification Using SIFT Feature Extraction, Bag of Features and Support Vector Machine , 2015 .

[31]  Abozar Nasirahmadi,et al.  Bag-of-Feature model for sweet and bitter almond classification , 2017 .

[32]  Marios Anthimopoulos,et al.  A Food Recognition System for Diabetic Patients Based on an Optimized Bag-of-Features Model , 2014, IEEE Journal of Biomedical and Health Informatics.

[33]  Zachary A. Pardos,et al.  Affective states and state tests: investigating how affect throughout the school year predicts end of year learning outcomes , 2013, LAK '13.

[34]  Bozidar Kovacic,et al.  Intelligent tutoring systems for language learning , 2015, 2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[35]  Jeffrey P. Bigham,et al.  A Spellchecker for Dyslexia , 2015, ASSETS.

[36]  Mohammad Hafiz Ismail,et al.  Bijak Membaca — Applying Phonic Reading Technique and Multisensory Approach with interactive multimedia for dyslexia children , 2012, 2012 IEEE Colloquium on Humanities, Science and Engineering (CHUSER).

[37]  Muhamad Risqi Utama Saputra,et al.  LexiPal: Design, Implementation and Evaluation of Gamification on Learning Application for Dyslexia , 2015 .