On the use of ECG and EMG Signals for Question Difficulty Level Prediction in the Context of Intelligent Tutoring Systems

A fundamental drawback of traditional Intelligent Tutoring Systems (ITS) is that, unlike human tutors, they are not able to understand the emotional state of their users and adapt the learning process accordingly. This work explores the potential use of affective computing techniques for providing an affect detection mechanism for ITS. Electrocardiography (ECG) and electromyography (EMG) signals were recorded from 45 individuals that undertook a computerised English language test and provided feedback on the difficulty of the test's questions. Features extracted from the ECG and EMG signals were then used in order to train machine learning models for the task of predicting the self-perceived difficulty level of the questions. The conducted supervised classification experiments provided promising results for the suitability of this approach for enhancing ITS with information relating to the affective state of the learners, reaching an average classification F1-score of 75.49% for the personalised single-participant models and a classification F1-score of 64.10% for the global models.

[1]  Naeem Ramzan,et al.  Comparison and Efficacy of Synergistic Intelligent Tutoring Systems with Human Physiological Response , 2019, Sensors.

[2]  Olusola O. Adesope,et al.  Intelligent tutoring systems and learning outcomes: A meta-analysis , 2014 .

[3]  Miguel Arevalillo-Herráez,et al.  Fusing highly dimensional energy and connectivity features to identify affective states from EEG signals , 2017, Neurocomputing.

[4]  Daune West,et al.  Examining Human-Horse Interaction by Means of Affect Recognition via Physiological Signals , 2019, IEEE Access.

[5]  Panagiotis Germanakos,et al.  An Experimental Assessment of the Use of Cognitive and Affective Factors in Adaptive Educational Hypermedia , 2009, IEEE Transactions on Learning Technologies.

[6]  Xia Mao,et al.  Agent based affective tutoring systems: A pilot study , 2010, Comput. Educ..

[7]  J. Russell A circumplex model of affect. , 1980 .

[8]  Alla Anohina-Naumeca,et al.  Emotion Recognition in Affective Tutoring Systems , 2017 .

[9]  Subramanian Ramanathan,et al.  DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses , 2015, IEEE Transactions on Affective Computing.

[10]  Harri Ketamo,et al.  Evaluating Cognitive and Affective Outcomes of a Digital Game-Based Math Test , 2018, IEEE Transactions on Learning Technologies.

[11]  Adrian Burns,et al.  SHIMMER™ – A Wireless Sensor Platform for Noninvasive Biomedical Research , 2010, IEEE Sensors Journal.

[12]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[13]  Ramón Zataraín-Cabada,et al.  Affective Tutoring System for Android Mobiles , 2014, ICIC.

[14]  Gautam Biswas,et al.  Affect Sequences and Learning in Betty's Brain , 2019, LAK.

[15]  吉島 茂,et al.  文化と言語の多様性の中のCommon European Framework of Reference for Languages: Learning, teaching, assessment (CEFR)--それは基準か? (第10回明海大学大学院応用言語学研究科セミナー 講演) , 2008 .

[16]  Mahmoud Neji,et al.  The Affective Tutoring System , 2010, Expert Syst. Appl..

[17]  Sidney K. D'Mello,et al.  The Affective Experience of Novice Computer Programmers , 2015, International Journal of Artificial Intelligence in Education.

[18]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[19]  Rosalind W. Picard Affective Computing: From Laughter to IEEE , 2010 .

[20]  Naeem Ramzan,et al.  DREAMER: A Database for Emotion Recognition Through EEG and ECG Signals From Wireless Low-cost Off-the-Shelf Devices , 2018, IEEE Journal of Biomedical and Health Informatics.

[21]  Mohammad Soleymani,et al.  A Multimodal Database for Affect Recognition and Implicit Tagging , 2012, IEEE Transactions on Affective Computing.

[22]  Anastasios A. Economides,et al.  Mood Recognition during Online Self-Assessment Tests , 2009, IEEE Transactions on Learning Technologies.

[23]  Jasjit S. Suri,et al.  Analysis of Electrocardiograms , 2007 .

[24]  Ramón Zataraín-Cabada,et al.  An Intelligent and Affective Tutoring System within a Social Network for Learning Mathematics , 2012, IBERAMIA.

[25]  Benjamin Nye,et al.  Intelligent Tutoring Systems by and for the Developing World: A Review of Trends and Approaches for Educational Technology in a Global Context , 2014, International Journal of Artificial Intelligence in Education.