Adding sensor-free intention-based affective support to an Intelligent Tutoring System

Abstract Emotional factors considerably influence learning and academic performance. In this paper, we validate the hypothesis that learning platforms can adjust their response to have an effect on the learner’s pleasure, arousal and/or dominance, without using a specific emotion detection system during operation. To this end, we have enriched an existing Intelligent Tutoring System (ITS) by designing a module that is able to regulate the level of help provided to maximize valence, arousal or autonomy as desired. The design of this module followed a two-stage methodology. In the first stage, the ITS was adapted to collect data from several groups of students in primary education, by providing a random level of help and adding an emotional self-report based on Self Assessment Manikins. Then, the collected data was used to learn a series of classifiers. In operation, self-reporting was removed and the classifiers were used to choose the most convenient help level in order to positively affect the target variables. The effectiveness of the system has been extensively evaluated in a real educational setting, showing that the added module is successful at acting on the chosen target variable in a controlled way.

[1]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[2]  K. Koedinger,et al.  Exploring the Assistance Dilemma in Experiments with Cognitive Tutors , 2007 .

[3]  Zachary A. Pardos,et al.  Affective states and state tests: investigating how affect throughout the school year predicts end of year learning outcomes , 2013, LAK '13.

[4]  Nada Dabbagh,et al.  Scaffolding: An important teacher competency in online learning , 2003 .

[5]  Longzhuang Li,et al.  Recognizing and regulating e-learners' emotions based on interactive Chinese texts in e-learning systems , 2014, Knowl. Based Syst..

[6]  Beno Benhabib,et al.  A Survey of Autonomous Human Affect Detection Methods for Social Robots Engaged in Natural HRI , 2016, J. Intell. Robotic Syst..

[7]  P. Lang.  Behavioral treatment and bio-behavioral assessment: computer applications , 1980 .

[9]  Brandon G. King,et al.  Facial Features for Affective State Detection in Learning Environments , 2007 .

[10]  Dan A. Lewis.  When Help Helps , 2003 .

[11]  Davide Fossati,et al.  Affect detection from non-stationary physiological data using ensemble classifiers , 2014, Evolving Systems.

[12]  A. Mehrabian.  Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament , 1996 .

[13]  Vincent Aleven,et al.  Help Helps, But Only So Much: Research on Help Seeking with Intelligent Tutoring Systems , 2016, International Journal of Artificial Intelligence in Education.

[14]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[15]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Miyoung Kim,et al.  A Review on the Computational Methods for Emotional State Estimation from the Human EEG , 2013, Comput. Math. Methods Medicine.

[17]  James C. Lester,et al.  Modeling Learner Affect with Theoretically Grounded Dynamic Bayesian Networks , 2011, ACII.

[18]  Vincenzo Loia,et al.  A fuzzy-oriented sentic analysis to capture the human emotion in Web-based content , 2014, Knowl. Based Syst..

[19]  David Arnau,et al.  Emulating Human Supervision in an Intelligent Tutoring System for Arithmetical Problem Solving , 2014, IEEE Transactions on Learning Technologies.

[20]  Jonathan P. Rowe,et al.  Sensor-Free or Sensor-Full: A Comparison of Data Modalities in Multi-Channel Affect Detection , 2015, EDM.

[21]  Sergio Escalera,et al.  Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  David Arnau,et al.  Domain-specific knowledge representation and inference engine for an intelligent tutoring system , 2013, Knowl. Based Syst..

[23]  Reinhard Pekrun,et al.  Boredom in achievement settings: Exploring control–value antecedents and performance outcomes of a neglected emotion. , 2010 .

[24]  J. Russell,et al.  Evidence for a three-factor theory of emotions , 1977 .

[25]  Sergio Salmeron-Majadas,et al.  Filtering of Spontaneous and Low Intensity Emotions in Educational Contexts , 2015, AIED.

[26]  Mohammad Soleymani,et al.  Analysis of EEG Signals and Facial Expressions for Continuous Emotion Detection , 2016, IEEE Transactions on Affective Computing.

[27]  Cristina Conati,et al.  Empirically building and evaluating a probabilistic model of user affect , 2009, User Modeling and User-Adapted Interaction.

[28]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[29]  Beno Benhabib,et al.  Affective Voice Recognition of Older Adults , 2016 .

[30]  Costanza Navarretta,et al.  Predicting emotions in facial expressions from the annotations in naturally occurring first encounters , 2014, Knowl. Based Syst..

[31]  Andreas Dengel,et al.  Automatic classifier selection for non-experts , 2012, Pattern Analysis and Applications.

[32]  Ryan Shaun Joazeiro de Baker,et al.  Detecting When Students Game the System, Across Tutor Subjects and Classroom Cohorts , 2005, User Modeling.

[33]  Arthur C. Graesser,et al.  AUTOMATIC DETECTION OF LEARNER'S AFFECT FROM GROSS BODY LANGUAGE , 2009, Appl. Artif. Intell..

[34]  Arthur C. Graesser,et al.  Automatic detection of learner’s affect from conversational cues , 2008, User Modeling and User-Adapted Interaction.

[35]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[36]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[37]  Wouter van Joolingen,et al.  Model-Based Diagnosis for Regulative Support in Inquiry Learning , 2013 .

[38]  Ameet Talwalkar,et al.  Foundations of Machine Learning , 2012, Adaptive computation and machine learning.

[39]  Miguel Arevalillo-Herráez,et al.  Fusing highly dimensional energy and connectivity features to identify affective states from EEG signals , 2017, Neurocomputing.

[40]  Rosalind W. Picard,et al.  An affective model of interplay between emotions and learning: reengineering educational pedagogy-building a learning companion , 2001, Proceedings IEEE International Conference on Advanced Learning Technologies.

[41]  R. Calvo,et al.  New Perspectives on Affect and Learning Technologies , 2011 .

[42]  Vincent Aleven,et al.  Towards Sensor-Free Affect Detection in Cognitive Tutor Algebra. , 2012, EDM 2012.

[43]  Héctor M. Pérez Meana,et al.  Facial expression recognition with automatic segmentation of face regions using a fuzzy based classification approach , 2016, Knowl. Based Syst..

[44]  Kasia Muldner,et al.  The Opportunities and Limitations of Scaling Up Sensor-Free Affect Detection , 2014, EDM.

[45]  David Arnau,et al.  Intensive scaffolding in an intelligent tutoring system for the learning of algebraic word problem solving , 2015, Br. J. Educ. Technol..

[46]  J. Russell,et al.  An approach to environmental psychology , 1974 .

[47]  Arthur C. Graesser,et al.  Multimethod assessment of affective experience and expression during deep learning , 2009, Int. J. Learn. Technol..

[48]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[49]  Mary Ainley,et al.  Connecting with Learning: Motivation, Affect and Cognition in Interest Processes , 2006 .

[50]  Sidney K. D'Mello,et al.  A Review and Meta-Analysis of Multimodal Affect Detection Systems , 2015, ACM Comput. Surv..

[51]  Kristy Elizabeth Boyer,et al.  Analyzing Posture and Affect in Task-Oriented Tutoring , 2012, FLAIRS Conference.