Integrating Learning Styles and Affect with an Intelligent Tutoring System

This paper presents two software systems for visual affect and learning styles recognition. The first system recognizes Paul Ekman's seven basic emotions in student expressions which are surprise, fear, disgust, anger, happiness, sadness, and neutral. The second system recognizes the student learning style using the Felder-Silverman Model. Both systems are integrated into an intelligent tutoring system in a math social network. The automatic recognition was implemented using Kohonen networks which were trained to recognize and classify emotions and learning styles. We show and discuss results by using different methods with respect to affect or emotion recognition and present the automatic response to affect results. We also present the software architecture where both recognizers collaborate with intelligent tutoring systems in a social network.

[1]  Kasia Muldner,et al.  Emotion Sensors Go To School , 2009, AIED.

[2]  Cristina Conati,et al.  Evaluating a Probabilistic Model of Student Affect , 2004, Intelligent Tutoring Systems.

[3]  John R. Anderson,et al.  Cognitive Modeling and Intelligent Tutoring , 1990, Artif. Intell..

[4]  Alex Pentland,et al.  Facial expression recognition using a dynamic model and motion energy , 1995, Proceedings of IEEE International Conference on Computer Vision.

[5]  Arthur C. Graesser,et al.  Toward an Affect-Sensitive AutoTutor , 2007, IEEE Intelligent Systems.

[6]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[7]  Ramón Zataraín-Cabada,et al.  A Framework for Creating, Training, and Testing Self-Organizing Maps for Recognizing Learning Styles , 2010, Edutainment.

[8]  Jean-Claude Falmagne,et al.  Knowledge spaces , 1998 .

[9]  William John Clancey,et al.  Transfer of rule-based expertise through a tutorial dialogue , 1979 .

[10]  R. Felder,et al.  Learning and Teaching Styles in Engineering Education. , 1988 .

[11]  Jaime R. Carbonell,et al.  AI in CAI : An artificial intelligence approach to computer-assisted instruction , 1970 .

[12]  Skyler T. Hawk,et al.  Presentation and validation of the Radboud Faces Database , 2010 .

[13]  Larry S. Davis,et al.  Recognizing Human FACIAL EXPRESSION , 1994 .

[14]  Ryohei Nakatsu,et al.  Life-like communication agent-emotion sensing character "MIC" and feeling session character "MUSE" , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[15]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[16]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[17]  Ramón Zataraín-Cabada,et al.  Fermat: Merging Affective Tutoring Systems with Learning Social Networks , 2012, 2012 IEEE 12th International Conference on Advanced Learning Technologies.

[18]  Heather H. Mitchell,et al.  AutoTutor: A tutor with dialogue in natural language , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[19]  Vincent Aleven,et al.  An effective metacognitive strategy: learning by doing and explaining with a computer-based Cognitive Tutor , 2002, Cogn. Sci..

[20]  Beverley Park Woolf,et al.  Building Intelligent Interactive Tutors , 2008 .