Sistema de reconocimiento multimodal de emociones relacionadas al aprendizaje en dispositivos móviles

Many emotion recognizer systems have been developed, but only a few of them have been used in the real world. This may occur due to several reasons like: the high cost of required technology and the low rate of accuracy of recognition, when not working with spontaneous emotions. This paper presents the implementation of a multimodal emotion recognition system using mobile devices and the creation of an affective database populated by data collected from a mobile application. The recognizer can be easily integrated into a mobile educational application to identify user’s emotions as they interact with the device. The recognized emotions are engagement and boredom. The affective database was created with spontaneous emotions of students who used a mobile educational application called Duolingo and a data gathering mobile application called EmoData. The developed system has an acceptable accuracy rate and by 135 Research in Computing Science 111 (2016) pp. 135–147; rec. 2016-03-18; acc. 2016-05-15 increasing the amount of records of the affective database, it is expected this rate will be better.

[1]  Arthur C. Graesser,et al.  Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments , 2010, Int. J. Hum. Comput. Stud..

[2]  Y. Kawahara,et al.  Recognizing User Context Using Mobile Handsets with Acceleration Sensors , 2007, 2007 IEEE International Conference on Portable Information Devices.

[3]  S. D’Mello.  A selective meta-analysis on the relative incidence of discrete affective states during learning with technology , 2013 .

[4]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[5]  Yunxin Liu,et al.  MoodScope: building a mood sensor from smartphone usage patterns , 2013, MobiSys.

[6]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[7]  Ryan Shaun Joazeiro de Baker,et al.  The Dynamics of Affective Transitions in Simulation Problem-Solving Environments , 2007, ACII.

[8]  Hasan Mahmud,et al.  Recognition of human affection in Smartphone perspective based on accelerometer and user's sitting position , 2014, 2014 17th International Conference on Computer and Information Technology (ICCIT).

[9]  Diogo R. Ferreira,et al.  Preprocessing techniques for context recognition from accelerometer data , 2010, Personal and Ubiquitous Computing.

[10]  Wan-Young Chung,et al.  Classification of Posture and Movement Using a 3-axis Accelerometer , 2007, 2007 International Conference on Convergence Information Technology (ICCIT 2007).

[11]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[12]  Sidney D'Mello,et al.  The half-life of cognitive-affective states during complex learning , 2011, Cognition & emotion.

[13]  David Sun,et al.  Sensor-less sensing for affective computing and stress management technology , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[14]  Gang Zhou,et al.  Accurate, Fast Fall Detection Using Gyroscopes and Accelerometer-Derived Posture Information , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.

[15]  Skyler T. Hawk,et al.  Presentation and validation of the Radboud Faces Database , 2010 .

[16]  Jesús Alcalá-Fdez,et al.  jFuzzyLogic: a robust and flexible Fuzzy-Logic inference system language implementation , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[17]  Yuan Gao,et al.  What Does Touch Tell Us about Emotions in Touchscreen-Based Gameplay? , 2012, TCHI.

[18]  Don-Lin Yang,et al.  A mobile emotion recognition system based on speech signals and facial images , 2013, 2013 International Computer Science and Engineering Conference (ICSEC).

[19]  Cecilia Mascolo,et al.  EmotionSense: a mobile phones based adaptive platform for experimental social psychology research , 2010, UbiComp.