Emotion Detection Using Unobtrusive methods: An Integrated Approach

Proven research is available to identify the importance of emotions in every walk of life. Emotions play an important role in a human's life in the sense that they effect how a user makes decisions, buys commodities, the way he lives in, the way he learns and many more. Emotion has been used as an attribute in many computational systems that provide services to mankind. Many affective systems have come into picture when the concept of personalized recommendations was realized. Affective systems are the systems that deal with the emotional nature of a user. The major question with these systems is the detection of emotion. The methods and the user characteristics that can be used to detection of emotion of the user. This paper proposes a unique methodology to detect emotions using the unobtrusive method of keystrokes, mouse clicks, forum discussions and results of assessments if any in an E-learning scenario.

[1]  Fwa Hua Leong.  Fine-Grained Detection of Programming Students’ Frustration Using Keystrokes, Mouse Clicks and Interaction Logs , 2016 .

[2]  Hartmut Neven,et al.  Online facial expression recognition based on personalized galleries , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[3]  Christine Ingleton,et al.  Emotion in learning: a neglected dynamic , 2000 .

[4]  R. Pekrun.  The impact of emotions on learning and achievement : towards a theory of cognitive/motivational mediators , 1992 .

[5]  Cecilia Ovesdotter Alm,et al.  Emotions from Text: Machine Learning for Text-based Emotion Prediction , 2005, HLT.

[6]  Sergio Salmeron-Majadas,et al.  Towards Emotion Detection in Educational Scenarios from Facial Expressions and Body Movements through Multimodal Approaches , 2014, TheScientificWorldJournal.

[7]  Daniel McDuff,et al.  Crowdsourcing Facial Responses to Online Videos , 2012, IEEE Transactions on Affective Computing.

[8]  Amlan Chakrabarti,et al.  Biophysical signal based emotion detection for technology enabled affective learning , 2015, 2015 IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT).

[9]  Akputu K. Oryina,et al.  Emotion Recognition for User Centred E-Learning , 2016, 2016 IEEE 40th Annual Computer Software and Applications Conference (COMPSAC).

[10]  Douiji yasmina,et al.  Using YouTube Comments for Text-based Emotion Recognition☆ , 2016 .

[11]  Wolfgang Minker,et al.  Speech-based Emotion Recognition and Speaker Identification: Static vs. Dynamic Mode of Speech Representation , 2016 .

[12]  Vidhyasaharan Sethu,et al.  Speech Based Emotion Recognition , 2015 .

[13]  A. Malik,et al.  The Influences of Emotion on Learning and Memory , 2017, Front. Psychol..

[14]  Priyadarshi Patnaik,et al.  Automated Alertness and Emotion Detection for Empathic Feedback during e-Learning , 2016, 2013 IEEE Fifth International Conference on Technology for Education (t4e 2013).

[15]  Jonathan Klein,et al.  Frustrating the user on purpose: using biosignals in a pilot study to detect the user's emotional state , 1998, CHI Conference Summary.

[16]  Daniel Gatica-Perez,et al.  FaceTube: predicting personality from facial expressions of emotion in online conversational video , 2012, ICMI '12.

[17]  M. Murugappan,et al.  Time-Frequency Analysis of EEG Signals for Human Emotion Detection , 2008 .

[18]  Colin Grubb.  Multimodal Emotion Recognition , 2013 .

[19]  Pilar Rodríguez Marín,et al.  Extracting Emotions from Texts in E-Learning Environments , 2012, 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems.

[20]  Loïc Kessous,et al.  Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis , 2010, Journal on Multimodal User Interfaces.

[21]  Ravi P. Ramachandran,et al.  Speech based emotion recognition using spectral feature extraction and an ensemble of kNN classifiers , 2014, The 9th International Symposium on Chinese Spoken Language Processing.

[22]  Sergio Salmeron-Majadas,et al.  An Evaluation of Mouse and Keyboard Interaction Indicators towards Non-intrusive and Low Cost Affective Modeling in an Educational Context , 2014, KES.

[23]  Neil Y. Yen,et al.  Facial emotion recognition towards affective computing-based learning , 2013, Libr. Hi Tech.

[24]  Aladdin Ayesh,et al.  Detecting emotional stress during typing task with time pressure , 2014, 2014 Science and Information Conference.

[25]  Minjuan Wang,et al.  Affective e-Learning: Using "Emotional" Data to Improve Learning in Pervasive Learning Environment , 2009, J. Educ. Technol. Soc..

[26]  M. den Uyl,et al.  The FaceReader: Online facial expression recognition , 2006 .

[27]  Abeer Alsadoon,et al.  An Emotion Recognition Model Based on Facial Recognition in Virtual Learning Environment , 2018 .

[28]  Arturas Kaklauskas,et al.  Biometric Mouse Intelligent System for Student's Emotional and Examination Process Analysis , 2009, 2009 Ninth IEEE International Conference on Advanced Learning Technologies.

[29]  Hajar Mousannif,et al.  Using YouTube Comments for Text-based Emotion Recognition , 2016, ANT/SEIT.

[30]  Yueh-Min Huang,et al.  Using Facial Expression to Detect Emotion in E-learning System: A Deep Learning Method , 2017, SETE@ICWL.

[31]  Hüseyin Gürüler,et al.  USE OF FACIAL EMOTION RECOGNITION IN E-LEARNING SYSTEMS , 2017 .

[32]  Robert M. Hierons,et al.  Towards estimating computer users’ mood from interaction behaviour with keyboard and mouse , 2013, Frontiers of Computer Science.

[33]  Thierry Pun,et al.  Multimodal Emotion Recognition in Response to Videos , 2012, IEEE Transactions on Affective Computing.

[34]  L.J.F.格尔特斯,et al.  Using biosensors for sharing emotions via a data network service , 2012 .

[35]  T. Hascher.  Learning and Emotion: Perspectives for Theory and Research , 2010 .

[36]  Lakshmi Priya Gg,et al.  Student Emotion Recognition System (SERS) for e-learning Improvement Based on Learner Concentration Metric , 2016 .

[37]  L. de Silva,et al.  Facial emotion recognition using multi-modal information , 1997, Proceedings of ICICS, 1997 International Conference on Information, Communications and Signal Processing. Theme: Trends in Information Systems Engineering and Wireless Multimedia Communications (Cat..

[38]  E. Ambikairajah,et al.  Speaker Normalisation for Speech-Based Emotion Detection , 2007, 2007 15th International Conference on Digital Signal Processing.

[39]  D. Leutner.  Motivation and emotion as mediators in multimedia learning , 2014 .

[40]  M. S. Khan,et al.  Keyboard and mouse interaction based mood measurement using artificial neural networks , 2012, 2012 International Conference of Robotics and Artificial Intelligence.

[41]  K. O’Regan.  EMOTION AND E-LEARNING , 2019, Online Learning.

[42]  Fakhri Karray,et al.  Survey on speech emotion recognition: Features, classification schemes, and databases , 2011, Pattern Recognit..

[43]  Carolyn Penstein Rosé,et al.  Sentiment Analysis in MOOC Discussion Forums: What does it tell us? , 2014, EDM.

[44]  Minda Borun,et al.  How Do You Like To Learn? Comparing User Preferences and Visit Length of Educational Web Sites. , 2002 .

[45]  Min Jiang,et al.  Emotion Detection in E-learning Using Expectation-Maximization Deep Spatial-Temporal Inference Network , 2017, UKCI.

[46]  Kiavash Bahreini,et al.  Towards multimodal emotion recognition in e-learning environments , 2016, Interact. Learn. Environ..

[47]  Stefan Feuerriegel,et al.  Deep learning for affective computing: Text-based emotion recognition in decision support , 2018, Decis. Support Syst..