Brain-IoT based Emotion Recognition System

Emotions are referred to as a natural instinctive state of mind derived from some circumstances or mood. In this research, we investigate the use of a system based on Brain-IoT that identifies negative emotions such as Anger, Fear or Sadness and triggers a video to elicit positive emotions. The experiments were conducted using an EEG Headset, Heart Rate Variability Sensor (HRV), Galvanic Skin Response sensor (GSR), ThingSpeak database, and a Mobile Application. The subject is required to watch a video that induces negative emotions. The EEG data gathered is pre-processed, while the required parameters like Arousal and Valence and computed using MATLAB and transferred to the ThingSpeak Database. When the negative emotions are detected, a video inducing positive emotions is triggered. Overall, the experiment results concluded that a Brain IoT based system that can sense negative emotion and provoke positive emotions can be developed.

[1]  Zhenqi Li,et al.  A Review of Emotion Recognition Using Physiological Signals , 2018, Sensors.

[2]  B. Fredrickson.  The role of positive emotions in positive psychology. The broaden-and-build theory of positive emotions. , 2001, The American psychologist.

[3]  Mohammad Soleymani,et al.  Analysis of EEG Signals and Facial Expressions for Continuous Emotion Detection , 2016, IEEE Transactions on Affective Computing.

[4]  Turgay Kaya,et al.  Wavelet-based study of valence–arousal model of emotions on EEG signals with LabVIEW , 2016, Brain Informatics.

[5]  Mauridhi Hery Purnomo,et al.  Improving the accuracy of EEG emotion recognition by combining valence lateralization and ensemble learning with tuning parameters , 2019, Cognitive Processing.

[6]  Yang Wang,et al.  GSR and Blink Features for Cognitive Load Classification , 2013, INTERACT.

[7]  M. Teplan.  FUNDAMENTALS OF EEG MEASUREMENT , 2002 .

[8]  Cuntai Guan,et al.  Asymmetric Spatial Pattern for EEG-based emotion detection , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[9]  Kai Keng Ang,et al.  EEG-based Emotion Recognition Using Self-Organizing Map for Boundary Detection , 2010, 2010 20th International Conference on Pattern Recognition.

[10]  Pasin Israsena,et al.  Real-Time EEG-Based Happiness Detection System , 2013, TheScientificWorldJournal.

[11]  Fu Xiao,et al.  An EEG-Based Identity Authentication System with Audiovisual Paradigm in IoT , 2019, Sensors.

[12]  Bao-Liang Lu,et al.  Multimodal emotion recognition using EEG and eye tracking data , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Sazali Yaacob,et al.  An investigation on visual and audiovisual stimulus based emotion recognition using EEG , 2009, Int. J. Medical Eng. Informatics.

[14]  Jason Williams,et al.  Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System , 2004, ADS.

[15]  Kwang-Eun Ko,et al.  Emotion recognition using EEG signals with relative power values and Bayesian network , 2009 .

[16]  Leontios J. Hadjileontiadis,et al.  Emotion Recognition from Brain Signals Using Hybrid Adaptive Filtering and Higher Order Crossings Analysis , 2010, IEEE Transactions on Affective Computing.

[17]  S. Hsieh,et al.  Classifying Different Emotional States by Means of EEG-Based Functional Connectivity Patterns , 2014, PloS one.

[18]  Guanghua Wu,et al.  The Analysis of Emotion Recognition from GSR Based on PSO , 2010, 2010 International Symposium on Intelligence Information Processing and Trusted Computing.