EmotionO+: Physiological signals knowledge representation and emotion reasoning model for mental health monitoring

Emotion is an important indicator of depressive conditions. Emotion recognition based on physiological signals such as electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) has gained significant attraction in healthcare domain research. Sharing of physiological signal data related to emotional response between different healthcare systems has the potential to benefit both laboratory-based healthcare research and `real-world' clinical practice. However, management and distribution of the data presents significant challenges; addressing these challenges requires advanced tools for data representation, mining and integration. In this paper we propose such a tool which contains an ontology model called EmotionO+ and rules set based on EEG, which is obtained by random forest algorithm to predict emotional state. It presents not only an effective method to enable semantic representation of the EEG and fNIRS data, but also an emotion knowledge mining tool. Results using EEG data in the eNTERFACE'06 dataset show an accuracy for our proposed model of 99.11% as compared to 97.8% for competing methods using the C4.5 algorithm. The experimental results demonstrate that the posited approach is potentially usable for early stage prediction and intervention for depressive disorders.

[1]  M A Kulikov,et al.  Frequency characteristics of EEG spectra in the emotions. , 1996, Neuroscience and behavioral physiology.

[2]  Aldo Gangemi,et al.  An Overview of the ONIONS Project: Applying Ontologies to the Integration of Medical Terminologies , 1999, Data Knowl. Eng..

[3]  Thomas R. Gruber,et al.  A Translation Approach to Portable Ontologies , 1993 .

[4]  Bo Hu,et al.  Ontology-Mediated Distributed Decision Support for Breast Cancer , 2005, AIME.

[5]  L. H. Viet,et al.  Emotion Detection in the Loop from Brain Signals and Facial Images , 2006 .

[6]  J. Russell.  A circumplex model of affect. , 1980 .

[7]  P. Lang.  International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[8]  Mei-Hui Wang,et al.  A Fuzzy Expert System for Diabetes Decision Support Application , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Stephen R. Garner,et al.  WEKA: The Waikato Environment for Knowledge Analysis , 1996 .

[10]  Giuseppe De Pietro,et al.  An ontology-based fuzzy decision support system for multiple sclerosis , 2011, Eng. Appl. Artif. Intell..

[11]  C. Krause,et al.  Relative electroencephalographic desynchronization and synchronization in humans to emotional film content: an analysis of the 4–6, 6–8, 8–10 and 10–12 Hz frequency bands , 2000, Neuroscience Letters.

[12]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[14]  Yuan-Pin Lin,et al.  EEG-Based Emotion Recognition in Music Listening , 2010, IEEE Transactions on Biomedical Engineering.

[15]  Ramón Díaz-Uriarte,et al.  Gene selection and classification of microarray data using random forest , 2006, BMC Bioinformatics.

[16]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[17]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[18]  Paul Pauli,et al.  Prefrontal Brain Activation During Emotional Processing: A Functional Near Infrared Spectroscopy Study (fNIRS) , 2011, The open neuroimaging journal.

[19]  John F. Sowa,et al.  Top-level ontological categories , 1995, Int. J. Hum. Comput. Stud..

[20]  J. Fermaglich.  Electric Fields of the Brain: The Neurophysics of EEG , 1982 .

[21]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[22]  Touradj Ebrahimi,et al.  Affect recognition based on physiological changes during the watching of music videos , 2012, TIIS.

[23]  Marco Ferrari,et al.  A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application , 2012, NeuroImage.

[24]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[25]  Leontios J. Hadjileontiadis,et al.  Emotion Recognition From EEG Using Higher Order Crossings , 2010, IEEE Transactions on Information Technology in Biomedicine.

[26]  Bin Hu,et al.  Ontology driven decision support for the diagnosis of mild cognitive impairment , 2014, Comput. Methods Programs Biomed..

[27]  Guillaume Chanel,et al.  Emotion Assessment: Arousal Evaluation Using EEG's and Peripheral Physiological Signals , 2006, MRCS.

[28]  L. Aftanas,et al.  Analysis of Evoked EEG Synchronization and Desynchronization in Conditions of Emotional Activation in Humans: Temporal and Topographic Characteristics , 2004, Neuroscience and Behavioral Physiology.

[29]  Bin Hu,et al.  Emotiono: An Ontology with Rule-Based Reasoning for Emotion Recognition , 2011, ICONIP.

[30]  W. Ray,et al.  EEG alpha activity reflects attentional demands, and beta activity reflects emotional and cognitive processes. , 1985, Science.

[31]  Mohammad Soleymani,et al.  Short-term emotion assessment in a recall paradigm , 2009, Int. J. Hum. Comput. Stud..