EEG-based excitement detection in immersive environments: An improved deep learning approach

The use of machine learning approaches to detecting the human emotion of excitement via electroencephalography (EEG) while immersed in an immersive virtual reality environment is studied in this investigation. The ability to detect excitement has many potential applications such as in affective entertainment, neuromarketing and particularly in virtual reality computer gaming. Users are exposed to a roller-coaster experience as the emotional stimuli, which is expected to evoke the emotion of excitement, while simultaneously wearing virtual reality goggles, which delivers the virtual reality experience of excitement, and an EEG headset, which acquires the raw brain signals detected when exposed to this excitement stimuli. In this study, a deep learning approach is used to improve the excitement detection rate to well above the 90% accuracy level. In a prior similar study, the use of conventional machine learning approaches involving k-Nearest Neighbour (kNN) classifiers and Support Vector Machines (SVM) only achieved prediction accuracy rates of between 65-89%. Using a deep learning approach here, rates of 78-96% were achieved. This demonstrates the superiority of adopting a deep learning approach over other machine learning approaches for detecting human excitement when immersed in an immersive virtual reality environment.The use of machine learning approaches to detecting the human emotion of excitement via electroencephalography (EEG) while immersed in an immersive virtual reality environment is studied in this investigation. The ability to detect excitement has many potential applications such as in affective entertainment, neuromarketing and particularly in virtual reality computer gaming. Users are exposed to a roller-coaster experience as the emotional stimuli, which is expected to evoke the emotion of excitement, while simultaneously wearing virtual reality goggles, which delivers the virtual reality experience of excitement, and an EEG headset, which acquires the raw brain signals detected when exposed to this excitement stimuli. In this study, a deep learning approach is used to improve the excitement detection rate to well above the 90% accuracy level. In a prior similar study, the use of conventional machine learning approaches involving k-Nearest Neighbour (kNN) classifiers and Support Vector Machines (SVM) onl...

[1]  Brent Lance,et al.  Optimal Arousal Identification and Classification for Affective Computing Using Physiological Signals: Virtual Reality Stroop Task , 2010, IEEE Transactions on Affective Computing.

[2]  Bernard Widrow,et al.  Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[3]  Alberto Betella,et al.  Fast mental states decoding in mixed reality , 2014, Front. Behav. Neurosci..

[4]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[5]  Bao-Liang Lu,et al.  Emotional state classification from EEG data using machine learning approach , 2014, Neurocomputing.

[6]  Pouya Bashivan,et al.  Mental State Recognition via Wearable EEG , 2016, ArXiv.

[7]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[8]  Apichart Intarapanich,et al.  Analysis of the meditation brainwave from consumer EEG device , 2015, SoutheastCon 2015.

[9]  Anthony Randal McIntosh,et al.  ‘My Virtual Dream’: Collective Neurofeedback in an Immersive Art Environment , 2015, PloS one.

[10]  S. Murugappan,et al.  Human emotion recognition through short time Electroencephalogram (EEG) signals using Fast Fourier Transform (FFT) , 2013, 2013 IEEE 9th International Colloquium on Signal Processing and its Applications.

[11]  Weihui Dai,et al.  Emotion recognition and affective computing on vocal social media , 2015, Inf. Manag..

[12]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.