EEG-enabled Affective Human-Computer Interfaces

Nowadays, the human computer interfaces can be designed to be adaptive and emotion-enabled. The recognized emotions of the user can help make the user’s experience more complete, more engaging, less stressful or more stressful depending on the target of the applications. Such affective human-computer interfaces are getting more attention from researchers and engineers. EEG signals are used to recognize emotions of the user in real time. We describe a real-time emotion recognition algorithm that is used to personalize different applications according to the user’s current emotions. The algorithm is subject-dependent and needs a training session before running the application. Two EEG-enabled games and one adaptive advertisement based on the algorithm are designed and implemented. One game is the “Bar” game where a difficulty level of the game is adapted based on the player’s score and emotions. Another game is the “Girl Twins” one where the player’s emotions are monitored in real time, and an emotional companion is implemented as the girl twins avatars whose behaviour changes according to the user’s emotions. An adaptive advertising movie is designed and implemented as well. Here, the real-time emotion recognition algorithm is used to adjust the scenes of the advertisement based on the current emotion recognized.

[1]  Mohammad Soleymani,et al.  Short-term emotion assessment in a recall paradigm , 2009, Int. J. Hum. Comput. Stud..

[2]  A. Mehrabian Framework for a comprehensive description and measurement of emotional states. , 1995, Genetic, social, and general psychology monographs.

[3]  Olga Sourina,et al.  EEG-Based Emotion-Adaptive Advertising , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[4]  Marko Turpeinen,et al.  Emotionally Adapted Games - An Example of a First Person Shooter , 2009, HCI.

[5]  Tzu-Wei Tsai,et al.  An affective computing approach to develop the game-based adaptive learning material for the elementary students , 2012, HCCE '12.

[6]  Olga Sourina,et al.  Real-Time EEG-Based Human Emotion Recognition and Visualization , 2010, 2010 International Conference on Cyberworlds.

[7]  Alan J. Dix,et al.  Using frustration in the design of adaptive videogames , 2004, ACE '04.

[8]  M. Kringelbach The human orbitofrontal cortex: linking reward to hedonic experience , 2005, Nature Reviews Neuroscience.

[9]  Olga Sourina,et al.  Real-Time EEG-Based Emotion Recognition and Its Applications , 2011, Trans. Comput. Sci..

[10]  Cosima Prahm,et al.  Evaluation of consumer EEG device Emotiv EPOC , 2011 .

[11]  S. Adamovich,et al.  Analysis of a commercial EEG device for the control of a robot arm , 2010, Proceedings of the 2010 IEEE 36th Annual Northeast Bioengineering Conference (NEBEC).

[12]  J. Knott,et al.  Regarding the American Electroencephalographic Society guidelines for standard electrode position nomenclature: a commentary on the proposal to change the 10-20 electrode designators. , 1993, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[13]  R. Moddemeijer On estimation of entropy and mutual information of continuous distributions , 1989 .

[14]  Kamryn T. Eddy,et al.  Amygdala-frontal connectivity during emotion regulation. , 2007, Social cognitive and affective neuroscience.

[15]  D. Pandya,et al.  Projections to the frontal cortex from the posterior parietal region in the rhesus monkey , 1984, The Journal of comparative neurology.

[16]  H. Demaree,et al.  Brain lateralization of emotional processing: historical roots and a future incorporating "dominance". , 2005, Behavioral and cognitive neuroscience reviews.

[17]  Paul D. Bolls,et al.  The Effects of Message Valence and Listener Arousal on Attention, Memory, and Facial Muscular Responses to Radio Advertisements , 2001, Commun. Res..

[18]  Thierry Dutoit,et al.  A P300-based Quantitative Comparison between the Emotiv Epoc Headset and a Medical EEG Device , 2012, BioMed 2012.

[19]  A. Damasio,et al.  Emotion, decision making and the orbitofrontal cortex. , 2000, Cerebral cortex.

[20]  Wijnand A. IJsselsteijn,et al.  Creating an Emotionally Adaptive Game , 2008, ICEC.

[21]  Ken Binmore,et al.  Fun and games : a text on game theory , 1991 .

[22]  Michael D. Robinson,et al.  Measures of emotion: A review , 2009, Cognition & emotion.

[23]  Scott M. Stevens,et al.  Entertainment Computing - ICEC 2008, 7th International Conference, Pittsburgh, PA, USA, September 25-27, 2008. Proceedings , 2008, ICEC.

[24]  Florin Dolcos,et al.  Dissociable effects of arousal and valence on prefrontal activity indexing emotional evaluation and subsequent memory: an event-related fMRI study , 2004, NeuroImage.

[25]  A. Mehrabian Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament , 1996 .

[26]  Julie A. Jacko,et al.  Interacting in various application domains , 2009 .

[27]  K. Poels,et al.  How to Capture the Heart? Reviewing 20 Years of Emotion Measurement in Advertising , 2006 .

[28]  Wijnand A. IJsselsteijn,et al.  Dynamic Game Balancing by Recognizing Affect , 2008, Fun and Games.

[29]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[30]  Olga Sourina,et al.  EEG Databases for Emotion Recognition , 2013, 2013 International Conference on Cyberworlds.