A Flexible Bio-Affective Gaming Interface

Affective bio-feedback can be an important instrument to enhance the game experience. Several studies have provided evidence of the usefulness of physiological signals for affective gaming. However, due to discrepancies in the findings of psychology studies, the pattern matching models employed are limited in the number of emotions they are able to classify. This paper presents a bio-affective gaming interface (BAGI) that can be used to customize a game experience according to the player’s emotional response. Its architecture offers important characteristics for gaming such as: flexibility, scalability and multi-category discrimination in real time. These features are important not only because they allow the classification with pattern matching and machine learning models but also because they make possible the reusability of previous findings and the inclusion of new models to the system. In order to prove the effectiveness of BAGI two different types of neural networks have been trained to recognize emotions. After that, they were incorporated into the system to customize in real-time the computer wallpaper, according to the emotion experienced by the user. The best results were obtained with a probabilistic neural network with accuracy results of 84.46% on the training data and 78.38% on the validation for new independent data sets.

[1]  Bruce H. Friedman,et al.  Multivariate Discrimination of Emotion-Specific Autonomic Nervous System Activity , 2002 .

[2]  Brian McDonald,et al.  Intelligent Biofeedback using an Immersive Competitive Environment , 2001 .

[3]  K. H. Kim,et al.  Emotion recognition system using short-term monitoring of physiological signals , 2004, Medical and Biological Engineering and Computing.

[4]  Sara Ilstedt Hjelm,et al.  Brainball - using brain activity for cool competition , 2000 .

[5]  J. Cacioppo,et al.  Inferring psychological significance from physiological signals. , 1990, The American psychologist.

[6]  Mitsuru Ishizuka,et al.  A Study in Users' Physiological Response to an Empathic Interface Agent , 2006, Int. J. Humanoid Robotics.

[7]  Graham Clarke,et al.  A user-independent real-time emotion recognition system for software agents in domestic environments , 2007, Eng. Appl. Artif. Intell..

[8]  Dongkyoo Shin,et al.  Towards an Emotion Recognition System Based on Biometrics , 2009, 2009 International Joint Conference on Computational Sciences and Optimization.

[9]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[10]  John R. Smith,et al.  Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment , 2005, EURASIP J. Adv. Signal Process..

[11]  G. Stemmler,et al.  The autonomic differentiation of emotions revisited: convergent and discriminant validation. , 1989, Psychophysiology.

[12]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Daniela M. Romano,et al.  Exploring the use of a respiratory-computer interface for game interaction , 2009, 2009 International IEEE Consumer Electronics Society's Games Innovations Conference.

[14]  J. Russell A circumplex model of affect. , 1980 .

[15]  R. Zajonc,et al.  Emotions Research: Some Promising Questions and Some Questionable Promises , 1992 .

[16]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[17]  Christine L. Lisetti,et al.  Emotion recognition from physiological signals using wireless sensors for presence technologies , 2004, Cognition, Technology & Work.

[18]  Andruid Kerne,et al.  A Design for Using Physiological Signals to Affect Team Game Play , 2006 .

[19]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Christian Peter,et al.  Emotion representation and physiology assignments in digital systems , 2006, Interact. Comput..

[21]  Cristina Conati,et al.  Probabilistic assessment of user's emotions in educational games , 2002, Appl. Artif. Intell..

[22]  Jason Williams,et al.  Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System , 2004, ADS.

[23]  J. Averill AUTONOMIC RESPONSE PATTERNS DURING SADNESS AND MIRTH , 1969 .

[24]  Gyuhwan Oh,et al.  A Study on New Gameplay Based on Brain-Computer Interface , 2009, DiGRA Conference.

[25]  Alan J. Dix,et al.  Affective Videogames and Modes of Affective Gaming: Assist Me, Challenge Me, Emote Me (ACE) , 2005, DiGRA Conference.

[26]  J. Cacioppo,et al.  The psychophysiology of emotion. , 1993 .

[27]  J. Arroyo-Palacios Towards a Standardization in the Use of Physiological Signals for Affective Recognition Systems , 2008 .

[28]  J. E. Rose,et al.  Autonomic Nervous System Activity Distinguishes Among Emotions , 2009 .

[29]  B. Fredrickson,et al.  The Undoing Effect of Positive Emotions , 2000, Motivation and emotion.