EmotionBike: A Study of Provoking Emotions in Cycling Exergames

In this work, we investigate the effect of how exercise game design elements generate deliberate real-time sensed emotional responses in gamers. Our experimental setup consists of a cycling game controller, a designed 3D first-person cycling game to provoke emotions, a data recording system, and an emotion analysis system. The physical cycling game controller is an enhanced computer controlled bike-exercise-trainer that enables handle bar steering and sets pedal resistance. Our developed 3D first person cycling game provokes emotions with game elements in different game settings: timed race, parcours traversal, and virtual world exploration. Our recording system synchronously captures video, game controller activity, and game events for emotion analysis. In this case study, we show evidence that crafted computer exergame elements are able to provoke subject emotions displayed in their facial expressions, which can be quantified with our developed analysis method. The game elements selected in the specific gameplay situations follow patterns that give inside and judge of individual players involvement and emotional tension. Our emotion analysis of game events provides insights into player reactions during specific game situations. Our results show that strong differing responses by individuals may be taken into account in the design of game mechanics. For example, the falling event of level 3 showed that two opposing strong reactions could be triggered in players. The emotion analysis methods may be used in other types of games. Hereby we believe that a combination of questionnaires and our in situ emotion analysis provide valuable feedback to aid decision in for game design and game mechanics.

[1]  Florian Vogt,et al.  Emotional Interaction with Surfaces - Works of Design and Computing , 2012, ICEC.

[2]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[3]  Ricardo Gutierrez-Osuna,et al.  A Control-Theoretic Approach to Adaptive Physiological Games , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[4]  Hatice Gunes,et al.  Automatic, Dimensional and Continuous Emotion Recognition , 2010, Int. J. Synth. Emot..

[5]  P. Ekman,et al.  Measuring facial movement , 1976 .

[6]  Ryan E Rhodes,et al.  The health benefits of interactive video game exercise. , 2007, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[7]  Kristy Elizabeth Boyer,et al.  Automatically Recognizing Facial Indicators of Frustration: A Learning-centric Analysis , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[8]  Regan L. Mandryk,et al.  Using affective state to adapt characters, NPCs, and the environment in a first-person shooter game , 2014, 2014 IEEE Games Media Entertainment.

[9]  Maria E. Jabon,et al.  Real-time classification of evoked emotions using facial feature tracking and physiological responses , 2008, Int. J. Hum. Comput. Stud..

[10]  Sharon L. Oviatt,et al.  Multimodal Interfaces: A Survey of Principles, Models and Frameworks , 2009, Human Machine Interaction.

[11]  C. Breazeal Sociable Machines: Expressive Social Ex-change Between Humans and Robots , 2000 .

[12]  Franz Kummert,et al.  Dynamic dialog system for human robot collaboration: playing a game of pairs , 2014, HAI.

[13]  Anne-Marie Brouwer,et al.  Heart Rate Variability and Skin Conductance Biofeedback: A Triple-Blind Randomized Controlled Study , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[14]  Gwen Littlewort,et al.  The computer expression recognition toolbox (CERT) , 2011, Face and Gesture 2011.

[15]  Alan J. Dix,et al.  Affective Videogames and Modes of Affective Gaming: Assist Me, Challenge Me, Emote Me (ACE) , 2005, DiGRA Conference.

[16]  Masayuki Numao,et al.  An implementation of affective adaptation in survival horror games , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[17]  Wolfgang Wahlster,et al.  Dialogue Systems Go Multimodal: The SmartKom Experience , 2006, SmartKom.

[18]  Christian Werner Becker-Asano,et al.  WASABI: Affect simulation for agents with believable interactivity , 2008 .

[19]  Abdulmotaleb El-Saddik,et al.  Evaluating Player Experience in Cycling Exergames , 2013, 2013 IEEE International Symposium on Multimedia.

[20]  Regan L. Mandryk,et al.  Biofeedback game design: using direct and indirect physiological control to enhance game interaction , 2011, CHI.

[21]  Rosalind W. Picard,et al.  Acted vs. natural frustration and delight: Many people smile in natural frustration , 2011, Face and Gesture 2011.

[22]  Eugénio C. Oliveira,et al.  Computational Models of Players' Physiological-Based Emotional Reactions: A Digital Games Case Study , 2014, 2014 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT).

[23]  Tamás D. Gedeon,et al.  Modeling stress recognition in typical virtual environments , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[24]  Stefanos Zafeiriou,et al.  Affective Gaming: A Comprehensive Survey , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[25]  Sheikh Shanawaz Mostafa,et al.  Mental states estimation with the variation of physiological signals , 2012, 2012 International Conference on Informatics, Electronics & Vision (ICIEV).

[26]  Tuck Wah Leong,et al.  Combining think-aloud and physiological data to understand video game experiences , 2014, CHI.