Encourage Players to Smile While Playing Games Bring More Enjoyment

This paper presents a video game system with a smile interface designed to promote the player experience. We introduce a new mechanism to an existing endless runner game, "Runner." Such mechanism allows smiles to be taken as an input to the game system, for triggering boosting period. To detect smiles, a deep-learning facial recognition toolkit named Affdex, by Affectiva, is employed. Evaluation on player experience was done using a shorten version of Game User Experience Satisfaction Scale. Three different game modes are compared: Standard Mode (no smile and boosting), Smile Mode (with smile for boosting), and Auto Mode (auto boosting, without smile). Our results show that the presence of the smile mechanism leads to more enjoyable gameplay.

[1]  P. Ekman,et al.  Behavioral markers and recognizability of the smile of enjoyment. , 1993, Journal of personality and social psychology.

[2]  Nicholas A. Coles,et al.  A meta-analysis of the facial feedback literature: Effects of facial feedback on emotional experience are small and variable. , 2019, Psychological bulletin.

[3]  Daniel McDuff,et al.  AFFDEX SDK: A Cross-Platform Real-Time Multi-Face Expression Recognition Toolkit , 2016, CHI Extended Abstracts.

[4]  Jun Rekimoto,et al.  Smiling makes us happier: enhancing positive mood and communication with smile-encouraging digital appliances , 2011, UbiComp '11.

[5]  Manfred Tscheligi,et al.  Using emotion in games: emotional flowers , 2007, ACE '07.

[6]  Daniel Moldt,et al.  Emotions and Multimodal Interface-Agents: A Sociological View , 2001, MuC.

[7]  Barbara S. Chaparro,et al.  The Development and Validation of the Game User Experience Satisfaction Scale (GUESS) , 2016, Hum. Factors.

[8]  Jingdi Xu,et al.  An Angry Birds-like Game System for Promoting Players’ Emotion , 2018, 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE).

[9]  P. Ekman Facial expression and emotion. , 1993, The American psychologist.

[10]  Yuuki Okido,et al.  Promoting Emotional Well-Being with Angry-Birds-like Gameplay on Pixel Image Levels , 2019, 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH).

[11]  M. Bennett,et al.  The effect of mirthful laughter on stress and natural killer cell activity. , 2003, Alternative therapies in health and medicine.

[12]  Pujana Paliyawan,et al.  Runner: A 2D platform game for physical health promotion , 2019, SoftwareX.

[13]  Javier Hernandez,et al.  Mood meter: counting smiles in the wild , 2012, UbiComp.

[14]  Changeun Yang,et al.  Smile with Angry Birds: Two Smile-Interface Implementations , 2018, 2018 Nicograph International (NicoInt).