Affect-based adaptation of an applied video game for educational purposes

Purpose This paper aims to clarify how affect-based adaptation can improve implicit recognition of playing style of individuals during game sessions. This study presents the “Rush for Gold” game using dynamic difficulty adjustment of tasks based on both player performance and affectation inferred through electrodermal activity and facial expressions of the player. The game applies linear regression for calculating playing styles to be applied for achieving a style-based adaptation in other educational video games. Design/methodology/approach The experimental procedure included subject selection, demonstration, informed consent procedure, two game sessions in random order – one without and another with affective adaptation control – and post-game self-report. The experiment was conducted with participation of 30 master students and university lecturers in informatics. Findings This study presents experimental results concerning the impact of affective adaptation over playing style recognition, game session time, task’s effectiveness, efficiency and difficulty and, as well, player’s assessment of affectively adaptive gameplay obtained by an adaptation control panel embedded into the game and by post-game self-report. Research limitations/implications The proposed adaptive game limits recognised styles to such based on the Kolb’s Learning Style Inventory model. Another limitation of the study is the relatively small number of participants constrained by the extended experimental procedure and the desktop game version. Originality/value The paper presents an original research on the effect of affect-based adaptation on a novel approach for implicit recognition of playing styles.

[1]  Teemu Henrikki Laine,et al.  Detecting Play and Learning Styles for Adaptive Educational Games , 2016, CSEDU.

[2]  Lennart E. Nacke,et al.  Player Typology in Theory and Practice , 2011, DiGRA Conference.

[3]  Ana Paiva,et al.  Artificial Intelligence and Personalization Opportunities for Serious Games , 2012, AAAI 2012.

[4]  Joost Broekens,et al.  AffectButton: A method for reliable and valid affective self-report , 2013, Int. J. Hum. Comput. Stud..

[5]  Manuel Graña,et al.  EMOTION RECOGNITION BASED ON THE ANALYSIS OF FACIAL EXPRESIONS: A SURVEY , 2009 .

[6]  Brian Magerko,et al.  Intelligent adaptation of digital game-based learning , 2008, Future Play.

[7]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[8]  K. Squire From Content to Context: Videogames as Designed Experience , 2006 .

[9]  Valerie J. Shute,et al.  Video gameplay, personality and academic performance , 2012, Comput. Educ..

[10]  Dennis S. Charney,et al.  Neurobiology of Mental Illness , 2004 .

[11]  Ana Paiva,et al.  Emotion in Games , 2011, ACII.

[12]  Stephen H. Fairclough,et al.  Construction of the biocybernetic loop: a case study , 2012, ICMI '12.

[13]  Larry S. Davis,et al.  Recognizing Human Facial Expressions From Long Image Sequences Using Optical Flow , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Oliver G. B. Garrod,et al.  Dynamic Facial Expressions of Emotion Transmit an Evolving Hierarchy of Signals over Time , 2014, Current Biology.

[15]  Ryan O. Murphy,et al.  Using Skin Conductance in Judgment and Decision Making Research , 2011 .

[16]  L Curry Learning preferences and continuing medical education. , 1981, Canadian Medical Association journal.

[17]  Boyan Bontchev CUSTOMIZABLE 3D VIDEO GAMES AS EDUCATIONAL SOFTWARE , 2015 .

[18]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[19]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[20]  Karl J. Friston,et al.  Analytic measures for quantification of arousal from spontaneous skin conductance fluctuations , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[21]  Boyan Bontchev,et al.  Assessing engagement in an emotionally-adaptive applied game , 2016, TEEM.

[22]  Eugénio C. Oliveira,et al.  Real-Time Psychophysiological Emotional State Estimation in Digital Gameplay Scenarios , 2013, EANN.

[23]  Guillaume Chanel,et al.  A review of the use of psychophysiological methods in game research , 2011 .

[24]  Rafael Bidarra,et al.  A Generic Method for Classification of Player Behavior , 2013, AIIDE 2013.

[25]  Thomas S. Huang,et al.  Emotion Recognition from Facial Expressions using Multilevel HMM , 2000 .

[26]  B. D. Coller,et al.  Effectiveness of using a video game to teach a course in mechanical engineering , 2009, Comput. Educ..

[27]  Eunjung Han,et al.  Human-centered modeling for style-based adaptive games , 2009 .

[28]  D. Kolb Experiential Learning: Experience as the Source of Learning and Development , 1983 .