Toward Personalized Adaptive Gamification: A Machine Learning Model for Predicting Performance

Personalized adaptive gamification has the potential to improve individuals’ motivation and performance. Current methods aim to predict the perceived affective state (i.e., emotion) of an individual in order to improve their motivation and performance by tailoring an application. However, existing methods may struggle to predict the state of an individual that it has not been trained for. Moreover, the affective state that correlates to good performance may vary based on individuals and task characteristics. Given these limitations, this paper presents a machine learning method that uses task information and an individual's facial expression data to predict his/her performance on a gamified task. The training data used to generate the adaptive-individual-task model is updated every time new data from an individual is acquired. This approach helps to improve the model's prediction accuracy and account for variations in facial expressions across individuals. A case study is presented that demonstrates the feasibility and performance of the model. The results indicate that the model is able to predict the performance of individuals, before completing a task, with an accuracy of 0.768. The findings support the use of adaptive models that dynamically update their training data set and consider task information and individuals’ facial expression data.

[1]  Conrad S. Tucker,et al.  Exploring the link between task complexity and students' affective states during engineering laboratory activities , 2016 .

[2]  S TuckerConrad,et al.  A quantitative method for evaluating the complexity of implementing and performing game features in physically-interactive gamified applications , 2017 .

[3]  Conrad S. Tucker,et al.  Towards Personalized Performance Feedback: Mining the Dynamics of Facial Keypoint Data in Engineering Lab Environments , 2018 .

[4]  Pedro A. Toledo,et al.  Enhancing the engagement of intelligent tutorial systems through personalization of gamification , 2016 .

[5]  Bin Xu,et al.  Personality-targeted Gamification: A Survey Study on Personality Traits and Motivational Affordances , 2016, CHI.

[6]  E. Hudlicka AFFECTIVE COMPUTING FOR GAME DESIGN , 2008 .

[7]  Sandra Fernandes,et al.  Gamification in the Workplace: A Systematic Literature Review , 2017, WorldCIST.

[8]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[9]  Yang Li,et al.  Predicting Human Performance in Vertical Menu Selection Using Deep Learning , 2018, CHI.

[10]  R. Wood Task complexity: Definition of the construct , 1986 .

[11]  Sidney K. D'Mello,et al.  A Review and Meta-Analysis of Multimodal Affect Detection Systems , 2015, ACM Comput. Surv..

[12]  Antti Oulasvirta,et al.  Model of visual search and selection time in linear menus , 2014, CHI.

[13]  Markus Bick,et al.  Towards adaptive Gamification: a synthesis of current Developments , 2017, ECIS.

[14]  James C. Lester,et al.  Affect and Engagement in Game-BasedLearning Environments , 2014, IEEE Transactions on Affective Computing.

[15]  Juho Hamari,et al.  Player Types: A Meta-synthesis , 2014, Trans. Digit. Games Res. Assoc..

[16]  Julita Vassileva,et al.  Modeling the efficacy of persuasive strategies for different gamer types in serious games for health , 2014, User Modeling and User-Adapted Interaction.

[17]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[18]  Longzhuang Li,et al.  Recognizing and regulating e-learners' emotions based on interactive Chinese texts in e-learning systems , 2014, Knowl. Based Syst..

[19]  Kurt Hornik,et al.  Misc Functions of the Department of Statistics (e1071), TU Wien , 2014 .

[20]  Stefanos Zafeiriou,et al.  Affective Gaming: A Comprehensive Survey , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[21]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[22]  Guillaume Chanel,et al.  Emotion Assessment From Physiological Signals for Adaptation of Game Difficulty , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[23]  Ludmila I. Kuncheva,et al.  Technological Advancements in Affective Gaming: A Historical Survey , 2014 .

[24]  Zhizhong Li,et al.  Task complexity: A review and conceptualization framework , 2012 .

[25]  Kostas Karpouzis,et al.  Fusing Visual and Behavioral Cues for Modeling User Experience in Games , 2013, IEEE Transactions on Cybernetics.

[26]  Allen Newell,et al.  The keystroke-level model for user performance time with interactive systems , 1980, CACM.

[27]  Galia Angelova,et al.  Gamification in Education: A Systematic Mapping Study , 2015, J. Educ. Technol. Soc..

[28]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[29]  Peter Robinson,et al.  OpenFace: An open source facial behavior analysis toolkit , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[30]  Julian Togelius,et al.  Modeling Player Experience for Content Creation , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[31]  Harriet Black Nembhard,et al.  Knowledge discovery of game design features by mining user-generated feedback , 2016, Comput. Hum. Behav..

[32]  Mahmoud Neji,et al.  The Affective Tutoring System , 2010, Expert Syst. Appl..

[33]  Sébastien George,et al.  Motivation for Learning - Adaptive Gamification for Web-based Learning Environments , 2014, CSEDU.

[34]  Julian Togelius,et al.  Towards Automatic Personalized Content Generation for Platform Games , 2010, AIIDE.

[35]  Kostas Karpouzis,et al.  Towards player’s affective and behavioral visual cues as drives to game adaptation , 2012 .

[36]  Jörgen Ahlberg,et al.  CANDIDE-3 - An Updated Parameterised Face , 2001 .

[37]  Neil Charness,et al.  The Model Human Processor and the older adult: parameter estimation and validation within a mobile phone task. , 2007, Journal of experimental psychology. Applied.

[38]  Marco Granato,et al.  Profile-Based Algorithm for Personalized Gamification in Computer-Supported Collaborative Learning Environments , 2017, GHITALY@CHItaly.

[39]  Conrad S. Tucker,et al.  From Mining Affective States to Mining Facial Keypoint Data: The Quest Towards Personalized Feedback , 2017 .

[40]  Jesse Fox,et al.  Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance , 2015, Comput. Educ..

[41]  Danial Hooshyar,et al.  A survey on data-driven approaches in educational games , 2016, 2016 2nd International Conference on Science in Information Technology (ICSITech).

[42]  Joaquim A. Jorge,et al.  Engaging Engineering Students with Gamification , 2013, 2013 5th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES).

[43]  Joaquim A. Jorge,et al.  Early Prediction of Student Profiles Based on Performance and Gaming Preferences , 2016, IEEE Transactions on Learning Technologies.

[44]  Michel C. Desmarais,et al.  A Player Model for Adaptive Gamification in Learning Environments , 2015, AIED.

[45]  Patrick Buckley,et al.  Individualising gamification: An investigation of the impact of learning styles and personality traits on the efficacy of gamification using a prediction market , 2017, Comput. Educ..

[46]  Georgios N. Yannakakis,et al.  Real-time adaptation of augmented-reality games for optimizing player satisfaction , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[47]  D. Campbell Task Complexity: A Review and Analysis , 1988 .

[48]  Petros Daras,et al.  Multimodal Student Engagement Recognition in Prosocial Games , 2018, IEEE Transactions on Games.

[49]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[50]  Stylianos Asteriadis,et al.  Personalized, Affect and Performance-driven Computer-based Learning , 2017, CSEDU.

[51]  Alexander Agung Santoso Gunawan,et al.  Face Expression Detection on Kinect Using Active Appearance Model and Fuzzy Logic , 2015 .

[52]  Berkan Celik,et al.  A qualitative investigation of student perceptions of game elements in a gamified course , 2018, Comput. Hum. Behav..

[53]  E. Biddiss,et al.  Active video games to promote physical activity in children and youth: a systematic review. , 2010, Archives of pediatrics & adolescent medicine.

[54]  David M. Pennock,et al.  Categories and Subject Descriptors , 2001 .

[55]  Rafael Bidarra,et al.  In Press: Ieee Transactions on Computational Intelligence and Ai in Games Adaptivity Challenges in Games and Simulations: a Survey , 2022 .

[56]  Conrad S. Tucker,et al.  A quantitative method for evaluating the complexity of implementing and performing game features in physically-interactive gamified applications , 2017, Comput. Hum. Behav..

[57]  Paul Denny,et al.  The effect of virtual achievements on student engagement , 2013, CHI.

[58]  Conrad S. Tucker,et al.  Automatic Facial Feature Extraction for Predicting Designers' Comfort With Engineering Equipment During Prototype Creation , 2017 .

[59]  B. J. Fogg,et al.  A behavior model for persuasive design , 2009, Persuasive '09.

[60]  Erik Marchi,et al.  Asc-inclusion: Interactive Emotion Games for Social Inclusion of Children with Autism Spectrum Conditions , 2022 .

[61]  Antonio P. Gutierrez,et al.  The role of emotion in the learning process: Comparisons between online and face-to-face learning settings , 2012, Internet High. Educ..

[62]  Arindam Sikdar,et al.  Computer-Vision-Guided Human Pulse Rate Estimation: A Review , 2016, IEEE Reviews in Biomedical Engineering.

[63]  Juho Hamari,et al.  Demographic differences in perceived benefits from gamification , 2014, Comput. Hum. Behav..

[64]  Jonathan Tompson,et al.  Towards Accurate Multi-person Pose Estimation in the Wild , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[65]  Pierre Poirier,et al.  Evaluating the Effectiveness of an Affective Tutoring Agent in Specialized Education , 2016, EC-TEL.

[66]  Gilad Ravid,et al.  Personality Based Gamification: How Different Personalities perceive Gamification , 2014, ECIS.

[67]  U. Dimberg,et al.  Facial reactions to emotional stimuli: Automatically controlled emotional responses , 2002 .

[68]  Julian Togelius,et al.  Towards Player Adaptivity in a Serious Game for Conflict Resolution , 2011, 2011 Third International Conference on Games and Virtual Worlds for Serious Applications.