Serious Games and ML for Detecting MCI

Our work has focused on detecting Mild Cognitive Impairment (MCI) by developing Serious Games (SG) on mobile devices, distinct from games marketed as ‘brain training’ which claim to maintain mental acuity. One game, WarCAT, captures players’ moves during the game to infer processes of strategy recognition, learning, and memory. The purpose of our game is to use the generated game-play data combined with machine learning (ML) to help detect MCI. MCI is difficult to detect for several reasons. Firstly, it is a mild impairment and as such difficult to detect in its early stages, Secondly, it is a subtle impairment for which the brain attempts compensation; as a consequence, it is considered rare in light of normal cognitive decline and the brain’s ability to mask its manifestation. The problem of early MCI detection is further compounded as people have various cognitive acumen which again can lead to false positives which would exacerbate the rare diagnosis still further. To evaluate the conjecture, ML methods are used to generate synthetic data to plausibly emulate a large population of players. Reinforcement Learning (RL) is used to train bots as RL most closely emulates the way humans learn. Considerable trial and error (training) is required, therefore RL bots were developed that process millions of gameplay training patterns and achieve results comparable to the best human performance. This baseline allows us to create bots to emulate individuals at various stages of learning, or conversely, various levels of cognitive decline. The paper demonstrates the ML work to both generate data and subsequently classify different levels of play. This development stage is necessary as part of the larger objective to create SGs that detect MCI.

[1]  Giovanni B. Frisoni,et al.  Clinical trial design of serious gaming in mild cognitive impairment , 2015, Front. Aging Neurosci..

[2]  A. Kramer,et al.  Regional differences in brain volume predict the acquisition of skill in a complex real-time strategy videogame , 2011, Brain and Cognition.

[3]  Marcia R. Friesen,et al.  Machine learning and serious games: opportunities and requirements for detection of mild cognitive impairment , 2018 .

[4]  M. Chignell,et al.  A Serious Game for Clinical Assessment of Cognitive Status: Validation Study , 2016, JMIR serious games.

[5]  Oonagh Thompson,et al.  Examining the Neurocognitive Validity of Commercially Available, Smartphone-Based Puzzle Games , 2012 .

[6]  Tobias Nef,et al.  Evaluation of a novel Serious Game based assessment tool for patients with Alzheimer’s disease , 2017, PloS one.

[7]  R. Petersen,et al.  Mild cognitive impairment , 2006, The Lancet.

[8]  R. Petersen,et al.  Mild cognitive impairment , 2006, The Lancet.

[9]  Pauline E. J. Spaan,et al.  Episodic and semantic memory impairments in (very) early Alzheimer’s disease: The diagnostic accuracy of paired-associate learning formats , 2016 .

[10]  Jörg Drechsler,et al.  An empirical evaluation of easily implemented, nonparametric methods for generating synthetic datasets , 2011, Comput. Stat. Data Anal..

[11]  Robert D. McLeod,et al.  Serious games to assess mild cognitive impairment: ‘The game is the assessment’ , 2018 .

[12]  H. Jimison,et al.  Embedded Assessment Algorithms within Home-Based Cognitive Computer Game Exercises for Elders , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Sarah Verschueren,et al.  Developing Theory-Driven, Evidence-Based Serious Games for Health: Framework Based on Research Community Insights , 2019, JMIR serious games.

[14]  Misha Pavel,et al.  Assessing Executive Function Using a Computer Game: Computational Modeling of Cognitive Processes , 2014, IEEE Journal of Biomedical and Health Informatics.

[15]  Simon McCallum,et al.  Gamification and Serious Games for Personalized Health , 2012, pHealth.