Machine learning and serious games: opportunities and requirements for detection of mild cognitive impairment

This perspective paper presents a simple serious game on a mobile platform (Smartphone game). The game has the integrated capability to track a person’s play by storing player metadata on start time, end time, and moves within the game. These data can be analyzed to infer cognitive processes of strategy learning, retention, and recall over a brief period of time for potential future applications in pre-symptomatic assessment of mild cognitive impairment (MCI). Through machine learning (ML), the data are demonstrated to be of utility in providing a “cognitive fingerprint” of play. The ML methods used to classify play use synthetic data generated by robots (bots), ranging from bots playing perfectly to bots playing with various degrees of impairment. The findings include guidance on the volume of data required, as well as the features deemed effective for ML classification of various degrees of bot impairment. The work illustrates several significant considerations when applying ML to simple serious games and the data they can generate.

[1]  E. O. Elliott Estimates of error rates for codes on burst-noise channels , 1963 .

[2]  Misha Pavel,et al.  Assessing Executive Function Using a Computer Game: Computational Modeling of Cognitive Processes , 2014, IEEE Journal of Biomedical and Health Informatics.

[3]  M. Miozzo,et al.  Perseverations in Alzheimer's disease: Memory slips? , 2013, Cortex.

[4]  L L Jacoby,et al.  Separating habit and recollection: memory slips, process dissociations, and probability matching. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[5]  H. Jimison,et al.  Embedded Assessment Algorithms within Home-Based Cognitive Computer Game Exercises for Elders , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  W. Heiss,et al.  Mild Cognitive Impairment (MCI) , 2021, Encyclopedia of Gerontology and Population Aging.

[7]  Tobias Nef,et al.  Evaluation of a novel Serious Game based assessment tool for patients with Alzheimer’s disease , 2017, PloS one.

[8]  Oonagh Thompson,et al.  Examining the Neurocognitive Validity of Commercially Available, Smartphone-Based Puzzle Games , 2012 .

[9]  H. Brodaty,et al.  ALZHEIMER'S DISEASE INTERNATIONAL , 1997, International journal of geriatric psychiatry.

[10]  E. Tangalos,et al.  Mild Cognitive Impairment Clinical Characterization and Outcome , 1999 .

[11]  A. Kramer,et al.  Regional differences in brain volume predict the acquisition of skill in a complex real-time strategy videogame , 2011, Brain and Cognition.

[12]  M. Chignell,et al.  A Serious Game for Clinical Assessment of Cognitive Status: Validation Study , 2016, JMIR serious games.

[13]  F. Leavitt,et al.  Distraction as a key determinant of impaired memory in patients with fibromyalgia. , 2006, The Journal of rheumatology.

[14]  Pauline E. J. Spaan,et al.  Episodic and semantic memory impairments in (very) early Alzheimer’s disease: The diagnostic accuracy of paired-associate learning formats , 2016 .

[15]  C. Ferri,et al.  World Alzheimer Report 2011 : The benefits of early diagnosis and intervention , 2018 .

[16]  Russell A. McCann,et al.  mHealth for mental health: Integrating smartphone technology in behavioral healthcare. , 2011 .

[17]  Erika Nyhus,et al.  The Wisconsin Card Sorting Test and the cognitive assessment of prefrontal executive functions: A critical update , 2009, Brain and Cognition.

[18]  Bruno Vellas,et al.  Recommendations for the use of Serious Games in people with Alzheimer's Disease, related disorders and frailty , 2014, Front. Aging Neurosci..

[19]  C. Jack,et al.  Biomarker Modeling of Alzheimer’s Disease , 2013, Neuron.