Physical Training In-Game Metrics for Cognitive Assessment: Evidence from Extended Trials with the Fitforall Exergaming Platform

Conventional clinical cognitive assessment has its limitations, as evidenced by the environmental shortcomings of various neuropsychological tests conducted away from an older person’s everyday environment. Recent research activities have focused on transferring screening tests to computerized forms, as well as on developing short screening tests for screening large populations for cognitive impairment. The purpose of this study was to present an exergaming platform, which was widely trialed (116 participants) to collect in-game metrics (built-in game performance measures). The potential correlation between in-game metrics and cognition was investigated in-depth by scrutinizing different in-game metrics. The predictive value of high-resolution monitoring games was assessed by correlating it with classical neuropsychological tests; the area under the curve (AUC) in the receiver operating characteristic (ROC) analysis was calculated to determine the sensitivity and specificity of the method for detecting mild cognitive impairment (MCI). Classification accuracy was calculated to be 73.53% when distinguishing between MCI and normal subjects, and 70.69% when subjects with mild dementia were also involved. The results revealed evidence that careful design of serious games, with respect to in-game metrics, could potentially contribute to the early and unobtrusive detection of cognitive decline.

[1]  Valeria Manera,et al.  ‘Kitchen and cooking,’ a serious game for mild cognitive impairment and Alzheimer’s disease: a pilot study , 2015, Front. Aging Neurosci..

[2]  R. Petersen Mild cognitive impairment as a diagnostic entity , 2004, Journal of internal medicine.

[3]  H. Jimison,et al.  Embedded Assessment Algorithms within Home-Based Cognitive Computer Game Exercises for Elders , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Maria Carla Gilardi,et al.  Computerized Neuropsychological Assessment in Aging: Testing Efficacy and Clinical Ecology of Different Interfaces , 2014, Comput. Math. Methods Medicine.

[5]  Sandra L. Calvert,et al.  The promise of exergames as tools to measure physical health , 2011, Entertain. Comput..

[6]  F. Sava,et al.  Virtual reality measures in neuropsychological assessment: a meta-analytic review , 2016, The Clinical neuropsychologist.

[7]  Panagiotis D. Bamidis,et al.  Design, Implementation, and Wide Pilot Deployment of FitForAll: An Easy to use Exergaming Platform Improving Physical Fitness and Life Quality of Senior Citizens , 2016, IEEE Journal of Biomedical and Health Informatics.

[8]  Riccardo Berta,et al.  Assessment in and of Serious Games: An Overview , 2013, Adv. Hum. Comput. Interact..

[9]  Erika R. Carr,et al.  The computerized self test (CST): an interactive, internet accessible cognitive screening test for dementia. , 2010, Journal of Alzheimer's disease : JAD.

[10]  Magda Tsolaki,et al.  Gains in cognition through combined cognitive and physical training: the role of training dosage and severity of neurocognitive disorder , 2015, Front. Aging Neurosci..

[11]  Magda Tsolaki,et al.  Mini Mental State Examination (MMSE): A validation study in Greece , 2000 .

[12]  Zhiqi Shen,et al.  Parkinson ' s Disease Predictive Analytics through a Pad Game Based on Personal Data , 2013 .

[13]  Frederick A. Schmitt,et al.  Improving dementia care: The role of screening and detection of cognitive impairment , 2013, Alzheimer's & Dementia.

[14]  Hardeep Singh,et al.  Missed and Delayed Diagnosis of Dementia in Primary Care: Prevalence and Contributing Factors , 2009, Alzheimer disease and associated disorders.

[15]  Regan L. Mandryk,et al.  Game Dynamics that Support Snacking, not Feasting , 2019, CHI PLAY.

[16]  M. Tsolaki,et al.  Computerized Cognitive Testing for Older Adults , 2015, American journal of Alzheimer's disease and other dementias.

[17]  Daniel Schoene,et al.  A novel video game--based device for measuring stepping performance and fall risk in older people. , 2011, Archives of physical medicine and rehabilitation.

[18]  M. Folstein,et al.  Clinical diagnosis of Alzheimer's disease: Report of the NINCDS—ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer's Disease , 2011, Neurology.

[19]  Misha Pavel,et al.  Assessing Executive Function Using a Computer Game: Computational Modeling of Cognitive Processes , 2014, IEEE Journal of Biomedical and Health Informatics.

[20]  Hirofumi Tanaka,et al.  Age-predicted maximal heart rate revisited. , 2001, Journal of the American College of Cardiology.

[21]  Misha Pavel,et al.  Models of cognitive performance based on home monitoring data , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[22]  Jerrell C. Cassady,et al.  Cognitive Test Anxiety and Academic Performance , 2002 .

[23]  Tobias Nef,et al.  Evaluation of a novel Serious Game based assessment tool for patients with Alzheimer’s disease , 2017, PloS one.

[24]  Ioannis Tarnanas,et al.  Ecological Validity of Virtual Reality Daily Living Activities Screening for Early Dementia: Longitudinal Study , 2013, JMIR serious games.

[25]  Panagiotis D. Bamidis,et al.  Exploring health profiles from physical and cognitive serious game analytics , 2018, 2018 2nd International Conference on Technology and Innovation in Sports, Health and Wellbeing (TISHW).

[26]  A. King,et al.  Physical activity and public health in older adults: recommendation from the American College of Sports Medicine and the American Heart Association. , 2007, Medicine and science in sports and exercise.

[27]  Luis E. Anido-Rifón,et al.  Trends on the application of serious games to neuropsychological evaluation: A scoping review , 2016, J. Biomed. Informatics.

[28]  Daniel Casey,et al.  Cognitive tests for the detection of mild cognitive impairment (MCI), the prodromal stage of dementia: Meta‐analysis of diagnostic accuracy studies , 2018, International journal of geriatric psychiatry.

[29]  Anna Różańska-Kirschke,et al.  The Fullerton Fitness Test as an index of fitness in the elderly Test Fullerton jako miernik sprawności fizycznej osób starszych , 2006 .

[30]  G. Borg Psychophysical bases of perceived exertion. , 1982, Medicine and science in sports and exercise.

[31]  Regan L. Mandryk,et al.  Full-body motion-based game interaction for older adults , 2012, CHI.

[32]  Carmen Castaneda-Sceppa,et al.  Physical activity and public health in older adults: recommendation from the American College of Sports Medicine and the American Heart Association. , 2007, Circulation.

[33]  Maureen Schmitter-Edgecombe,et al.  Improving the ecological validity of executive functioning assessment. , 2006, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[34]  Clifford R. Jack,et al.  Alzheimer's disease diagnosis in individual subjects using structural MR images: Validation studies , 2008, NeuroImage.

[35]  P. Kato,et al.  The Future Value of Serious Games for Assessment: Where Do We Go Now? , 2017 .

[36]  V. Shute,et al.  Melding the Power of Serious Games and Embedded Assessment to Monitor and Foster Learning: Flow and Grow , 2009 .

[37]  R. Mandryk,et al.  Effective Gamification of the Stop-Signal Task: Two Controlled Laboratory Experiments , 2020, JMIR serious games.

[38]  Bruno Vellas,et al.  Recommendations for the use of Serious Games in people with Alzheimer's Disease, related disorders and frailty , 2014, Front. Aging Neurosci..

[39]  Christian Sebastian Loh,et al.  Measuring the (dis-)similarity between expert and novice behaviors as serious games analytics , 2013, Education and Information Technologies.

[40]  E. Konstantinidis,et al.  Towards exergaming commons: composing the exergame ontology for publishing open game data , 2016, Journal of Biomedical Semantics.

[41]  Misha Pavel,et al.  Divided attention in computer game play: Analysis utilizing unobtrusive health monitoring , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[42]  Simon McCallum,et al.  Gamification and Serious Games for Personalized Health , 2012, pHealth.