Supervised Digital Neuropsychological Tests for Cognitive Decline in Older Adults: Usability and Clinical Validity Study

Background Dementia is a major and growing health problem, and early diagnosis is key to its management. Objective With the ultimate goal of providing a monitoring tool that could be used to support the screening for cognitive decline, this study aims to develop a supervised, digitized version of 2 neuropsychological tests: Trail Making Test and Bells Test. The system consists of a web app that implements a tablet-based version of the tests and consists of an innovative vocal assistant that acts as the virtual supervisor for the execution of the test. A replay functionality is added to allow inspection of the user’s performance after test completion. Methods To deploy the system in a nonsupervised environment, extensive functional testing of the platform was conducted, together with a validation of the tablet-based tests. Such validation had the two-fold aim of evaluating system usability and acceptance and investigating the concurrent validity of computerized assessment compared with the corresponding paper-and-pencil counterparts. Results The results obtained from 83 older adults showed high system acceptance, despite the patients’ low familiarity with technology. The system software was successfully validated. A concurrent validation of the system reported good ability of the digitized tests to retain the same predictive power of the corresponding paper-based tests. Conclusions Altogether, the positive results pave the way for the deployment of the system to a nonsupervised environment, thus representing a potential efficacious and ecological solution to support clinicians in the identification of early signs of cognitive decline.

[1]  Marta Romeo,et al.  The MOVECARE Project: Home-based Monitoring of Frailty , 2019, 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[2]  A M Owen,et al.  Computerized assessment in neuropsychiatry using CANTAB: discussion paper. , 1992, Journal of the Royal Society of Medicine.

[3]  L. Gauthier,et al.  The Bells Test: A quantitative and qualitative test for visual neglect. , 1989 .

[4]  Kaarin J Anstey,et al.  Prevalence and determinants of undetected dementia in the community: a systematic literature review and a meta-analysis , 2017, BMJ Open.

[5]  P. Snyder,et al.  Validity of the CogState brief battery: relationship to standardized tests and sensitivity to cognitive impairment in mild traumatic brain injury, schizophrenia, and AIDS dementia complex. , 2009, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[6]  K. Tsoi,et al.  Comparison of Computerized and Paper-and-Pencil Memory Tests in Detection of Mild Cognitive Impairment and Dementia: A Systematic Review and Meta-analysis of Diagnostic Studies. , 2018, Journal of the American Medical Directors Association.

[7]  Florence Pasquier,et al.  Early diagnosis of dementia: neuropsychology , 1999, Journal of Neurology.

[8]  M. Tsolaki,et al.  Computerized Cognitive Testing for Older Adults , 2015, American journal of Alzheimer's disease and other dementias.

[9]  A. Gow,et al.  Older Adults Perceptions of Technology and Barriers to Interacting with Tablet Computers: A Focus Group Study , 2017, Front. Psychol..

[10]  M. Chong,et al.  Preclinical Alzheimer's disease: diagnosis and prediction of progression , 2005, The Lancet Neurology.

[11]  R. Green,et al.  Trail Making Test errors in normal aging, mild cognitive impairment, and dementia. , 2008, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[12]  P. Lapuerta,et al.  Impact of early intervention and disease modification in patients with predementia Alzheimer’s disease: a Markov model simulation , 2011, ClinicoEconomics and outcomes research : CEOR.

[13]  F. Oprescu,et al.  Reducing geriatric outpatient waiting times: Impact of an advanced health practitioner , 2018, Australasian journal on ageing.

[14]  Bilge Mutlu,et al.  Embodiment in Socially Interactive Robots , 2019, Found. Trends Robotics.

[15]  Maureen Schmitter-Edgecombe,et al.  An analysis of a digital variant of the Trail Making Test using machine learning techniques. , 2017, Technology and health care : official journal of the European Society for Engineering and Medicine.

[16]  G. Doniger,et al.  Validity of a short computerized assessment battery for moderate cognitive impairment and dementia , 2010, International Psychogeriatrics.

[17]  A. Korczyn,et al.  Willingness to Use Computerized Systems for the Diagnosis of Dementia: Testing a Theoretical Model in an Israeli Sample , 2012, Alzheimer disease and associated disorders.

[18]  Nicola Basilico,et al.  Validity of digital Trail Making Test and Bells Test in elderlies , 2019, 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[19]  Jin H. Yan,et al.  Alzheimer's disease and mild cognitive impairment deteriorate fine movement control. , 2008, Journal of psychiatric research.

[20]  R. Reitan Validity of the Trail Making Test as an Indicator of Organic Brain Damage , 1958 .

[21]  Amanda Connolly,et al.  Underdiagnosis of dementia in primary care: Variations in the observed prevalence and comparisons to the expected prevalence , 2011, Aging & mental health.

[22]  E. Capitani,et al.  Trail making test: normative values from 287 normal adult controls , 1996, The Italian Journal of Neurological Sciences.

[23]  Kees Dorst,et al.  The core of ‘design thinking’ and its application , 2011 .

[24]  Maureen Schmitter-Edgecombe,et al.  Multicomponent analysis of a digital Trail Making Test , 2017, The Clinical neuropsychologist.

[25]  Maria Carla Gilardi,et al.  Computerized Neuropsychological Assessment in Aging: Testing Efficacy and Clinical Ecology of Different Interfaces , 2014, Comput. Math. Methods Medicine.

[26]  Hiroshi Ishii,et al.  Effect of age and education on the Trail Making Test and determination of normative data for Japanese elderly people: The Tajiri Project , 2006, Psychiatry and clinical neurosciences.

[27]  Jeffrey L. Cummings,et al.  Practicality of a computerized system for cognitive assessment in the elderly , 2008, Alzheimer's & Dementia.

[28]  Maja J. Mataric,et al.  Evaluation of a spatial language interpretation framework for natural human-robot interaction with older adults , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[29]  Marta Romeo,et al.  Evaluating the Acceptability of Assistive Robots for Early Detection of Mild Cognitive Impairment , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[31]  Angelo Cangelosi,et al.  Digitalized Cognitive Assessment mediated by a Virtual Caregiver , 2018, IJCAI.

[32]  Avraham Schweiger,et al.  Validity of a novel computerized cognitive battery for mild cognitive impairment , 2003, BMC geriatrics.

[33]  Gábor Csukly,et al.  Monitoring the Early Signs of Cognitive Decline in Elderly by Computer Games: An MRI Study , 2015, PloS one.

[34]  E. Tangalos,et al.  Mild Cognitive Impairment Clinical Characterization and Outcome , 1999 .

[35]  M. Albert,et al.  Selectivity of executive function deficits in mild cognitive impairment. , 2009, Neuropsychology.

[36]  Manfred Tscheligi,et al.  Exploring voice user interfaces for seniors , 2013, PETRA '13.

[37]  L. Huson,et al.  Performance of Some Correlation Coefficients When Applied to Zero-Clustered Data , 2007 .

[38]  C. Gualtieri,et al.  Reliability and validity of a computerized neurocognitive test battery, CNS Vital Signs. , 2006, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.