Development of a self-administered web-based test for longitudinal cognitive assessment

Sequential testing with brief cognitive tools has been recommended to improve cognitive screening and monitoring, however the few available tools still depend on an external evaluator and periodic visits. We developed a self-administered computerized test intended for longitudinal cognitive testing (Brain on Track). The test can be performed from a home computer and is composed of several subtests, expected to evaluate different cognitive domains, all including random elements to minimize learning effects. An initial (A) and a refined version of the test (B) were applied to patients with mild cognitive impairment or early dementia (n = 88) and age and education-matched controls. A subsample of a population-based cohort (n = 113) performed the test at home every three months to evaluate test-retest reliability. The test’s final version Cronbach’s alpha was 0.90, test scores were significantly different between patients and controls (p = 0.001), the area under the receiver operating characteristic curve was 0.75 and the smallest real difference (43.04) was lower than the clinical relevant difference (56.82). In the test-retest reliability analysis 9/10 subtests showed two-way mixed single intraclass consistency correlation coefficient >0.70. These results imply good internal consistency, discriminative ability and reliability when performed at home, encouraging further longitudinal clinical and population-based studies.

[1]  Adriana M. Seelye,et al.  Status of computerized cognitive testing in aging: A systematic review , 2008, Alzheimer's & Dementia.

[2]  Oecd Ocde Education At A Glance , 2005 .

[3]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[4]  Erika R. Carr,et al.  The computerized self test (CST): an interactive, internet accessible cognitive screening test for dementia. , 2010, Journal of Alzheimer's disease : JAD.

[5]  Joost Dekker,et al.  Community based occupational therapy for patients with dementia and their care givers: randomised controlled trial , 2006, BMJ : British Medical Journal.

[6]  I. Santana,et al.  Montreal Cognitive Assessment (MoCA): Normative study for the Portuguese population , 2011, Journal of clinical and experimental neuropsychology.

[7]  M. Filippi,et al.  Neuropsychological rehabilitation in adult multiple sclerosis , 2010, Neurological Sciences.

[8]  H. Hartung,et al.  Recommendations for a Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) , 2012, Multiple sclerosis.

[9]  T. Mills,et al.  Measuring Health: A Guide to Rating Scales and Questionnaires , 2006 .

[10]  R A Deyo,et al.  Assessing the responsiveness of functional scales to clinical change: an analogy to diagnostic test performance. , 1986, Journal of chronic diseases.

[11]  M. Tierney,et al.  Computerized cognitive assessment in primary care to identify patients with suspected cognitive impairment. , 2010, Journal of Alzheimer's disease : JAD.

[12]  N. Fox,et al.  The Cognition Battery of the NIH Toolbox for Assessment of Neurological and Behavioral Function: Validation in an Adult Sample , 2014, Journal of the International Neuropsychological Society.

[13]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .

[14]  Nathan Herrmann,et al.  Efficacy and safety of cholinesterase inhibitors in Alzheimer's disease: a meta-analysis. , 2003, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[15]  C. Jack,et al.  Mild cognitive impairment – beyond controversies, towards a consensus: report of the International Working Group on Mild Cognitive Impairment , 2004, Journal of internal medicine.

[16]  J. Geddes,et al.  What is a randomised controlled trial? , 2009, Epidemiologia e Psichiatria Sociale.

[17]  C. Terwee,et al.  Quality criteria were proposed for measurement properties of health status questionnaires. , 2007, Journal of clinical epidemiology.

[18]  R. Green,et al.  Screening for cognitive impairment in older individuals. Validation study of a computer-based test. , 1994, Archives of neurology.

[19]  G. Iverson,et al.  Does familiarity with computers affect computerized neuropsychological test performance? , 2009, Journal of clinical and experimental neuropsychology.

[20]  C. Lopes,et al.  Investigating the effect of nonparticipation using a population-based case-control study on myocardial infarction. , 2004, Annals of epidemiology.

[21]  L. Harvill,et al.  Standard Error of Measurement , 1991 .

[22]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[23]  J. Morris The Clinical Dementia Rating (CDR) , 1993, Neurology.

[24]  H. Abdi,et al.  Principal component analysis , 2010 .

[25]  F. Q. Ribeiro The meta-analysis , 2017, Brazilian journal of otorhinolaryngology.

[26]  Virgílio F. Bento,et al.  Web-Based Cognitive Training: Patient Adherence and Intensity of Treatment in an Outpatient Memory Clinic , 2014, Journal of medical Internet research.

[27]  Kirby Gilliland,et al.  Development and quality assurance of computer-based assessment batteries. , 2007, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[28]  Atta Abbas,et al.  DIAGNOSTIC AND STATISTICAL MANUAL OF MENTAL DISORDERS, FIFTH EDITION , 2013 .

[29]  J. Attia,et al.  The Audio Recorded Cognitive Screen (ARCS): a flexible hybrid cognitive test instrument , 2009, Journal of Neurology, Neurosurgery & Psychiatry.

[30]  M. Schmitter-Edgecombe,et al.  Applications of Technology in Neuropsychological Assessment , 2013, The Clinical neuropsychologist.

[31]  M. Tsolaki,et al.  Computerized Cognitive Testing for Older Adults , 2015, American journal of Alzheimer's disease and other dementias.

[32]  Celeste A de Jager,et al.  Detection of MCI in the clinic: evaluation of the sensitivity and specificity of a computerised test battery, the Hopkins Verbal Learning Test and the MMSE. , 2009, Age and ageing.

[33]  Amy Eschman,et al.  Computer Assessment of Mild Cognitive Impairment , 2009, Postgraduate medicine.

[34]  A. Spector,et al.  Cognitive stimulation to improve cognitive functioning in people with dementia. , 2012, The Cochrane database of systematic reviews.

[35]  D. Gladman,et al.  Methods for assessing responsiveness: a critical review and recommendations. , 2000, Journal of clinical epidemiology.

[36]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[37]  A. Milne,et al.  Screening for dementia in primary care: a review of the use, efficacy and quality of measures , 2008, International Psychogeriatrics.

[38]  T. Kaushik,et al.  Development and Validation of a Web-Based Screening Tool for Monitoring Cognitive Status , 2002, The Journal of head trauma rehabilitation.

[39]  E. Tangalos,et al.  CME Practice parameter: , 2022 .

[40]  Klaus P. Ebmeier,et al.  Screening for mild cognitive impairment: a systematic review , 2009, International journal of geriatric psychiatry.

[41]  T. Overend,et al.  A Systematic Review of Screening Tools for Predicting the Development of Dementia , 2012, Canadian Journal on Aging / La Revue canadienne du vieillissement.