The Use of the Integrated Cognitive Assessment (ICA) to Improve the Efficiency of Primary Care Referrals to Memory Services in the Accelerating Dementia Pathway Technologies (ADePT) Study

Background Current primary care cognitive assessment tools are either crude or time-consuming instruments that can only detect cognitive impairment when it is well established. This leads to unnecessary or late referrals to memory services, by which time the disease may have already progressed into more severe stages. Due to the COVID-19 pandemic, some memory services have adapted to the new environment by shifting to remote assessments of patients to meet service user demand. However, the use of remote cognitive assessments has been inconsistent, and there has been little evaluation of the outcome of such a change in clinical practice. Emerging research has highlighted computerised cognitive tests, such as the Integrated Cognitive Assessment (ICA), as the leading candidates for adoption in clinical practice. This is true both during the pandemic and in the post-COVID-19 era as part of healthcare innovation. Objectives The Accelerating Dementias Pathways Technologies (ADePT) Study was initiated in order to address this challenge and develop a real-world evidence basis to support the adoption of ICA as an inexpensive screening tool for the detection of cognitive impairment and improving the efficiency of the dementia care pathway. Methods Ninety-nine patients aged 55-90 who have been referred to a memory clinic by a general practitioner (GP) were recruited. Participants completed the ICA either at home or in the clinic along with medical history and usability questionnaires. The GP referral and ICA outcome were compared with the specialist diagnosis obtained at the memory clinic. Participants were given the option to carry out a retest visit where they were again given the chance to take the ICA test either remotely or face-to-face. Results The primary outcome of the study compared GP referral with specialist diagnosis of MCI/dementia. Of those the GP referred to memory clinics, 78% were necessary referrals, with ~22% unnecessary referrals, or patients who should have been referred to other services as they had disorders other than MCI/dementia. In the same population the ICA was able to correctly identify cognitive impairment in ~90% of patients, with approximately 9% of patients being false negatives. From the subset of unnecessary GP referrals, the ICA classified ~72% of those as not having cognitive impairment, suggesting that these unnecessary referrals may not have been made if the ICA was in use. Conclusions The results from this study demonstrate the potential of the ICA as a screening tool, which can be used to support accurate referrals from primary care settings, along with the work conducted in memory clinics and in secondary care.

[1]  Seyed-Mahdi Khaligh-Razavi,et al.  Health Economic Analysis of the Integrated Cognitive Assessment Tool to Aid Dementia Diagnosis in the United Kingdom , 2022, medRxiv.

[2]  A. Bayer,et al.  Clinical judgment of GPs for the diagnosis of dementia: a diagnostic test accuracy study , 2021, BJGP open.

[3]  D. Aarsland,et al.  Validity and Cultural Generalisability of a 5-Minute AI-Based, Computerised Cognitive Assessment in Mild Cognitive Impairment and Alzheimer's Dementia , 2021, bioRxiv.

[4]  C. Jacova,et al.  Distance Assessment for Detecting Cognitive Impairment in Older Adults: A Systematic Review of Psychometric Evidence , 2020, Dementia and Geriatric Cognitive Disorders.

[5]  Nick C Fox,et al.  Mild Cognitive Impairment: the Manchester consensus , 2020, Age and ageing.

[6]  Dag Aarsland,et al.  Implementing Remote Memory Clinics to Enhance Clinical Care During and After COVID-19 , 2020, Frontiers in Psychiatry.

[7]  C. Kalafatis,et al.  THE INTEGRATED COGNITIVE ASSESSMENT - EMPLOYING ARTIFICIAL INTELLIGENCE FOR THE DETECTION OF COGNITIVE IMPAIRMENT , 2019, Alzheimer's & Dementia.

[8]  Z. Vahabi,et al.  EMPLOYING ARTIFICIAL INTELLIGENCE IN THE DEVELOPMENT OF A SELF-ADMINISTERED, COMPUTERISED COGNITIVE ASSESSMENT FOR THE ASSESSMENT OF NEURODEGENERATION , 2019, Alzheimer's & Dementia.

[9]  Seyed-Mahdi Khaligh-Razavi,et al.  A self-administered, artificial intelligence (AI) platform for cognitive assessment in multiple sclerosis (MS) , 2019, bioRxiv.

[10]  S. Engelborghs,et al.  Brief cognitive screening instruments for early detection of Alzheimer’s disease: a systematic review , 2019, Alzheimer's Research & Therapy.

[11]  K. Langa,et al.  Predictors of dementia misclassification when using brief cognitive assessments , 2018, Neurology. Clinical practice.

[12]  Laisheng Cai,et al.  Neurofilament light chain as a biological marker for multiple sclerosis: a meta-analysis study , 2018, Neuropsychiatric disease and treatment.

[13]  K. Blennow,et al.  Plasma neurofilament light as a potential biomarker of neurodegeneration in Alzheimer’s disease , 2018, Alzheimer's Research & Therapy.

[14]  Seyed-Mahdi Khaligh-Razavi,et al.  Integrated Cognitive Assessment: Speed and Accuracy of Visual Processing as a Reliable Proxy to Cognitive Performance , 2018, bioRxiv.

[15]  Adrian G. Palacios,et al.  Alzheimer's disease in the human eye. Clinical tests that identify ocular and visual information processing deficit as biomarkers , 2014, Alzheimer's & Dementia.

[16]  Brian Barton,et al.  Visual cortex in aging and Alzheimer's disease: changes in visual field maps and population receptive fields , 2012, Front. Psychol..

[17]  H. Vankova Mini Mental State , 2010 .

[18]  S. Sawilowsky New Effect Size Rules of Thumb , 2009 .

[19]  J. Cummings,et al.  The Montreal Cognitive Assessment, MoCA: A Brief Screening Tool For Mild Cognitive Impairment , 2005, Journal of the American Geriatrics Society.

[20]  H. Brodaty,et al.  Characteristics of the GPCOG, a screening tool for cognitive impairment , 2004, International journal of geriatric psychiatry.

[21]  R. Bullock,et al.  Validation of a 6 item cognitive impairment test with a view to primary care usage , 1999, International journal of geriatric psychiatry.

[22]  C. Metz Basic principles of ROC analysis. , 1978, Seminars in nuclear medicine.