Digitally translated Self-Administered Gerocognitive Examination (eSAGE): relationship with its validated paper version, neuropsychological evaluations, and clinical assessments

BackgroundThe original paper Self-Administered Gerocognitive Examination (SAGE) is a valid and reliable cognitive assessment tool used to identify individuals with mild cognitive impairment (MCI) or early dementia. We evaluated identical test questions in a digital format (eSAGE) made for tablet use with the goals of calibrating it against SAGE and establishing its association with other neuropsychological tests and clinical assessments of cognitive impairment.MethodsSubjects aged 50 and over who had taken SAGE were recruited from community and clinic settings. Subjects were randomly selected to participate in a clinical evaluation including neuropsychological evaluations. SAGE and eSAGE were administered using a crossover design. Subjects were identified as dementia, MCI, or normal based on standard clinical criteria. Associations were investigated using Spearman correlations, linear regression, and sensitivity and specificity measures.ResultsOf the 426 subjects screened, 66 completed the evaluation. eSAGE score correlation to a battery of neuropsychological tests was 0.73 (p < 0.0001) with no significant difference between the paper and digital format. Spearman correlation of SAGE versus eSAGE was 0.88 (p < 0.0001), and they are related by the formula: eSAGE score = –1.05 + 0.99 × SAGE score. Since the slope is very close to 1 (p = 0.86) there is strong evidence that the scaling is identical between eSAGE and SAGE, with no scale bias. Overall, eSAGE scores are lower by an average of 1.21 and the decrease is statistically significant (p < 0.0001). For those subjects familiar with smartphones or tablets (one measure of digital proficiency), eSAGE scores are lower by an average of 0.83 points (p = 0.029). With a score 16 and higher being classified as normal, eSAGE had 90% specificity and 71% sensitivity in detecting those with cognitive impairment from normal subjects.ConclusionsTablet-based eSAGE shows a strong association with the validated paper SAGE and a neuropsychological battery. It shows no scale bias compared to SAGE. Both have the advantage of self-administration, brevity, four interchangeable forms, and high sensitivity and specificity in detecting cognitive impairment from normal subjects. Their potential widespread availability will be a major factor in overcoming the many obstacles in identifying early cognitive changes.Trial registrationClinicalTrials.gov, NCT02544074. Registered on 18 March 2015.

[1]  S. Inouye,et al.  Screening for Dementia in the Outpatient Setting: The Time and Change Test , 1998, Journal of the American Geriatrics Society.

[2]  J. Miller,et al.  The clock drawing test is a poor screen for very mild dementia , 2002, Neurology.

[3]  Amy Eschman,et al.  Computer Assessment of Mild Cognitive Impairment , 2009, Postgraduate medicine.

[4]  H. Brodaty,et al.  THE CLOCK DRAWING TEST FOR DEMENTIA OF THE ALZHEIMER'S TYPE: A COMPARISON OF THREE SCORING METHODS IN A MEMORY DISORDERS CLINIC , 1997, International journal of geriatric psychiatry.

[5]  C. Randolph,et al.  The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS): preliminary clinical validity. , 1998, Journal of clinical and experimental neuropsychology.

[6]  Charles Bridges-Webb,et al.  The pathway to dementia diagnosis , 2008, The Medical journal of Australia.

[7]  H. Levin A Compendium of Neuropsychological Tests: Administration, Norms, and Commentary , 1993 .

[8]  M. Gatz,et al.  Pathways to care for Alzheimer's disease among Korean Americans. , 2004, Cultural diversity & ethnic minority psychology.

[9]  S. Teipel,et al.  Subjective memory impairment: No suitable criteria for case-finding of dementia in primary care , 2015, Alzheimer's & dementia.

[10]  P. Maruff,et al.  Intraindividual cognitive decline using a brief computerized cognitive screening test , 2012, Alzheimer's & Dementia.

[11]  Anthony F Jorm,et al.  The Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE): socio-demographic correlates, reliability, validity and some norms , 1989, Psychological Medicine.

[12]  J. Kessler,et al.  DemTect: a new, sensitive cognitive screening test to support the diagnosis of mild cognitive impairment and early dementia , 2004, International journal of geriatric psychiatry.

[13]  H. Brodaty,et al.  The GPCOG: A New Screening Test for Dementia Designed for General Practice , 2002, Journal of the American Geriatrics Society.

[14]  M. Lawton,et al.  Assessment of older people: self-maintaining and instrumental activities of daily living. , 1969, The Gerontologist.

[15]  Gary Naglie,et al.  Feasibility and Validity of the Self-administered Computerized Assessment of Mild Cognitive Impairment With Older Primary Care Patients , 2014, Alzheimer disease and associated disorders.

[16]  M. Elliott,et al.  Physician Recognition of Cognitive Impairment: Evaluating the Need for Improvement , 2004, Journal of the American Geriatrics Society.

[17]  O. Spreen,et al.  A Compendium of Neuropsychological Tests: Administration, Norms, and Commentary , 1991 .

[18]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[19]  J. Cummings,et al.  The Montreal Cognitive Assessment, MoCA: A Brief Screening Tool For Mild Cognitive Impairment , 2005, Journal of the American Geriatrics Society.

[20]  Kathleen N Lohr,et al.  Screening for Dementia in Primary Care: A Summary of the Evidence for the U.S. Preventive Services Task Force , 2003, Annals of Internal Medicine.

[21]  Hardeep Singh,et al.  Missed and Delayed Diagnosis of Dementia in Primary Care: Prevalence and Contributing Factors , 2009, Alzheimer disease and associated disorders.

[22]  Ronald C Petersen,et al.  Comparison of the short test of mental status and the mini-mental state examination in mild cognitive impairment. , 2003, Archives of neurology.

[23]  John Breitner,et al.  Prevalence and classification of mild cognitive impairment in the Cardiovascular Health Study Cognition Study: part 1. , 2003, Archives of neurology.

[24]  M. Farlow,et al.  A 52-Week Study of the Efficacy of Rivastigmine in Patients with Mild to Moderately Severe Alzheimer’s Disease , 2000, European Neurology.

[25]  R. Lipton,et al.  Primary Care Screen for Early Dementia , 2008, Journal of the American Geriatrics Society.

[26]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[27]  John T Chibnall,et al.  Comparison of the Saint Louis University mental status examination and the mini-mental state examination for detecting dementia and mild neurocognitive disorder--a pilot study. , 2006, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[28]  Soo Borson,et al.  Simplifying Detection of Cognitive Impairment: Comparison of the Mini‐Cog and Mini‐Mental State Examination in a Multiethnic Sample , 2005, Journal of the American Geriatrics Society.

[29]  Y. Geda Mild Cognitive Impairment in Older Adults , 2012, Current Psychiatry Reports.

[30]  R. Heaton Wisconsin Card Sorting Test manual , 1993 .

[31]  J. Morris,et al.  Validity and reliability of the AD8 informant interview in dementia , 2006, Neurology.

[32]  J. Hanley,et al.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases. , 1983, Radiology.

[33]  H. Nagaraja,et al.  Community Cognitive Screening Using the Self-Administered Gerocognitive Examination (SAGE). , 2014, The Journal of neuropsychiatry and clinical neurosciences.

[34]  S. Borson,et al.  Improving identification of cognitive impairment in primary care , 2006, International journal of geriatric psychiatry.

[35]  K. Langa,et al.  The diagnosis and management of mild cognitive impairment: a clinical review. , 2014, JAMA.

[36]  V. Valcour,et al.  The detection of dementia in the primary care setting. , 2000, Archives of internal medicine.

[37]  J. Brandt The Hopkins Verbal Learning Test: Development of a new memory test with six equivalent forms. , 1991 .

[38]  E. A. Berg,et al.  A simple objective technique for measuring flexibility in thinking. , 1948, The Journal of general psychology.

[39]  W F Stewart,et al.  Screening for dementia with the Memory Impairment Screen , 1999, Neurology.

[40]  Zahinoor Ismail,et al.  Brief cognitive screening instruments: an update , 2010, International journal of geriatric psychiatry.

[41]  L. Boise,et al.  Diagnosing dementia: perspectives of primary care physicians. , 1999, The Gerontologist.

[42]  S. Borson,et al.  Brief Screening Tests for Dementia , 2002, Canadian journal of psychiatry. Revue canadienne de psychiatrie.

[43]  M. Sano,et al.  An Inventory to Assess Activities of Daily Living for Clinical Trials in Alzheimer's Disease , 1997, Alzheimer disease and associated disorders.

[44]  Jonathan J. Evans,et al.  A review of screening tests for cognitive impairment , 2006, Journal of Neurology, Neurosurgery & Psychiatry.

[45]  Maria Kataki,et al.  Self-administered Gerocognitive Examination (SAGE): A Brief Cognitive Assessment Instrument for Mild Cognitive Impairment (MCI) and Early Dementia , 2010, Alzheimer disease and associated disorders.

[46]  E G Tangalos,et al.  Prevalence of mild cognitive impairment is higher in men , 2010, Neurology.

[47]  Adriana M. Seelye,et al.  Status of computerized cognitive testing in aging: A systematic review , 2008, Alzheimer's & Dementia.

[48]  J. Ashford,et al.  Designing a Brief Alzheimer Screen (BAS). , 2003, Journal of Alzheimer's disease : JAD.

[49]  Kai Ruggeri,et al.  Are We There Yet? Exploring the Impact of Translating Cognitive Tests for Dementia Using Mobile Technology in an Aging Population , 2016, Front. Aging Neurosci..

[50]  V. Hachinski,et al.  Comparison of an Electronic and Paper-based Montreal Cognitive Assessment Tool , 2015, Alzheimer disease and associated disorders.

[51]  E. Kaplan,et al.  The Boston naming test , 2001 .

[52]  R. Ownby,et al.  The Effect of a Memory Screening Program on the Early Diagnosis of Alzheimer Disease , 2005, Alzheimer disease and associated disorders.

[53]  P. Lapuerta,et al.  Impact of early intervention and disease modification in patients with predementia Alzheimer’s disease: a Markov model simulation , 2011, ClinicoEconomics and outcomes research : CEOR.

[54]  J. Morris The Clinical Dementia Rating (CDR) , 1993, Neurology.

[55]  J. H. Steiger Tests for comparing elements of a correlation matrix. , 1980 .

[56]  Ralph H. B. Benedict,et al.  Hopkins Verbal Learning Test—Revised: Normative data and analysis of inter-form and test–retest reliability. , 1998 .

[57]  O. Spreen,et al.  Comprar A Compendium of Neuropsychological Tests - Administration, Norms, and Commentary | Esther Strauss | 9780195159578 | Oxford University Press , 2009 .

[58]  Bruno Dubois,et al.  Screening for Alzheimer’s Disease with the Short Cognitive Evaluation Battery , 2003, Dementia and Geriatric Cognitive Disorders.

[59]  M. Mega,et al.  The Neuropsychiatric Inventory , 1994, Neurology.

[60]  E. Tangalos,et al.  Mild Cognitive Impairment Clinical Characterization and Outcome , 1999 .

[61]  Christopher M. Callahan,et al.  Implementing a screening and diagnosis program for dementia in primary care , 2005, Journal of General Internal Medicine.

[62]  John Young,et al.  A systematic review of the diagnostic test accuracy of brief cognitive tests to detect amnestic mild cognitive impairment , 2016, International journal of geriatric psychiatry.

[63]  H. Brodaty,et al.  What is the best dementia screening instrument for general practitioners to use? , 2005, Alzheimer's & Dementia.

[64]  A. Milne,et al.  Screening for dementia in primary care: a review of the use, efficacy and quality of measures , 2008, International Psychogeriatrics.

[65]  E. Tangalos,et al.  CME Practice parameter: , 2022 .

[66]  R. Hu Diagnostic and Statistical Manual of Mental Disorders (DSM-IV) , 2003 .

[67]  Malaz Boustani,et al.  Alzheimer's Association recommendations for operationalizing the detection of cognitive impairment during the Medicare Annual Wellness Visit in a primary care setting , 2013, Alzheimer's & Dementia.

[68]  Minh Quach,et al.  Screening for mild cognitive impairment (MCI) utilizing combined mini‐mental‐cognitive capacity examinations for identifying dementia prodromes , 2002, International journal of geriatric psychiatry.

[69]  M. Tierney,et al.  Computerized cognitive assessment in primary care to identify patients with suspected cognitive impairment. , 2010, Journal of Alzheimer's disease : JAD.

[70]  M. Bullinger,et al.  The patient with dementia, the caregiver and the doctor: cognition, depression and quality of life from three perspectives , 2008, International journal of geriatric psychiatry.

[71]  H. Kraemer,et al.  Adjusting Mini-Mental State Examination Scores for Age and Educational Level to Screen for Dementia: Correcting Bias or Reducing Validity? , 1998, International Psychogeriatrics.

[72]  Ralph H. B. Benedict,et al.  Hopkins Verbal Learning Test--Revised , 2013 .

[73]  L. Lin,et al.  A concordance correlation coefficient to evaluate reproducibility. , 1989, Biometrics.