Why a clinical trial is as good as its outcome measure: A framework for the selection and use of cognitive outcome measures for clinical trials of Alzheimer’s disease

A crucial aspect of any clinical trial is using the right outcome measure to assess treatment efficacy. Compared to the rapidly evolved understanding and measurement of pathophysiology in preclinical and early symptomatic stages of Alzheimer's disease (AD), relatively less progress has been made in the evolution of clinical outcome assessments (COAs) for those stages. The current paper aims to provide a benchmark for the design and evaluation of COAs for use in early AD trials. We discuss lessons learned on capturing cognitive changes in predementia stages of AD, including challenges when validating novel COAs for those early stages and necessary evidence for their implementation in clinical trials. Moving forward, we propose a multi-step framework to advance the use of more effective COAs to assess clinically meaningful changes in early AD, which will hopefully contribute to the much-needed consensus around more appropriate outcome measures to assess clinical efficacy of putative treatments. HIGHLIGHTS: We discuss lessons learned on capturing cognitive changes in predementia stages of AD. We propose a framework for the design and evaluation of performance based cognitive tests for use in early AD trials. We provide recommendations to facilitate the implementation of more effective cognitive outcome measures in AD trials.

[1]  L. Schneider,et al.  Diversity in Alzheimer's disease drug trials: The importance of eligibility criteria , 2021, Alzheimer's & dementia : the journal of the Alzheimer's Association.

[2]  Minimal important change (MIC): a conceptual clarification and systematic review of MIC estimates of PROMIS measures , 2021, Quality of Life Research.

[3]  A. Fagan,et al.  A trial of gantenerumab or solanezumab in dominantly inherited Alzheimer’s disease , 2021, Nature Medicine.

[4]  W. M. van der Flier,et al.  Finding Treatment Effects in Alzheimer Trials in the Face of Disease Progression Heterogeneity , 2021, Neurology.

[5]  A. Monsch,et al.  Using historical data to facilitate clinical prevention trials in Alzheimer disease? An analysis of longitudinal MCI (mild cognitive impairment) data sets , 2021, Alzheimer's Research & Therapy.

[6]  Christopher J. Weber,et al.  Building clinically relevant outcomes across the Alzheimer's disease spectrum , 2021, Alzheimer's & dementia.

[7]  David T. Jones,et al.  Failure to demonstrate efficacy of aducanumab: An analysis of the EMERGE and ENGAGE trials as reported by Biogen, December 2019 , 2020, Alzheimer's & dementia : the journal of the Alzheimer's Association.

[8]  Keith A. Johnson,et al.  Decline in cognitively complex everyday activities accelerates along the Alzheimer’s disease continuum , 2020, Alzheimer's research & therapy.

[9]  Keith A. Johnson,et al.  Identifying Sensitive Measures of Cognitive Decline at Different Clinical Stages of Alzheimer’s Disease , 2020, Journal of the International Neuropsychological Society.

[10]  S. Gauthier,et al.  Trajectories of decline on instrumental activities of daily living prior to dementia in persons with mild cognitive impairment , 2020, International journal of geriatric psychiatry.

[11]  P. Tariot,et al.  The Alzheimer’s Prevention Initiative Composite Cognitive Test: a practical measure for tracking cognitive decline in preclinical Alzheimer’s disease , 2020, Alzheimer's Research & Therapy.

[12]  L. Schneider,et al.  Composite cognitive and functional measures for early stage Alzheimer's disease trials , 2020, Alzheimer's & dementia.

[13]  Philip S. Insel,et al.  The A4 study: β‐amyloid and cognition in 4432 cognitively unimpaired adults , 2020, Annals of clinical and translational neurology.

[14]  L. Schneider,et al.  Using practice effects for targeted trials or sub-group analysis in Alzheimer’s disease: How practice effects predict change over time , 2020, PloS one.

[15]  P. Scheltens,et al.  Longitudinal Maintenance of Cognitive Health in Centenarians in the 100-plus Study , 2020, JAMA network open.

[16]  D. Rentz,et al.  Commentary on Composite cognitive and functional measures for early stage Alzheimer's disease trials , 2020, Alzheimer's & dementia.

[17]  P. Scheltens,et al.  The Cognitive‐Functional Composite is sensitive to clinical progression in early dementia: Longitudinal findings from the Catch‐Cog study cohort , 2020, Alzheimer's & dementia.

[18]  P. Tariot,et al.  Efficacy and Safety of Lanabecestat for Treatment of Early and Mild Alzheimer Disease , 2019, JAMA neurology.

[19]  Keith A. Johnson,et al.  Clinical meaningfulness of subtle cognitive decline on longitudinal testing in preclinical AD , 2019, Alzheimer's & Dementia.

[20]  M. V. van Tulder,et al.  Measurement properties of performance-based instruments to assess mental function during activity and participation in traumatic brain injury: A systematic review , 2019, Scandinavian journal of occupational therapy.

[21]  P. Scheltens,et al.  The “rights” of precision drug development for Alzheimer’s disease , 2019, Alzheimer's Research & Therapy.

[22]  J. Papma,et al.  Assessment of Visual Association Memory in Low-Educated, Non-Western Immigrants with the Modified Visual Association Test , 2019, Dementia and Geriatric Cognitive Disorders.

[23]  J. Cummings,et al.  Alzheimer's disease drug development pipeline: 2019 , 2019, Alzheimer's & dementia.

[24]  Keith A. Johnson,et al.  THE ASSOCIATION BETWEEN INSTRUMENTAL ACTIVITIES OF DAILY LIVING AND CORTICAL AMYLOID IN COGNITIVELY NORMAL OLDER ADULTS SCREENING FOR THE A4 STUDY , 2019, Alzheimer's & Dementia.

[25]  P. Scheltens,et al.  Assessing cognition and daily function in early dementia using the cognitive-functional composite: findings from the Catch-Cog study cohort , 2019, Alzheimer's Research & Therapy.

[26]  A. Tricco,et al.  Variability in the validity and reliability of outcome measures identified in a systematic review to assess treatment efficacy of cognitive enhancers for Alzheimer’s Dementia , 2019, PloS one.

[27]  P. Tariot,et al.  Randomized Trial of Verubecestat for Prodromal Alzheimer's Disease , 2019, The New England journal of medicine.

[28]  P. Scheltens,et al.  Impairment in complex activities of daily living is related to neurodegeneration in Alzheimer's disease–specific regions , 2019, Neurobiology of Aging.

[29]  Bon Mi Koo,et al.  Mobile Technology for Cognitive Assessment of Older Adults: A Scoping Review , 2019, Innovation in aging.

[30]  Sterling C. Johnson,et al.  Measuring longitudinal cognition: Individual tests versus composites , 2018, Alzheimer's & dementia.

[31]  J. Hassenstab,et al.  The 2018 Revised FDA Guidance for Early Alzheimer’s Disease: Establishing the Meaningfulness of Treatment Effects , 2019, The Journal of Prevention of Alzheimer's Disease.

[32]  D. Na,et al.  Data-driven prognostic features of cognitive trajectories in patients with amnestic mild cognitive impairments , 2019, Alzheimer's Research & Therapy.

[33]  Keith A. Johnson,et al.  Measuring instrumental activities of daily living in non-demented elderly: a comparison of the new performance-based Harvard Automated Phone Task with other functional assessments , 2019, Alzheimer's Research & Therapy.

[34]  Joanne S. Robertson,et al.  Episodic Memory and Learning Dysfunction Over an 18-Month Period in Preclinical and Prodromal Alzheimer's Disease. , 2018, Journal of Alzheimer's disease : JAD.

[35]  E. Liu,et al.  Psychometric Evaluation of the Neuropsychological Test Battery in Individuals with Normal Cognition, Mild Cognitive Impairment, or Mild to Moderate Alzheimer’s Disease: Results from a Longitudinal Study , 2018, The Journal of Prevention of Alzheimer's Disease.

[36]  David B. Fogel,et al.  Factors associated with clinical trials that fail and opportunities for improving the likelihood of success: A review , 2018, Contemporary clinical trials communications.

[37]  P. Scheltens,et al.  Neuropathology and cognitive performance in self-reported cognitively healthy centenarians , 2018, Acta Neuropathologica Communications.

[38]  P. Snyder,et al.  Discontinuation and nonpublication of interventional clinical trials conducted in patients with mild cognitive impairment and Alzheimer's disease , 2018, Alzheimer's & dementia.

[39]  M. Montero‐Odasso,et al.  The Alzheimer’s Disease Assessment Scale–Cognitive Subscale (ADAS-Cog): Modifications and Responsiveness in Pre-Dementia Populations. A Narrative Review , 2018, Journal of Alzheimer's disease : JAD.

[40]  L. B. Mokkink,et al.  COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study , 2018, Quality of Life Research.

[41]  L. Schneider,et al.  The Alzheimer's Prevention Initiative Autosomal-Dominant Alzheimer's Disease Trial: A study of crenezumab versus placebo in preclinical PSEN1 E280A mutation carriers to evaluate efficacy and safety in the treatment of autosomal-dominant Alzheimer's disease, including a placebo-treated noncarrier coh , 2018, Alzheimer's & dementia.

[42]  Denise C. Park,et al.  Measuring cognition and function in the preclinical stage of Alzheimer's disease , 2018, Alzheimer's & dementia.

[43]  M. Mintun,et al.  Trial of Solanezumab for Mild Dementia Due to Alzheimer's Disease , 2018, The New England journal of medicine.

[44]  P. Scheltens,et al.  A novel cognitive-functional composite measure to detect changes in early Alzheimer's disease: Test–retest reliability and feasibility , 2017, Alzheimer's & dementia.

[45]  H. Vet,et al.  COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures , 2017, Quality of Life Research.

[46]  R. Sperling,et al.  Optimizing the preclinical Alzheimer's cognitive composite with semantic processing: The PACC5 , 2017, Alzheimer's & dementia.

[47]  D. Salmon,et al.  Potential implications of practice effects in Alzheimer's disease prevention trials , 2017, Alzheimer's & dementia.

[48]  Keith A. Johnson,et al.  Early and late change on the preclinical Alzheimer's cognitive composite in clinically normal older individuals with elevated amyloid β , 2017, Alzheimer's & Dementia.

[49]  Georgina Charlesworth,et al.  Development of a core outcome set for disease modification trials in mild to moderate dementia: a systematic review, patient and public consultation and consensus recommendations. , 2017, Health technology assessment.

[50]  J. Kaye,et al.  Detecting cognitive changes in preclinical Alzheimer's disease: A review of its feasibility , 2017, Alzheimer's & Dementia.

[51]  Chengjie Xiong,et al.  The DIAN-TU Next Generation Alzheimer's prevention trial: Adaptive design and disease progression model , 2017, Alzheimer's & Dementia.

[52]  Paul S. Aisen,et al.  Cross-validation of optimized composites for preclinical Alzheimer's disease , 2016, Alzheimer's & dementia.

[53]  J. Trojanowski,et al.  Heterogeneity of neuroanatomical patterns in prodromal Alzheimer’s disease: links to cognition, progression and biomarkers , 2016, Brain : a journal of neurology.

[54]  P. Scheltens,et al.  Detecting functional decline from normal aging to dementia: Development and validation of a short version of the Amsterdam IADL Questionnaire , 2016, Alzheimer's & dementia.

[55]  Caroline B. Terwee,et al.  How to select outcome measurement instruments for outcomes included in a “Core Outcome Set” – a practical guideline , 2016, Trials.

[56]  Fabrizio Benedetti,et al.  Increasing uncertainty in CNS clinical trials: the role of placebo, nocebo, and Hawthorne effects , 2016, The Lancet Neurology.

[57]  D. Hill,et al.  Bapineuzumab for mild to moderate Alzheimer’s disease in two global, randomized, phase 3 trials , 2016, Alzheimer's Research & Therapy.

[58]  Jeffrey Cummings,et al.  ADCOMS: a composite clinical outcome for prodromal Alzheimer's disease trials , 2016, Journal of Neurology, Neurosurgery & Psychiatry.

[59]  E. Siemers,et al.  A Combined Measure of Cognition and Function for Clinical Trials: The Integrated Alzheimer's Disease Rating Scale (iADRS). , 2015, The journal of prevention of Alzheimer's disease.

[60]  T. Kaptchuk,et al.  Placebo Effects in Medicine. , 2015, The New England journal of medicine.

[61]  Karen L. Price,et al.  Cognitive Impairment Precedes and Predicts Functional Impairment in Mild Alzheimer’s Disease , 2015, Journal of Alzheimer's disease : JAD.

[62]  A. Lockhart,et al.  A 24-week study to evaluate the effect of rilapladib on cognition and cerebrospinal fluid biomarkers of Alzheimer's disease , 2015, Alzheimer's & dementia.

[63]  J. Morris,et al.  Absence of practice effects in preclinical Alzheimer's disease. , 2015, Neuropsychology.

[64]  W. M. van der Flier,et al.  Prevalence and prognosis of Alzheimer's disease at the mild cognitive impairment stage. , 2015, Brain : a journal of neurology.

[65]  P. Tariot,et al.  Establishing Composite Cognitive Endpoints for Use in Preclinical Alzheimer's Disease Trials. , 2015, The journal of prevention of Alzheimer's disease.

[66]  Keith A. Johnson,et al.  The Evolution of Preclinical Alzheimer’s Disease: Implications for Prevention Trials , 2014, Neuron.

[67]  Richard J. Caselli,et al.  Assessing cognition and function in Alzheimer's disease clinical trials: Do we have the right tools? , 2014, Alzheimer's & Dementia.

[68]  Kewei Chen,et al.  An empirically derived composite cognitive test score with improved power to track and evaluate treatments for preclinical Alzheimer's disease , 2014, Alzheimer's & Dementia.

[69]  R. Sperling,et al.  The preclinical Alzheimer cognitive composite: measuring amyloid-related decline. , 2014, JAMA neurology.

[70]  A. Fleisher,et al.  The Alzheimer's prevention initiative composite cognitive test score: sample size estimates for the evaluation of preclinical Alzheimer's disease treatments in presenilin 1 E280A mutation carriers. , 2014, The Journal of clinical psychiatry.

[71]  P. Annas,et al.  Psychometric evaluation of ADAS‐Cog and NTB for measuring drug response , 2014, Acta neurologica Scandinavica.

[72]  Yaakov Stern,et al.  Promising developments in neuropsychological approaches for the detection of preclinical Alzheimer’s disease: a selective review , 2013, Alzheimer's Research & Therapy.

[73]  V. Pankratz,et al.  Practice Effects and Longitudinal Cognitive Change in Normal Aging vs. Incident Mild Cognitive Impairment and Dementia in The Mayo Clinic Study of Aging , 2013, The Clinical neuropsychologist.

[74]  B. Dubois,et al.  Measuring cognitive change in subjects with prodromal Alzheimer's disease , 2013, Journal of Neurology, Neurosurgery & Psychiatry.

[75]  M. W. van Eijck,et al.  Empirical validation of characteristics of design-based learning in higher education , 2013 .

[76]  P. Scheltens,et al.  A new informant-based questionnaire for instrumental activities of daily living in dementia , 2012, Alzheimer's & Dementia.

[77]  D. Tranel,et al.  Scoring Higher the Second Time Around: Meta-Analyses of Practice Effects in Neuropsychological Assessment , 2012, The Clinical neuropsychologist.

[78]  D. A. Gold,et al.  An examination of instrumental activities of daily living assessment in older adults and mild cognitive impairment , 2012, Journal of clinical and experimental neuropsychology.

[79]  Nick C Fox,et al.  The diagnosis of mild cognitive impairment due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[80]  Denise C. Park,et al.  Toward defining the preclinical stages of Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[81]  B. Hermann,et al.  Latent structure and factorial invariance of a neuropsychological test battery for the study of preclinical Alzheimer's disease. , 2010, Neuropsychology.

[82]  Jeremy C Hobart,et al.  The ADAS-cog in Alzheimer's disease clinical trials: psychometric evaluation of the sum and its parts , 2010, Journal of Neurology, Neurosurgery & Psychiatry.

[83]  C. Terwee,et al.  The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. , 2010, Journal of clinical epidemiology.

[84]  Mary Sano,et al.  Current Alzheimer's disease clinical trials: Methods and placebo outcomes , 2009, Alzheimer's & Dementia.

[85]  C. Cook Clinimetrics Corner: The Minimal Clinically Important Change Score (MCID): A Necessary Pretense , 2008, The Journal of manual & manipulative therapy.

[86]  B. Winblad,et al.  Safety and efficacy of galantamine in subjects with mild cognitive impairment , 2008, Neurology.

[87]  J. Blazeby,et al.  PATIENT-REPORTED OUTCOMES , 2023 .

[88]  Eric D. Heggestad,et al.  An examination of psychometric bias due to retesting on cognitive ability tests in selection settings. , 2007, The Journal of applied psychology.

[89]  Kevin J Black,et al.  The cognitive correlates of functional status: a review from the Committee on Research of the American Neuropsychiatric Association. , 2007, The Journal of neuropsychiatry and clinical neurosciences.

[90]  D. Harvey,et al.  Cognitive and neuroimaging predictors of instrumental activities of daily living , 2007, Journal of the International Neuropsychological Society.

[91]  Anna Agranovich,et al.  Do Russian and American normal adults perform similarly on neuropsychological tests? Preliminary findings on the relationship between culture and test performance. , 2007, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[92]  K. Boone,et al.  The association between neuropsychological scores and ethnicity, language, and acculturation variables in a large patient population. , 2007, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[93]  P. Maruff,et al.  Practice Effects Associated with the Repeated Assessment of Cognitive Function Using the CogState Battery at 10-minute, One Week and One Month Test-retest Intervals , 2006, Journal of clinical and experimental neuropsychology.

[94]  A. Brickman,et al.  Ethical Issues in Cross-Cultural Neuropsychology , 2006, Applied neuropsychology.

[95]  Nick C Fox,et al.  Clinical effects of Aβ immunization (AN1792) in patients with AD in an interrupted trial , 2005, Neurology.

[96]  J. Manly Advantages and Disadvantages of Separate Norms for African Americans , 2005, The Clinical neuropsychologist.

[97]  Linda Wetzel,et al.  Development and assessment of a neuropsychological battery to aid in predicting driving performance. , 2002, Journal of rehabilitation research and development.

[98]  Y. Stern,et al.  Reading level attenuates differences in neuropsychological test performance between African American and White elders , 2002, Journal of the International Neuropsychological Society.

[99]  H. Westervelt,et al.  Serial neuropsychological assessment with the National Institute of Mental Health (NIMH) AIDS Abbreviated Neuropsychological Battery. , 2001, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[100]  Martin R. Farlow,et al.  A controlled trial of tacrine in Alzheimer's disease. The Tacrine Study Group. , 1992, JAMA.

[101]  R F Woolson,et al.  A double-blind, placebo-controlled multicenter study of tacrine for Alzheimer's disease. The Tacrine Collaborative Study Group. , 1992, The New England journal of medicine.

[102]  K. Davis,et al.  A new rating scale for Alzheimer's disease. , 1984, The American journal of psychiatry.

[103]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.