BFF: Bayesian, Fiducial, and Frequentist Analysis of Cognitive Engagement among Cognitively Impaired Older Adults

Engagement in cognitively demanding activities is beneficial to preserving cognitive health. Our goal was to demonstrate the utility of frequentist, Bayesian, and fiducial statistical methods for evaluating the robustness of effects in identifying factors that contribute to cognitive engagement for older adults experiencing cognitive decline. We collected a total of 504 observations across two longitudinal waves of data from 28 cognitively impaired older adults. Participants’ systolic blood pressure responsivity, an index of cognitive engagement, was continuously sampled during cognitive testing. Participants reported on physical and mental health challenges and provided hair samples to assess chronic stress at each wave. Using the three statistical paradigms, we compared results from six model testing levels and longitudinal changes in health and stress predicting changes in cognitive engagement. Findings were mostly consistent across the three paradigms, providing additional confidence in determining effects. We extend selective engagement theory to cognitive impairment, noting that health challenges and stress appear to be important moderators. Further, we emphasize the utility of the Bayesian and fiducial paradigms for use with relatively small sample sizes because they are not based on asymptotic distributions. In particular, the fiducial paradigm is a useful tool because it provides more information than p values without the need to specify prior distributions, which may unduly influence the results based on a small sample. We provide the R code used to develop and implement all models.

[1]  Robert B. Gramacy,et al.  Assessing Bayes Factor Surfaces Using Interactive Visualization and Computer Surrogate Modeling , 2018, The American Statistician.

[2]  The Impact of Motivation and Task Difficulty on Resource Engagement: Differential Influences on Cardiovascular Responses of Young and Older Adults. , 2015, Motivation science.

[3]  Claire M. Growney,et al.  Predictors of engagement in young and older adults: The role of specific activity experience. , 2020, Psychology and aging.

[4]  L. Ferrucci,et al.  Longitudinal Change in Cortisol Levels Across the Adult Life Span. , 2019, The journals of gerontology. Series A, Biological sciences and medical sciences.

[5]  Ward Edwards,et al.  Bayesian statistical inference for psychological research. , 1963 .

[6]  Aída Gutiérrez-García,et al.  Cognition and Stress , 2016 .

[7]  N. Lazar,et al.  The ASA Statement on p-Values: Context, Process, and Purpose , 2016 .

[8]  M. J. Bayarri,et al.  Criteria for Bayesian model choice with application to variable selection , 2012, 1209.5240.

[9]  A. Jersild Mental set and shift , 2011 .

[10]  M. Pulopulos,et al.  Hair cortisol and cognitive performance in healthy older people , 2014, Psychoneuroendocrinology.

[11]  Javier M. Buldú,et al.  Permutation Entropy and Statistical Complexity in Mild Cognitive Impairment and Alzheimer’s Disease: An Analysis Based on Frequency Bands , 2020, Entropy.

[12]  D. Sbarra,et al.  Social participation predicts cognitive functioning in aging adults over time: comparisons with physical health, depression, and physical activity , 2017, Aging & mental health.

[13]  Randi C. Martin,et al.  Executive function in older adults: a structural equation modeling approach. , 2008, Neuropsychology.

[14]  Todd Iverson,et al.  Generalized fiducial inference , 2014 .

[15]  Anne M. Scheel,et al.  Improving Inferences about Null Effects with Bayes Factors and Equivalence Tests. , 2018, The journals of gerontology. Series B, Psychological sciences and social sciences.

[16]  Jennifer H. Barnett,et al.  Mental health versus physical health as determinants of cognition in midlife , 2015, Alzheimer's & Dementia.

[17]  T. Hess,et al.  Age differences in the effort and costs associated with cognitive activity. , 2012, The journals of gerontology. Series B, Psychological sciences and social sciences.

[18]  Jan Hannig,et al.  Nonparametric generalized fiducial inference for survival functions under censoring , 2017, Biometrika.

[19]  Claire M. Growney,et al.  The Role of Cognitive Costs, Attitudes About Aging, and Intrinsic Motivation in Predicting Engagement in Everyday Activities , 2018, Psychology and aging.

[20]  C. Kirschbaum,et al.  Stress-related and basic determinants of hair cortisol in humans: A meta-analysis , 2016, Psychoneuroendocrinology.

[21]  T. Patterson,et al.  Effects of chronic stress on memory decline in cognitively normal and mildly impaired older adults. , 2009, The American journal of psychiatry.

[22]  Michael Richter,et al.  Cardiovascular reactivity during performance under social observation: the moderating role of task difficulty. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[23]  T. Hess,et al.  Selective Engagement of Cognitive Resources , 2014, Perspectives on psychological science : a journal of the Association for Psychological Science.

[24]  M. Laudenslager,et al.  Hair Cortisol Analysis: A Promising Biomarker of HPA Activation in Older Adults. , 2015, The Gerontologist.

[25]  John E. Ware,et al.  SF-36 Health Survey. , 1990 .

[26]  F. Molnar,et al.  Emotional impact of dementia diagnosis: Exploring persons with dementia and caregivers’ perspectives , 2007, Aging & mental health.

[27]  J. Yesavage,et al.  Geriatric Depression Scale (GDS): Recent evidence and development of a shorter version. , 1986 .

[28]  Paolo Maria Rossini,et al.  Approximate Entropy of Brain Network in the Study of Hemispheric Differences , 2020, Entropy.

[29]  C. Kirschbaum,et al.  Analysis of cortisol in hair – State of the art and future directions , 2012, Brain, Behavior, and Immunity.

[30]  A. Zellner,et al.  Posterior odds ratios for selected regression hypotheses , 1980 .

[31]  Randy C. S. Lai,et al.  Generalized Fiducial Inference: A Review and New Results , 2016 .

[32]  David R. Bickel,et al.  Bayesian revision of a prior given prior-data conflict, expert opinion, or a similar insight: a large-deviation approach , 2018 .

[33]  Jeffrey N. Rouder,et al.  Computation of Bayes Factors for Common Designs , 2015 .

[34]  S. L. Zabell,et al.  R. A. Fisher and Fiducial Argument , 1992 .

[35]  Michael Evans,et al.  Checking for prior-data conflict , 2006 .

[36]  Cynthia A Berg,et al.  Are older adults less or more physiologically reactive? A meta-analysis of age-related differences in cardiovascular reactivity to laboratory tasks. , 2010, The journals of gerontology. Series B, Psychological sciences and social sciences.

[37]  C. Ferri,et al.  A brief dementia screener suitable for use by non-specialists in resource poor settings—the cross-cultural derivation and validation of the brief Community Screening Instrument for Dementia , 2010, International journal of geriatric psychiatry.

[38]  Bruce S. McEwen,et al.  The neurobiology of stress: from serendipity to clinical relevance. , 2000, Brain research.

[39]  S. Knardahl Cardiovascular psychophysiology , 2000, Annals of medicine.

[40]  Jeffrey N. Rouder,et al.  Default Bayes factors for ANOVA designs , 2012 .

[41]  Jan Hannig,et al.  Generalized fiducial inference for normal linear mixed models , 2012, 1211.1208.

[42]  Matthias G. Arend,et al.  Statistical power in two-level models: A tutorial based on Monte Carlo simulation. , 2019, Psychological methods.

[43]  Jan Hannig,et al.  BFF: Bayesian, Fiducial, Frequentist Analysis of Age Effects in Daily Diary Data. , 2019, The journals of gerontology. Series B, Psychological sciences and social sciences.

[44]  R. Katzman.,et al.  Validation of a short Orientation-Memory-Concentration Test of cognitive impairment. , 1983, The American journal of psychiatry.

[45]  T. Hess,et al.  Linkages Between Resources, Motivation, and Engagement in Everyday Activities , 2017, Motivation science.

[46]  Jennifer Wiley,et al.  What Are the Odds? A Practical Guide to Computing and Reporting Bayes Factors , 2014, J. Probl. Solving.

[47]  Rory A. Fisher,et al.  The concepts of inverse probability and fiducial probability referring to unknown parameters , 1933 .

[48]  Yang Guo,et al.  Measuring and Controlling Bias for Some Bayesian Inferences and the Relation to Frequentist Criteria , 2019, Entropy.

[49]  T. Hess,et al.  Motivation Moderates the Impact of Aging Stereotypes on Effort Expenditure , 2019, Psychology and aging.

[50]  Per B. Brockhoff,et al.  lmerTest Package: Tests in Linear Mixed Effects Models , 2017 .

[51]  T. Hess,et al.  Longitudinal relationships between resources, motivation, and functioning. , 2012, The journals of gerontology. Series B, Psychological sciences and social sciences.

[52]  T. Hess,et al.  The impact of age and motivation on cognitive effort: implications for cognitive engagement in older adulthood. , 2013, Psychology and aging.

[53]  H. Jeffreys An invariant form for the prior probability in estimation problems , 1946, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[54]  Richard D. Morey,et al.  Baysefactor: Computation of Bayes Factors for Common Designs , 2018 .

[55]  Jiqiang Guo,et al.  R Interface to Stan , 2016 .

[56]  Rosalind Walley,et al.  Addressing potential prior‐data conflict when using informative priors in proof‐of‐concept studies , 2016, Pharmaceutical statistics.

[57]  R. K. Caldwell,et al.  Permutation , 2020, Definitions.

[58]  J. Yesavage,et al.  Geriatric Depression Scale—Short Form , 2012 .

[59]  Michael Evans,et al.  Hypothesis Assessment and Inequalities for Bayes Factors and Relative Belief Ratios , 2013 .

[60]  S. Charles Strength and vulnerability integration: a model of emotional well-being across adulthood. , 2010, Psychological bulletin.