Test-retest reliability of brain responses to risk-taking during the balloon analogue risk task

The Balloon Analogue Risk Task (BART) provides a reliable and ecologically valid model for the assessment of individual risk-taking propensity and is frequently used in neuroimaging and developmental research. Although the test-retest reliability of risk-taking behavior during the BART is well established, the reliability of brain activation patterns in response to risk-taking during the BART remains elusive. In this study, we used functional magnetic resonance imaging (fMRI) and evaluated the test-retest reliability of brain responses in 34 healthy adults during a modified BART by calculating the intraclass correlation coefficients (ICC) and Dice’s similarity coefficients (DSC). Analyses revealed that risk-induced brain activation patterns showed good test-retest reliability (median ICC = 0.62) and moderate to high spatial consistency, while brain activation patterns associated with win or loss outcomes only had poor to fair reliability (median ICC = 0.33 for win and 0.42 for loss). These findings have important implications for future utility of the BART in fMRI to examine brain responses to risk-taking and decision-making.

[1]  H. Dewit,et al.  Risk taking differences on a behavioral task as a function of potential reward/loss magnitude and individual differences in impulsivity and sensation seeking , 2009, Pharmacology Biochemistry and Behavior.

[2]  Jussi Tohka,et al.  Functional brain segmentation using inter‐subject correlation in fMRI , 2017, Human brain mapping.

[3]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[4]  Simon B. Eickhoff,et al.  One-year test–retest reliability of intrinsic connectivity network fMRI in older adults , 2012, NeuroImage.

[5]  Peter Kirsch,et al.  Test–retest reliability of evoked BOLD signals from a cognitive–emotive fMRI test battery , 2012, NeuroImage.

[6]  Andreas Heinz,et al.  Test–retest reliability of resting-state connectivity network characteristics using fMRI and graph theoretical measures , 2012, NeuroImage.

[7]  R. Kahn,et al.  Efficiency of Functional Brain Networks and Intellectual Performance , 2009, The Journal of Neuroscience.

[8]  J. Mazziotta,et al.  Brain-behavior relationships: evidence from practice effects in spatial stimulus-response compatibility. , 1996, Journal of neurophysiology.

[9]  Michael B. Miller,et al.  How reliable are the results from functional magnetic resonance imaging? , 2010, Annals of the New York Academy of Sciences.

[10]  Christian Grefkes,et al.  Short- and long-term reliability of language fMRI , 2018, NeuroImage.

[11]  R. Kahn,et al.  Brain Activation During Antisaccades in Unaffected Relatives of Schizophrenic Patients , 2006, Biological Psychiatry.

[12]  Diana C. Robertson,et al.  Post-conventional moral reasoning is associated with increased ventral striatal activity at rest and during task , 2017, Scientific Reports.

[13]  Krzysztof J. Gorgolewski,et al.  A high resolution 7-Tesla resting-state fMRI test-retest dataset with cognitive and physiological measures , 2014, Scientific Data.

[14]  X. Zuo,et al.  Test-retest reliabilities of resting-state FMRI measurements in human brain functional connectomics: A systems neuroscience perspective , 2014, Neuroscience & Biobehavioral Reviews.

[15]  Sandeep Mishra,et al.  Personal relative deprivation and risk: An examination of individual differences in personality, attitudes, and behavioral outcomes , 2016 .

[16]  H. Rao,et al.  Differential effects of real versus hypothetical monetary reward magnitude on risk-taking behavior and brain activity , 2018, Scientific Reports.

[17]  Thomas E. Nichols,et al.  A positive-negative mode of population covariation links brain connectivity, demographics and behavior , 2015, Nature Neuroscience.

[18]  C. Lejuez,et al.  Maternal risk taking on the balloon analogue risk task as a prospective predictor of youth alcohol use escalation. , 2015, Addictive behaviors.

[19]  Israel Liberzon,et al.  Habituation of Rostral Anterior Cingulate Cortex to Repeated Emotionally Salient Pictures , 2003, Neuropsychopharmacology.

[20]  Mark E. Bastin,et al.  Single subject fMRI test–retest reliability metrics and confounding factors , 2013, NeuroImage.

[21]  N Jon Shah,et al.  Assessment of reliability in functional imaging studies , 2003, Journal of magnetic resonance imaging : JMRI.

[22]  David J. McGonigle,et al.  Test–retest reliability in fMRI: Or how I learned to stop worrying and love the variability , 2012, NeuroImage.

[23]  A. Gottlob,et al.  Monte-Carlo study , 1998 .

[24]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[25]  Jessica Weafer,et al.  Test-retest reliability of behavioral measures of impulsive choice, impulsive action, and inattention. , 2013, Experimental and clinical psychopharmacology.

[26]  David Ress,et al.  High-resolution functional magnetic resonance imaging methods for human midbrain. , 2012, Journal of visualized experiments : JoVE.

[27]  Stacey B. Daughters,et al.  Reliability and Validity of the Youth Version of the Balloon Analogue Risk Task (BART–Y) in the Assessment of Risk-Taking Behavior Among Inner-City Adolescents , 2007, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[28]  Kent E Hutchison,et al.  Neural mechanisms of risk taking and relationships with hazardous drinking. , 2012, Alcoholism, clinical and experimental research.

[29]  M. Weissman,et al.  Accounting for Dynamic Fluctuations across Time when Examining fMRI Test-Retest Reliability: Analysis of a Reward Paradigm in the EMBARC Study , 2015, PloS one.

[30]  Mike Angstadt,et al.  Test-retest reliability of amygdala response to emotional faces. , 2013, Psychophysiology.

[31]  Steven C. R. Williams,et al.  Measuring fMRI reliability with the intra-class correlation coefficient , 2009, NeuroImage.

[32]  Timothy O. Laumann,et al.  Methods to detect, characterize, and remove motion artifact in resting state fMRI , 2014, NeuroImage.

[33]  Nico Papinutto,et al.  Multisite reliability and repeatability of an advanced brain MRI protocol , 2019, Journal of magnetic resonance imaging : JMRI.

[34]  Diana C. Robertson,et al.  Risk choice and emotional experience: a multi-level comparison between active and passive decision-making , 2019 .

[35]  S. Rombouts,et al.  Test-retest analysis with functional MR of the activated area in the human visual cortex. , 1997, AJNR. American journal of neuroradiology.

[36]  Stephen M. Wilson,et al.  Validity and reliability of four language mapping paradigms , 2016, NeuroImage: Clinical.

[37]  Will M Aklin,et al.  The Balloon Analogue Risk Task (BART) differentiates smokers and nonsmokers. , 2003, Experimental and clinical psychopharmacology.

[38]  Lubin Wang,et al.  Neural correlates of increased risk-taking propensity in sleep-deprived people along with a changing risk level , 2017, Brain Imaging and Behavior.

[39]  Tilo Kircher,et al.  Test-Retest Reliability of fMRI Brain Activity during Memory Encoding , 2013, Front. Psychiatry.

[40]  Karl J. Friston,et al.  Regionally Specific Sensitivity Differences in fMRI and PET: Where Do They Come From? , 2000, NeuroImage.

[41]  S. Rombouts,et al.  Developmental Cognitive Neuroscience How Stable Is Activation in the Amygdala and Prefrontal Cortex in Adolescence? a Study of Emotional Face Processing across Three Measurements , 2022 .

[42]  John A. Detre,et al.  Neural correlates of voluntary and involuntary risk taking in the human brain: An fMRI Study of the Balloon Analog Risk Task (BART) , 2008, NeuroImage.

[43]  N. Maurits,et al.  A Brain-Wide Study of Age-Related Changes in Functional Connectivity. , 2015, Cerebral cortex.

[44]  J. Smyth,et al.  Extending the Balloon Analogue Risk Task to Assess Naturalistic Risk Taking via a Mobile Platform , 2017, Journal of Psychopathology and Behavioral Assessment.

[45]  Nick F. Ramsey,et al.  Test–retest reliability of fMRI activation during prosaccades and antisaccades , 2007, NeuroImage.

[46]  Tyrone D. Cannon,et al.  Predicting risky choices from brain activity patterns , 2014, Proceedings of the National Academy of Sciences.

[47]  V. Glauche,et al.  Test–retest reliability of event-related functional MRI in a probabilistic reversal learning task , 2009, Psychiatry Research: Neuroimaging.

[48]  C. Lejuez,et al.  Construct Validity of the Balloon Analog Risk Task (BART) , 2005, Assessment.

[49]  M. Egan,et al.  Abnormal fMRI response of the dorsolateral prefrontal cortex in cognitively intact siblings of patients with schizophrenia. , 2003, The American journal of psychiatry.

[50]  D M Murray,et al.  A Monte Carlo Study of Alternative Responses To Intraclass Correlation in Community Trials , 1996, Evaluation review.

[51]  Brian Parkinson,et al.  Bursting with anxiety: adult social referencing in an interpersonal balloon analogue risk task (BART). , 2012, Emotion.

[52]  Nick F. Ramsey,et al.  Test–retest variability underlying fMRI measurements , 2012, NeuroImage.

[53]  Yang Zhang,et al.  Decreased modulation by the risk level on the brain activation during decision making in adolescents with internet gaming disorder , 2015, Front. Behav. Neurosci..

[54]  Jonathan D. Power,et al.  Prediction of Individual Brain Maturity Using fMRI , 2010, Science.

[55]  Eva H. Telzer,et al.  Longitudinal Changes in Prefrontal Cortex Activation Underlie Declines in Adolescent Risk Taking , 2015, The Journal of Neuroscience.

[56]  Simon J Graham,et al.  Reliability of Task-Based fMRI for Preoperative Planning: A Test-Retest Study in Brain Tumor Patients and Healthy Controls , 2016, PloS one.

[57]  Marissa A. Gorlick,et al.  Acute Stress Increases Sex Differences in Risk Seeking in the Balloon Analogue Risk Task , 2009, PloS one.

[58]  John Pluta,et al.  Test–retest stability analysis of resting brain activity revealed by blood oxygen level‐dependent functional MRI , 2012, Journal of magnetic resonance imaging : JMRI.

[59]  C. Lejuez,et al.  Individual Differences in Risky Decision Making: A Meta‐analysis of Sensation Seeking and Impulsivity with the Balloon Analogue Risk Task , 2014 .

[60]  W. Shadish,et al.  Empirically supported treatments or type I errors? Problems with the analysis of data from group-administered treatments. , 2005, Journal of consulting and clinical psychology.

[61]  R. Adolphs,et al.  Building a Science of Individual Differences from fMRI , 2016, Trends in Cognitive Sciences.

[62]  C. Lejuez,et al.  Differences in risk-taking propensity across inner-city adolescent ever- and never-smokers. , 2005, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[63]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .

[64]  R. Sperling,et al.  Test-retest reliability of memory task functional magnetic resonance imaging in Alzheimer disease clinical trials. , 2011, Archives of neurology.

[65]  Valerie Kirsch,et al.  Long-term test-retest reliability of resting-state networks in healthy elderly subjects and with amnestic mild cognitive impairment patients. , 2013, Journal of Alzheimer's disease : JAD.

[66]  Paul Coleman,et al.  How I Learned To Stop Worrying , 1987 .

[67]  Tara L. White,et al.  Test-retest characteristics of the Balloon Analogue Risk Task (BART). , 2008, Experimental and clinical psychopharmacology.

[68]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[69]  J. Mumford,et al.  Greater risk sensitivity of dorsolateral prefrontal cortex in young smokers than in nonsmokers , 2013, Psychopharmacology.

[70]  Kevin Murphy,et al.  Deriving the optimal number of events for an event-related fMRI study based on the spatial extent of activation , 2005, NeuroImage.

[71]  C. Ko,et al.  The characteristics of decision making, potential to take risks, and personality of college students with Internet addiction , 2010, Psychiatry Research.

[72]  Peter Fransson,et al.  Can resting‐state functional MRI serve as a complement to task‐based mapping of sensorimotor function? A test–retest reliability study in healthy volunteers , 2011, Journal of magnetic resonance imaging : JMRI.

[73]  David Borsook,et al.  Test–retest reliability of evoked heat stimulation BOLD fMRI , 2015, Journal of Neuroscience Methods.

[74]  Mary E. Meyerand,et al.  Age-Related Differences in Test-Retest Reliability in Resting-State Brain Functional Connectivity , 2012, PloS one.

[75]  Oliver Grimm,et al.  Test–retest reliability of fMRI-based graph theoretical properties during working memory, emotion processing, and resting state , 2014, NeuroImage.

[76]  J. Detre,et al.  Decreased ventral striatal activity with impulse control disorders in Parkinson's disease , 2010, Movement disorders : official journal of the Movement Disorder Society.

[77]  C. Porro,et al.  Assessing denoising strategies to increase signal to noise ratio in spinal cord and in brain cortical and subcortical regions , 2018 .

[78]  Yufeng Zang,et al.  Functional brain hubs and their test–retest reliability: A multiband resting-state functional MRI study , 2013, NeuroImage.

[79]  Xi-Nian Zuo,et al.  Short-term test–retest reliability of resting state fMRI metrics in children with and without attention-deficit/hyperactivity disorder , 2015, Developmental Cognitive Neuroscience.

[80]  Zhe Qu,et al.  Real and hypothetical monetary rewards modulate risk taking in the brain , 2016, Scientific Reports.

[81]  Russell A. Poldrack,et al.  Long-term test–retest reliability of functional MRI in a classification learning task , 2006, NeuroImage.

[82]  Leslie G. Ungerleider,et al.  Functional MRI evidence for adult motor cortex plasticity during motor skill learning , 1995, Nature.

[83]  Jim Mintz,et al.  Conceptualizing impulsivity and risk taking in bipolar disorder: importance of history of alcohol abuse. , 2009, Bipolar disorders.

[84]  T. Yarkoni.  Neurobiological substrates of personality: A critical overview. , 2015 .

[85]  R. Kahn,et al.  Striatal Dysfunction in Schizophrenia and Unaffected Relatives , 2006, Biological Psychiatry.

[86]  Gregory L. Stuart,et al.  Evaluation of a behavioral measure of risk taking: the Balloon Analogue Risk Task (BART). , 2002, Journal of experimental psychology. Applied.

[87]  J. Detre,et al.  Test-retest reliability of cerebral blood flow for assessing brain function at rest and during a vigilance task , 2019, NeuroImage.

[88]  Mary L. Phillips,et al.  Model Specification and the Reliability of fMRI Results: Implications for Longitudinal Neuroimaging Studies in Psychiatry , 2014, PloS one.

[89]  Xi-Nian Zuo,et al.  Individual Variability and Test-Retest Reliability Revealed by Ten Repeated Resting-State Brain Scans over One Month , 2015, PloS one.

[90]  S. Rauch,et al.  Response and Habituation of the Human Amygdala during Visual Processing of Facial Expression , 1996, Neuron.

[91]  Sarah Schwartz,et al.  Analogue Study of Peer Influence on Risk-Taking Behavior in Older Adolescents , 2014, Prevention Science.

[92]  Elizabeth K. Reynolds,et al.  Changes in sensation seeking and risk-taking propensity predict increases in alcohol use among early adolescents. , 2010, Alcoholism, clinical and experimental research.

[93]  Yue-jia Luo,et al.  Neural correlates of Traditional Chinese Medicine induced advantageous risk-taking decision making , 2009, Brain and Cognition.

[94]  Steven D. Beyea,et al.  Thresholds in fMRI studies: Reliable for single subjects? , 2013, Journal of Neuroscience Methods.

[95]  A. V. van Duijvenvoorde,et al.  Longitudinal Changes in Adolescent Risk-Taking: A Comprehensive Study of Neural Responses to Rewards, Pubertal Development, and Risk-Taking Behavior , 2015, The Journal of Neuroscience.

[96]  Sihua Xu,et al.  Assessment of risk-taking and impulsive behaviors: A comparison between three tasks. , 2013, Social behavior and personality.

[97]  T. Sørensen,et al.  A method of establishing group of equal amplitude in plant sociobiology based on similarity of species content and its application to analyses of the vegetation on Danish commons , 1948 .

[98]  David R. Strong,et al.  Construct Validity of the Balloon Analogue Risk Task (BART): Relationship with MDMA Use by Inner-City Drug Users in Residential Treatment , 2006 .

[99]  Edward Vul,et al.  Reply to Comments on “Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition” , 2009, Perspectives on psychological science : a journal of the Association for Psychological Science.

[100]  G McCarthy,et al.  The effects of single-trial averaging upon the spatial extent of fMRI activation , 2001, Neuroreport.

[101]  Will M Aklin,et al.  Evaluation of behavioral measures of risk taking propensity with inner city adolescents. , 2005, Behaviour research and therapy.