Changes in Learning From Social Feedback After Web-Based Interpretation Bias Modification: Secondary Analysis of a Digital Mental Health Intervention Among Individuals With High Social Anxiety Symptoms

Background Biases in social reinforcement learning, or the process of learning to predict and optimize behavior based on rewards and punishments in the social environment, may underlie and maintain some negative cognitive biases that are characteristic of social anxiety. However, little is known about how cognitive and behavioral interventions may change social reinforcement learning in individuals who are anxious. Objective This study assessed whether a scalable, web-based cognitive bias modification for interpretations (CBM-I) intervention changed social reinforcement learning biases in participants with high social anxiety symptoms. This study focused on 2 types of social reinforcement learning relevant to social anxiety: learning about other people and learning about one’s own social performance. Methods Participants (N=106) completed 2 laboratory sessions, separated by 5 weeks of ecological momentary assessment tracking emotion regulation strategy use and affect. Approximately half (n=51, 48.1%) of the participants completed up to 6 brief daily sessions of CBM-I in week 3. Participants completed a task that assessed social reinforcement learning about other people in both laboratory sessions and a task that assessed social reinforcement learning about one’s own social performance in the second session. Behavioral data from these tasks were computationally modeled using Q-learning and analyzed using mixed effects models. Results After the CBM-I intervention, participants updated their beliefs about others more slowly (P=.04; Cohen d=−0.29) but used what they learned to make more accurate decisions (P=.005; Cohen d=0.20), choosing rewarding faces more frequently. These effects were not observed among participants who did not complete the CBM-I intervention. Participants who completed the CBM-I intervention also showed less-biased updating about their social performance than participants who did not complete the CBM-I intervention, learning similarly from positive and negative feedback and from feedback on items related to poor versus good social performance. Regardless of the intervention condition, participants at session 2 versus session 1 updated their expectancies about others more from rewarding (P=.003; Cohen d=0.43) and less from punishing outcomes (P=.001; Cohen d=−0.47), and they became more accurate at learning to avoid punishing faces (P=.001; Cohen d=0.20). Conclusions Taken together, our results provide initial evidence that there may be some beneficial effects of both the CBM-I intervention and self-tracking of emotion regulation on social reinforcement learning in individuals who are socially anxious, although replication will be important.

[1]  Steven L. Waslander,et al.  Overleaf Example , 2010 .

[2]  Miranda L. Beltzer,et al.  Examining social reinforcement learning in social anxiety. , 2023, Journal of behavior therapy and experimental psychiatry.

[3]  E. Gilboa-Schechtman,et al.  You never get a chance to undo a negative first impression: Social anxiety is associated with impaired positive updating of social information , 2023, Personality and Individual Differences.

[4]  J. Joormann,et al.  Developing a novel assessment of interpretation flexibility: Reliability, validity and clinical implications , 2022, Personality and Individual Differences.

[5]  K. Murayama,et al.  Summary-statistics-based power analysis: A new and practical method to determine sample size for mixed-effects modeling. , 2022, Psychological methods.

[6]  Laura E. Barnes,et al.  Building an emotion regulation recommender algorithm for socially anxious individuals using contextual bandits. , 2021, British Journal of Clinical Psychology.

[7]  M. Browning,et al.  Inducing Affective Learning Biases with Cognitive Training and Prefrontal tDCS: A Proof-of-Concept Study , 2020, Cognitive Therapy and Research.

[8]  Laura E. Barnes,et al.  Emotion Malleability Beliefs and Emotion Experience and Regulation in the Daily Lives of People with High Trait Social Anxiety , 2020, Cognitive Therapy and Research.

[9]  P. Cuijpers,et al.  Efficacy of cognitive bias modification interventions in anxiety and depressive disorders: a systematic review and network meta-analysis. , 2020, The lancet. Psychiatry.

[10]  J. Huppert,et al.  The effects of positive interpretation bias on cognitive reappraisal and social performance: Implications for social anxiety disorder. , 2020, Behaviour research and therapy.

[11]  M. Frank,et al.  Anxiety Impedes Adaptive Social Learning Under Uncertainty , 2020, Psychological science.

[12]  R. Rutledge,et al.  Under the Hood: Using Computational Psychiatry to Make Psychological Therapies More Mechanism-Focused , 2020, Frontiers in Psychiatry.

[13]  Laura E. Barnes,et al.  How Anxious are You Right Now? Using Ecological Momentary Assessment to Evaluate the Effects of Cognitive Bias Modification for Social Threat Interpretations , 2020, Cognitive Therapy and Research.

[14]  Julie Lorah Interpretation of main effects in the presence of non-significant interaction effects , 2020 .

[15]  D. Pizzagalli,et al.  Potent Dopamine D2 Antagonists Block the Reward-Enhancing Effects of Nicotine in Smokers With Schizophrenia. , 2019, Schizophrenia bulletin.

[16]  Stephen C. Adams,et al.  Social Anxiety and Dynamic Social Reinforcement Learning in a Volatile Environment , 2019, Clinical psychological science : a journal of the Association for Psychological Science.

[17]  M. Craske,et al.  The Effects of the Angiotensin II Receptor Antagonist Losartan on Appetitive Versus Aversive Learning: A Randomized Controlled Trial , 2019, Biological Psychiatry.

[18]  Jiming Liu,et al.  Reinforcement Learning in Healthcare: A Survey , 2019, ACM Comput. Surv..

[19]  L. Sharpe,et al.  Cognitive Bias Modification for Social Anxiety: The Differential Impact of Modifying Attentional and/or Interpretation Bias , 2019, Cognitive Therapy and Research.

[20]  J. Gray,et al.  PsychoPy2: Experiments in behavior made easy , 2019, Behavior Research Methods.

[21]  R. Cools,et al.  Emotionally Aversive Cues Suppress Neural Systems Underlying Optimal Learning in Socially Anxious Individuals , 2018, The Journal of Neuroscience.

[22]  Tyrone D. Cannon,et al.  Looking Through Tinted Glasses: Depression and Social Anxiety Are Related to Both Interpretation Biases and Inflexible Negative Interpretations , 2018 .

[23]  R. Dolan,et al.  Computation in Psychotherapy, or How Computational Psychiatry Can Aid Learning-Based Psychological Therapies , 2017, Computational Psychiatry.

[24]  Ambuj Tewari,et al.  Just-in-Time Adaptive Interventions (JITAIs) in Mobile Health: Key Components and Design Principles for Ongoing Health Behavior Support , 2017, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[25]  Sheri L. Johnson,et al.  Explicit and Implicit Reinforcement Learning Across the Psychosis Spectrum , 2017, Journal of abnormal psychology.

[26]  B. Han,et al.  Effects of cognitive bias modification on social anxiety: A meta-analysis , 2017, PloS one.

[27]  D. Pizzagalli,et al.  Dopaminergic Enhancement of Striatal Response to Reward in Major Depression. , 2017, The American journal of psychiatry.

[28]  Rebecca L. Schneider,et al.  Social Anxiety is Characterized by Biased Learning About Performance and the Self , 2017, Emotion.

[29]  Lei Zhang,et al.  Revealing Neurocomputational Mechanisms of Reinforcement Learning and Decision-Making With the hBayesDM Package , 2016, bioRxiv.

[30]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[31]  C. Hermann,et al.  Biases in probabilistic category learning in relation to social anxiety , 2015, Front. Psychol..

[32]  Taiki Takahashi,et al.  Reinforcement learning in depression: A review of computational research , 2015, Neuroscience & Biobehavioral Reviews.

[33]  Aki Vehtari,et al.  Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC , 2015, Statistics and Computing.

[34]  R. Rapee,et al.  Fear of Negative Evaluation Biases Social Evaluation Inference: Evidence from a Probabilistic Learning Task , 2015, PloS one.

[35]  Anthony J Bishara,et al.  Identifying cognitive remediation change through computational modelling--effects on reinforcement learning in schizophrenia. , 2014, Schizophrenia bulletin.

[36]  M. Ullsperger,et al.  Differential Modulation of Reinforcement Learning by D2 Dopamine and NMDA Glutamate Receptor Antagonism , 2014, The Journal of Neuroscience.

[37]  E. Gilboa-Schechtman,et al.  Impression formation and revision in social anxiety disorder. , 2014, Journal of anxiety disorders.

[38]  A. Olsson,et al.  Racial Bias Shapes Social Reinforcement Learning , 2014, Psychological science.

[39]  Catherine E. Myers,et al.  Learning from negative feedback in patients with major depressive disorder is attenuated by SSRI antidepressants , 2013, Front. Integr. Neurosci..

[40]  N. Bolger,et al.  Learning biases underlying individual differences in sensitivity to social rejection. , 2013, Emotion.

[41]  T. Dalgleish,et al.  A Comparison of Cognitive Bias Modification for Interpretation and Computerized Cognitive Behavior Therapy , 2012, Journal of consulting and clinical psychology.

[42]  M. Pessiglione,et al.  Similar Improvement of Reward and Punishment Learning by Serotonin Reuptake Inhibitors in Obsessive-Compulsive Disorder , 2012, Biological Psychiatry.

[43]  T. Sharot The optimism bias , 2011, Current Biology.

[44]  A. M. Ruscio,et al.  A meta-analysis of the effect of cognitive bias modification on anxiety and depression. , 2011, Psychological bulletin.

[45]  B. Teachman,et al.  Post-event processing and memory bias for performance feedback in social anxiety. , 2010, Journal of anxiety disorders.

[46]  Moonseong Heo,et al.  Sample Sizes Required to Detect Two-Way and Three-Way Interactions Involving Slope Differences in Mixed-Effects Linear Models , 2010, Journal of biopharmaceutical statistics.

[47]  Natalie C. Ebner,et al.  FACES—A database of facial expressions in young, middle-aged, and older women and men: Development and validation , 2010, Behavior research methods.

[48]  J. Tanaka,et al.  The NimStim set of facial expressions: Judgments from untrained research participants , 2009, Psychiatry Research.

[49]  P. Dayan Dopamine, reinforcement learning, and addiction. , 2009, Pharmacopsychiatry.

[50]  Michael J. Frank,et al.  Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning , 2007, Proceedings of the National Academy of Sciences.

[51]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[52]  D. Clark,et al.  Information-processing bias in social phobia. , 2004, Clinical psychology review.

[53]  R. Dennis Cook,et al.  Detection of Influential Observation in Linear Regression , 2000, Technometrics.

[54]  R. Mattick,et al.  Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. , 1998, Behaviour research and therapy.

[55]  R. Rapee,et al.  A cognitive-behavioral model of anxiety in social phobia. , 1997, Behaviour research and therapy.

[56]  C. Kirschbaum,et al.  The 'Trier Social Stress Test'--a tool for investigating psychobiological stress responses in a laboratory setting. , 1993, Neuropsychobiology.

[57]  D. Pine,et al.  Statistical learning as a predictor of attention bias modification outcome: A preliminary study among socially anxious patients. , 2019, Behaviour research and therapy.

[58]  P. Cuijpers,et al.  Efficacy of cognitive bias modification interventions in anxiety and depression: meta-analysis. , 2015, The British journal of psychiatry : the journal of mental science.

[59]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.