Speak and you shall predict: speech at initial cocaine abstinence as a biomarker of long-term drug use behavior

Importance Valid biomarkers that can predict longitudinal clinical outcomes at low cost are a holy grail in psychiatric research, promising to ultimately be used to optimize and tailor intervention and prevention efforts. Objective To determine if baseline linguistic markers in natural speech, as compared to non-speech clinical and demographic measures, can predict drug use severity measures at future sessions in initially abstinent individuals with cocaine use disorder (iCUD). Design A longitudinal cohort study (August 2017 – March 2020), where baseline measures were used to predict outcomes collected at three-month intervals for up to one year of follow-up. Participants Eighty-eight initially abstinent iCUD were studied at baseline; 57 (46 male, age 50.7+/-7.9 years) came back for at least another session. Main Outcomes and Measures Outcomes were self-reported symptoms of withdrawal, craving, abstinence duration and frequency of cocaine use in the past 90 days at each study session. The predictors were derived from 5-min recordings of vocal descriptions of the positive consequences of abstinence and the negative consequences of using cocaine; the baseline cocaine and other common drug use measures, demographic and neuropsychological variables were used for comparison. Results Models using the non-speech variables showed the best predictive performance at three(r>0.45, P<2×10-3) and six months follow-up (r>0.37, P<3×10-2). At 12 months, the natural language processing-based model showed significant correlations with withdrawal (r=0.43, P=3×10-2), craving (r=0.72, P=5×10-5), days of abstinence (r=0.76, P=1×10-5), and cocaine use in the past 90 days (r=0.61, P=2×10-3), significantly outperforming the other models for abstinence prediction. Conclusions and Relevance At short time intervals, maximal predictive power was obtained with models that used baseline drug use (in addition to demographic and neuropsychological) measures, potentially reflecting a slow rate of change in these measures, which could be estimated by linear functions. In contrast, short speech samples predicted longer-term changes in drug use, implying deeper penetrance by potentially capturing non-linear dynamics over longer intervals. Results suggest that, compared to the common outcome measures used in clinical trials, speech-based measures could be leveraged as better predictors of longitudinal drug use outcomes in initially abstinent iCUD, as potentially generalizable to other substance use disorders and related comorbidity. Key Points Question Can natural language processing be leveraged to predict longitudinal drug use outcomes in individuals with substance use disorder? Findings In this prospective study that included initially abstinent individuals with cocaine use disorder (iCUD), models using demographics, neuropsychological measures and drug use patterns at baseline were compared to those using minimally structured short natural speech samples relating the positive consequences of abstinence and the negative consequences of using drugs, showing a differential prediction of outcomes measured up to one year later. At three and six months, the former outperformed speech models, including approximately 50% of the variability in craving and 40% in abstinence duration. At 12 months from baseline, speech models were superior, predicting 50% of the variability in abstinence duration. Meaning Speech variables derived through natural language processing can predict clinically meaningful drug use outcome measures in addiction, with greater value at longer intervals. The applicability of language modeling to aid in assessing treatment response and risk in drug addiction warrants further investigation in clinical settings.

[1]  Rita Z. Goldstein,et al.  Whole-brain resting-state connectivity underlying impaired inhibitory control during early versus longer-term abstinence in cocaine addiction , 2023, Molecular Psychiatry.

[2]  Francois R. Lamy,et al.  "Can We Detect Substance Use Disorder?": Knowledge and Time Aware Classification on Social Media from Darkweb , 2023, ArXiv.

[3]  N. Mota,et al.  Speech as a graph: developmental perspectives on the organization of spoken language. , 2023, Biological Psychiatry: Cognitive Neuroscience and Neuroimaging.

[4]  K. Heslin,et al.  Predicting substance use disorder treatment follow-ups and relapse across the continuum of care at a single behavioral health center. , 2023, Journal of substance use and addiction treatment.

[5]  Rita Z. Goldstein,et al.  Emotional Expression on Social Media Support Forums for Substance Cessation: Observational Study of Text-Based Reddit Posts , 2022, Journal of medical Internet research.

[6]  Dmitriy Dligach,et al.  The Evaluation of a Clinical Decision Support Tool Using Natural Language Processing to Screen Hospitalized Adults for Unhealthy Substance Use: Protocol for a Quasi-Experimental Design , 2022, JMIR Research Protocols.

[7]  Kevin A. Hallgren Remotely Assessing Mechanisms of Behavioral Change in Community Substance Use Disorder Treatment to Facilitate Measurement-Informed Care: Pilot Longitudinal Questionnaire Study , 2022, JMIR formative research.

[8]  A. Bui,et al.  Natural Language Processing and Machine Learning to Identify People Who Inject Drugs in Electronic Health Records. , 2022, Open forum infectious diseases.

[9]  A. Bui,et al.  Development and Validation of Machine Models Using Natural Language Processing to Classify Substances Involved in Overdose Deaths , 2022, JAMA network open.

[10]  Rita Z. Goldstein,et al.  Neuropsychoimaging Measures as Alternatives to Drug Use Outcomes in Clinical Trials for Addiction. , 2022, JAMA psychiatry.

[11]  A. Kandasamy,et al.  Self-stigma, hope for future, and recovery: An exploratory study of men with early-onset substance use disorder , 2022, Industrial psychiatry journal.

[12]  K. Bachi,et al.  Using Natural Language Processing of Clinical Notes to Predict Outcomes of Opioid Treatment Program , 2022, 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[13]  A. Lauvsnes,et al.  Predicting Relapse in Substance Use: Prospective Modeling Based on Intensive Longitudinal Data on Mental Health, Cognition, and Craving , 2022, Brain sciences.

[14]  Rita Z. Goldstein,et al.  Cortico-striatal engagement during cue-reactivity, reappraisal, and savoring of drug and non-drug stimuli predicts craving in heroin addiction , 2022, medRxiv.

[15]  M. Churpek,et al.  Development and multimodal validation of a substance misuse algorithm for referral to treatment using artificial intelligence (SMART-AI): a retrospective deep learning study , 2022, The Lancet. Digital health.

[16]  Leping Wang,et al.  How drug cravings affect metacognitive monitoring in methamphetamine abusers. , 2022, Addictive behaviors.

[17]  S. Yip,et al.  Densely sampled neuroimaging for maximizing clinical insight in psychiatric and addiction disorders , 2021, Neuropsychopharmacology.

[18]  Yizhao Ni,et al.  Automated detection of substance use information from electronic health records for a pediatric population , 2021, J. Am. Medical Informatics Assoc..

[19]  Matthew W. Johnson,et al.  Predicting changes in substance use following psychedelic experiences: natural language processing of psychedelic session narratives , 2021, The American journal of drug and alcohol abuse.

[20]  Rita Z. Goldstein,et al.  Attention bias modification in drug addiction: Enhancing control of subsequent habits , 2021, Proceedings of the National Academy of Sciences.

[21]  World Health Organization Quality of Life (WHOQOL) , 2020, A Compendium of Tests, Scales and Questionnaires.

[22]  J. Schneider,et al.  Natural Language Processing of Clinical Notes to Identify Mental Illness and Substance Use Among People Living with HIV: Retrospective Cohort Study , 2020, JMIR medical informatics.

[23]  R. Norel,et al.  Detection of acute 3,4-methylenedioxymethamphetamine (MDMA) effects across protocols using automated natural language processing , 2020, Neuropsychopharmacology.

[24]  Brian D. Kiluk,et al.  Toward Addiction Prediction: An Overview of Cross-Validated Predictive Modeling Findings and Considerations for Future Neuroimaging Research. , 2019, Biological psychiatry. Cognitive neuroscience and neuroimaging.

[25]  Omer Levy,et al.  RoBERTa: A Robustly Optimized BERT Pretraining Approach , 2019, ArXiv.

[26]  Carla Agurto,et al.  Speech Markers for Clinical Assessment of Cocaine Users , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[27]  Justine S. Hastings,et al.  Predicting high-risk opioid prescriptions before they are given , 2019, Proceedings of the National Academy of Sciences.

[28]  Dustin Scheinost,et al.  Connectome-Based Prediction of Cocaine Abstinence. , 2019, The American journal of psychiatry.

[29]  Shimei Pan,et al.  Interpreting Social Media-Based Substance Use Prediction Models with Knowledge Distillation , 2018, 2018 IEEE 30th International Conference on Tools with Artificial Intelligence (ICTAI).

[30]  J. MacKillop,et al.  The neurobiology of impulsivity and substance use disorders: implications for treatment , 2018, Annals of the New York Academy of Sciences.

[31]  V. Calhoun,et al.  Machine Learning of Functional Magnetic Resonance Imaging Network Connectivity Predicts Substance Abuse Treatment Completion. , 2017, Biological psychiatry. Cognitive neuroscience and neuroimaging.

[32]  Sanda M. Harabagiu,et al.  Automatic recognition of symptom severity from psychiatric evaluation records. , 2017, Journal of biomedical informatics.

[33]  Rita Z. Goldstein,et al.  Incubation of Cue-Induced Craving in Adults Addicted to Cocaine Measured by Electroencephalography. , 2016, JAMA psychiatry.

[34]  E. Nunes,et al.  Multimodal predictive modeling of individual treatment outcome in cocaine dependence with combined neuroimaging and behavioral predictors , 2014 .

[35]  V. Calhoun,et al.  Brain Potentials Measured During a Go/NoGo Task Predict Completion of Substance Abuse Treatment , 2014, Biological Psychiatry.

[36]  Adam W. Hanley,et al.  Cognitive and Affective Mechanisms Linking Trait Mindfulness to Craving Among Individuals in Addiction Recovery , 2014, Substance use & misuse.

[37]  Vince D Calhoun,et al.  Reduced fMRI activity predicts relapse in patients recovering from stimulant dependence , 2014, Human brain mapping.

[38]  Kateri McRae,et al.  Functional overlap of top-down emotion regulation and generation: An fMRI study identifying common neural substrates between cognitive reappraisal and cognitively generated emotions , 2014, Cognitive, affective & behavioral neuroscience.

[39]  Y. Shaham,et al.  Neurobiology of the incubation of drug craving , 2011, Trends in Neurosciences.

[40]  Frank Telang,et al.  Impaired insight in cocaine addiction: laboratory evidence and effects on cocaine-seeking behaviour. , 2010, Brain : a journal of neurology.

[41]  Rita Z. Goldstein,et al.  Dopaminergic Response to Drug Words in Cocaine Addiction , 2009, The Journal of Neuroscience.

[42]  L. Clark,et al.  Impulsivity as a vulnerability marker for substance-use disorders: Review of findings from high-risk research, problem gamblers and genetic association studies , 2008, Neuroscience & Biobehavioral Reviews.

[43]  C. Caltagirone,et al.  Unawareness of Illness in Neuropsychiatric Disorders: Phenomenological Certainty versus Etiopathogenic Vagueness , 2008, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[44]  D. Ziedonis,et al.  The validity and reliability of a brief measure of cocaine craving. , 2006, Drug and alcohol dependence.

[45]  Y. Shaham,et al.  Incubation of cocaine craving after withdrawal: a review of preclinical data , 2004, Neuropharmacology.

[46]  Nora D. Volkow,et al.  Severity of neuropsychological impairment in cocaine and alcohol addiction: association with metabolism in the prefrontal cortex , 2004, Neuropsychologia.

[47]  Lin Lu,et al.  Cocaine seeking over extended withdrawal periods in rats: different time courses of responding induced by cocaine cues versus cocaine priming over the first 6 months , 2004, Psychopharmacology.

[48]  Bruce T. Hope,et al.  Neuroadaptation: Incubation of cocaine craving after withdrawal , 2001, Nature.

[49]  A. Alterman,et al.  Reliability and validity of the Cocaine Selective Severity Assessment. , 1998, Addictive behaviors.

[50]  B Powis,et al.  The Severity of Dependence Scale (SDS): psychometric properties of the SDS in English and Australian samples of heroin, cocaine and amphetamine users. , 1995, Addiction.

[51]  福田 博一 State-Trait Anxiety Inventoryによるペインクリニック外来患者の不安の評価 , 1994 .

[52]  B Powis,et al.  Severity of dependence and route of administration of heroin, cocaine and amphetamines. , 1992, British journal of addiction.

[53]  Suzanne V. Blackley,et al.  Using Natural Language Processing and Machine Learning to Identify Hospitalized Patients with Opioid Use Disorder , 2020, AMIA.