Identifying substance use risk based on deep neural networks and Instagram social media data

Social media may provide new insight into our understanding of substance use and addiction. In this study, we developed a deep-learning method to automatically classify individuals’ risk for alcohol, tobacco, and drug use based on the content from their Instagram profiles. In total, 2287 active Instagram users participated in the study. Deep convolutional neural networks for images and long short-term memory (LSTM) for text were used to extract predictive features from these data for risk assessment. The evaluation of our approach on a held-out test set of 228 individuals showed that among the substances we evaluated, our method could estimate the risk of alcohol abuse with statistical significance. These results are the first to suggest that deep-learning approaches applied to social media data can be used to identify potential substance use risk behavior, such as alcohol use. Utilization of automated estimation techniques can provide new insights for the next generation of population-level risk assessment and intervention delivery.

[1]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[2]  Christopher M. Danforth,et al.  Instagram photos reveal predictive markers of depression , 2016, EPJ Data Science.

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  C. Thompson,et al.  College Students’ Drinking and Posting About Alcohol: Forwarding a Model of Motivations, Behaviors, and Consequences , 2016, Journal of health communication.

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Yann LeCun,et al.  Scene parsing with Multiscale Feature Learning, Purity Trees, and Optimal Covers , 2012, ICML.

[7]  Christopher M. Danforth,et al.  Erratum to: Instagram photos reveal predictive markers of depression , 2017, EPJ Data Science.

[8]  M. Beattie,et al.  Interpersonal factors and post-treatment drinking and subjective wellbeing. , 1997, Addiction.

[9]  L. Ungar,et al.  Can Twitter be used to predict county excessive alcohol consumption rates? , 2018, PloS one.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Joon-Kyung Seong,et al.  Machine learning in biomedical engineering , 2018, Biomedical engineering letters.

[12]  Ståle Pallesen,et al.  Sharing of Alcohol-Related Content on Social Networking Sites: Frequency, Content, and Correlates. , 2017, Journal of studies on alcohol and drugs.

[13]  E. S. Pearson,et al.  THE USE OF CONFIDENCE OR FIDUCIAL LIMITS ILLUSTRATED IN THE CASE OF THE BINOMIAL , 1934 .

[14]  Christopher M. Danforth,et al.  Forecasting the onset and course of mental illness with Twitter data , 2016, Scientific Reports.

[15]  Cliff Lampe,et al.  The Benefits of Facebook "Friends: " Social Capital and College Students' Use of Online Social Network Sites , 2007, J. Comput. Mediat. Commun..

[16]  John R. Knight,et al.  Putting the Screen in Screening: Technology-Based Alcohol Screening and Brief Interventions in Medical Settings. , 2014 .

[17]  Yann LeCun,et al.  Learning long‐range vision for autonomous off‐road driving , 2009, J. Field Robotics.

[18]  Louis-Philippe Morency,et al.  OpenFace 2.0: Facial Behavior Analysis Toolkit , 2018, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[19]  Seetha Hari,et al.  Learning From Imbalanced Data , 2019, Advances in Computer and Electrical Engineering.

[20]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[21]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[22]  T. Valente,et al.  Peer influences: the impact of online and offline friendship networks on adolescent smoking and alcohol use. , 2014, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[23]  D. Mozaffarian,et al.  The Preventable Causes of Death in the United States: Comparative Risk Assessment of Dietary, Lifestyle, and Metabolic Risk Factors , 2009, PLoS medicine.

[24]  M. Rubio‐Stipec,et al.  The Alcohol, Smoking and Substance Involvement Screening Test (ASSIST): development, reliability and feasibility. , 2002, Addiction.

[25]  Joseph W. LaBrie,et al.  Different digital paths to the keg? How exposure to peers' alcohol-related social media content influences drinking among male and female first-year college students. , 2016, Addictive behaviors.

[26]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[27]  Chareen Snelson,et al.  Image and video disclosure of substance use on social media websites , 2010, Comput. Hum. Behav..

[28]  Jesse Dallery,et al.  Behavioral Health Care and Technology: Using Science-Based Innovations to Transform Practice , 2014 .

[29]  John R. Knight,et al.  Putting the Screen in Screening , 2014, Alcohol research : current reviews.

[30]  M. Moreno,et al.  Social Drinking on Social Media: Content Analysis of the Social Aspects of Alcohol-Related Posts on Facebook and Instagram , 2018, Journal of medical Internet research.

[31]  Peter Kreiner,et al.  The prescription opioid and heroin crisis: a public health approach to an epidemic of addiction. , 2015, Annual review of public health.

[32]  Marc A Zimmerman,et al.  Permissive norms and young adults' alcohol and marijuana use: the role of online communities. , 2012, Journal of studies on alcohol and drugs.

[33]  M. Moreno,et al.  Influence of Social Media on Alcohol Use in Adolescents and Young Adults , 2014, Alcohol research : current reviews.

[34]  Melissa J. Krauss,et al.  Young Adults' Exposure to Alcohol- and Marijuana-Related Content on Twitter. , 2016, Journal of studies on alcohol and drugs.

[35]  Sara Simblett,et al.  Behavioral health care and technology: using science-based innovations to transform practice , 2017, Journal of mental health.

[36]  Jonathan Ward,et al.  The role of lifestyle in perpetuating substance use disorder: the Lifestyle Balance Model , 2015, Substance Abuse Treatment, Prevention, and Policy.

[37]  John R Knight,et al.  Screening and brief intervention for alcohol and other abuse. , 2014, Adolescent medicine: state of the art reviews.