EDNet: Attention-Based Multimodal Representation for Classification of Twitter Users Related to Eating Disorders

Social media platforms provide rich data sources in several domains. In mental health, individuals experiencing an Eating Disorder (ED) are often hesitant to seek help through conventional healthcare services. However, many people seek help with diet and body image issues on social media. To better distinguish at-risk users who may need help for an ED from those who are simply commenting on ED in social environments, highly sophisticated approaches are required. Assessment of ED risks in such a situation can be done in various ways, and each has its own strengths and weaknesses. Hence, there is a need for and potential benefit of a more complex multimodal approach. To this end, we collect historical tweets, user biographies, and online behaviours of relevant users from Twitter, and generate a reasonably large labelled benchmark dataset. Thereafter, we develop an advanced multimodal deep learning model called EDNet using these data to identify the different types of users with ED engagement (e.g., potential ED sufferers, healthcare professionals, or communicators) and distinguish them from those not experiencing EDs on Twitter. EDNet consists of five deep neural network layers. With the help of its embedding, representation and behaviour modeling layers, it effectively learns the multimodalities of social media. In our experiments, EDNet consistently outperforms all the baseline techniques by significant margins. It achieves an accuracy of up to 94.32% and F1 score of up to 93.91% F1 score. To the best of our knowledge, this is the first such study to propose a multimodal approach for user-level classification according to their engagement with ED content on social media.

[1]  Quan Z. Sheng,et al.  Tracking the Evolution of Clusters in Social Media Streams , 2023, IEEE Transactions on Big Data.

[2]  Maximilien Servajean,et al.  Negatively Correlated Noisy Learners for At-Risk User Detection on Social Networks: A Study on Depression, Anorexia, Self-Harm, and Suicide , 2023, IEEE Transactions on Knowledge and Data Engineering.

[3]  Adrian B. R. Shatte,et al.  EDBase: Generating a Lexicon Base for Eating Disorders Via Social Media , 2022, IEEE Journal of Biomedical and Health Informatics.

[4]  Adrian B. R. Shatte,et al.  Classification of Twitter users with eating disorder engagement: Learning from the biographies , 2022, Comput. Hum. Behav..

[5]  A. Gopalan,et al.  Early Detection of Eating Disorders using Social Media , 2021, 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE).

[6]  Neeraj Kumar,et al.  Privacy-preserving Decentralized Learning Framework for Healthcare System , 2021, ACM Trans. Multim. Comput. Commun. Appl..

[7]  Shreya Ghosh,et al.  Depression Intensity Estimation via Social Media: A Deep Learning Approach , 2021, IEEE Transactions on Computational Social Systems.

[8]  Héctor Alaiz-Moretón,et al.  BERT Model-Based Approach For Detecting Categories of Tweets in the Field of Eating Disorders (ED) , 2021, 2021 IEEE 34th International Symposium on Computer-Based Medical Systems (CBMS).

[9]  Aline Paes,et al.  Screening for Depressed Individuals by Using Multimodal Social Media Data , 2021, AAAI.

[10]  Kush R. Varshney,et al.  Exploring the Efficacy of Generic Drugs in Treating Cancer , 2021, AAAI.

[11]  Ramit Sawhney,et al.  Towards Ordinal Suicide Ideation Detection on Social Media , 2021, WSDM.

[12]  M. Martín-Valdivia,et al.  How Successful Is Transfer Learning for Detecting Anorexia on Social Media? , 2021, Applied Sciences.

[13]  Rui Zhang,et al.  Artificial-Intelligence-Enhanced Mobile System for Cardiovascular Health Management , 2021, Sensors.

[14]  Rui Zhang,et al.  Exploring Eating Disorder Topics on Twitter: Machine Learning Approach , 2020, JMIR medical informatics.

[15]  Xin Wang,et al.  A Knowledge Enhanced Ensemble Learning Model for Mental Disorder Detection on Social Media , 2020, KSEM.

[16]  Stephen P. Lewis,et al.  #recovery: Understanding recovery from the lens of recovery-focused blogs posted by individuals with lived experience. , 2019, The International journal of eating disorders.

[17]  Melissa J. Krauss,et al.  Automatic detection of eating disorder-related social media posts that could benefit from a mental health intervention. , 2019, The International journal of eating disorders.

[18]  Minlong Peng,et al.  Cooperative Multimodal Approach to Depression Detection in Twitter , 2019, AAAI.

[19]  Roie Melamed,et al.  Predicting Breast Cancer by Applying Deep Learning to Linked Health Records and Mammograms. , 2019, Radiology.

[20]  Michael W. Dusenberry,et al.  Learning the Graphical Structure of Electronic Health Records with Graph Convolutional Transformer , 2019, AAAI.

[21]  Diana Ramírez-Cifuentes,et al.  Early Risk Detection of Anorexia on Social Media , 2018, INSCI.

[22]  Yoav Goldberg,et al.  Understanding Convolutional Neural Networks for Text Classification , 2018, BlackboxNLP@EMNLP.

[23]  S. Bauer,et al.  Analyzing big data in social media: Text and network analyses of an eating disorder forum , 2018, The International journal of eating disorders.

[24]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[25]  Geoffrey H. Tison,et al.  DeepHeart: Semi-Supervised Sequence Learning for Cardiovascular Risk Prediction , 2018, AAAI.

[26]  Munmun De Choudhury,et al.  Multimodal Classification of Moderated Online Pro-Eating Disorder Content , 2017, CHI.

[27]  Gregory D. Hager,et al.  Temporal Convolutional Networks: A Unified Approach to Action Segmentation , 2016, ECCV Workshops.

[28]  Alina Arseniev-Koehler,et al.  #Proana: Pro-Eating Disorder Socialization on Twitter. , 2016, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[29]  Munmun De Choudhury,et al.  #thyghgapp: Instagram Content Moderation and Lexical Variation in Pro-Eating Disorder Communities , 2016, CSCW.

[30]  Keiron O'Shea,et al.  An Introduction to Convolutional Neural Networks , 2015, ArXiv.

[31]  Wei Xu,et al.  Bidirectional LSTM-CRF Models for Sequence Tagging , 2015, ArXiv.

[32]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[33]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[34]  Dan J Stein,et al.  Barriers to mental health treatment: results from the WHO World Mental Health surveys , 2013, Psychological Medicine.

[35]  A. Guarda,et al.  Treatment of anorexia nervosa: Insights and obstacles , 2008, Physiology & Behavior.

[36]  Carole E. Chaski,et al.  Empirical evaluations of language-based author identification techniques , 2001 .

[37]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[38]  C. Fairburn,et al.  Assessment of eating disorders: interview or self-report questionnaire? , 1994, The International journal of eating disorders.

[39]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[40]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[41]  A. Kazdin,et al.  Addressing critical gaps in the treatment of eating disorders , 2017, The International journal of eating disorders.

[42]  Simon Haykin,et al.  GradientBased Learning Applied to Document Recognition , 2001 .

[43]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[44]  A. D. Sorosky An overview of eating disorders. , 1986, Adolescent psychiatry.