Transfer learning approach for detecting psychological distress in brexit tweets

In 2016, United Kingdom (UK) citizens voted to leave the European Union (EU), which was officially implemented in 2020. During this period, UK residents experienced a great deal of uncertainty around the UK's continued relationship with the EU. Many people have used social media platforms to express their emotions about this critical event. Sentiment analysis has been recently considered as an important tool for detecting mental well-being in Twitter contents. However, detecting the psychological distress status in political related tweets is a challenging task due to the lack of explicit sentences describing the depressive or anxiety status. To address this problem, this paper leverages a transfer learning approach for sentiment analysis to measure the non-clinical psychological distress status in Brexit tweets. The framework transfers the knowledge learnt from self-reported psychological distress tweets (source domain) to detect the distress status in Brexit tweets (target domain). The framework applies a domain adaptation technique to decrease the impact of negative transfer between source and target domains. The paper also introduces a Brexit distress index that can be used to detect levels of psychological distress of individuals in Brexit tweets. We design an experiment that includes data from both domains. The proposed model is able to detect the non-clinical psychological distress status in Brexit tweets with an accuracy of 66% and 62% on the source and target domains, respectively.

[1]  Taulant Guma,et al.  “Where are we going to go now?” European Union migrants' experiences of hostility, anxiety, and (non-)belonging during Brexit , 2018, Population, Space and Place.

[2]  Oksana Smal,et al.  POLITICAL DISCOURSE CONTENT ANALYSIS: A CRITICAL OVERVIEW OF A COMPUTERIZED TEXT ANALYSIS PROGRAM LINGUISTIC INQUIRY AND WORD COUNT (LIWC) , 2020, Naukovì zapiski Nacìonalʹnogo unìversitetu «Ostrozʹka akademìâ». Serìâ «Fìlologìâ».

[3]  Isabell M. Welpe,et al.  Predicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment , 2010, ICWSM.

[4]  Hans-Peter Kriegel,et al.  Integrating structured biological data by Kernel Maximum Mean Discrepancy , 2006, ISMB.

[5]  Koby Crammer,et al.  A theory of learning from different domains , 2010, Machine Learning.

[6]  Abdessalam Bouchekif,et al.  Epita at SemEval-2018 Task 1: Sentiment Analysis Using Transfer Learning Approach , 2018, *SEMEVAL.

[7]  Blesson Varghese,et al.  The royal birth of 2013: Analysing and visualising public sentiment in the UK using Twitter , 2013, 2013 IEEE International Conference on Big Data.

[8]  Lansdall-Welfare Thomas,et al.  Change-Point Analysis of the Public Mood in UK Twitter during the Brexit Referendum , 2016 .

[9]  Mark Dredze,et al.  Quantifying Mental Health Signals in Twitter , 2014, CLPsych@ACL.

[10]  I. Kawachi,et al.  The EU referendum and mental health in the short term: a natural experiment using antidepressant prescriptions in England , 2018, Journal of Epidemiology & Community Health.

[11]  Stefan Scherer,et al.  A Cross-modal Review of Indicators for Depression Detection Systems , 2017, CLPsych@ACL.

[12]  Yan Liu,et al.  Learning with Minimum Supervision: A General Framework for Transductive Transfer Learning , 2011, 2011 IEEE 11th International Conference on Data Mining.

[13]  Mark Dredze,et al.  From ADHD to SAD: Analyzing the Language of Mental Health on Twitter through Self-Reported Diagnoses , 2015, CLPsych@HLT-NAACL.

[14]  William L. Romine,et al.  Multimodal mental health analysis in social media , 2020, PloS one.

[15]  Sharath Chandra Guntuku,et al.  Detecting depression and mental illness on social media: an integrative review , 2017, Current Opinion in Behavioral Sciences.

[16]  Gerard de Melo,et al.  A Helping Hand: Transfer Learning for Deep Sentiment Analysis , 2018, ACL.

[17]  James W. Pennebaker,et al.  Linguistic Inquiry and Word Count (LIWC2007) , 2007 .

[18]  Sophia Ananiadou,et al.  Improving classification of Adverse Drug Reactions through Using Sentiment Analysis and Transfer Learning , 2019, BioNLP@ACL.

[19]  Nello Cristianini,et al.  Analysing Mood Patterns in the United Kingdom through Twitter Content , 2013, ArXiv.

[20]  Miguel A. Vadillo,et al.  Researching Mental Health Disorders in the Era of Social Media: Systematic Review , 2017, Journal of medical Internet research.

[21]  Munmun De Choudhury,et al.  A Social Media Based Index of Mental Well-Being in College Campuses , 2017, CHI.

[22]  Johan Bollen,et al.  Modeling Public Mood and Emotion: Twitter Sentiment and Socio-Economic Phenomena , 2009, ICWSM.

[23]  Mark Dredze,et al.  Shared Task : Depression and PTSD on Twitter , 2015 .

[24]  Ruijun Liu,et al.  A Survey of Sentiment Analysis Based on Transfer Learning , 2019, IEEE Access.

[25]  Virgílio A. F. Almeida,et al.  From bias to opinion: a transfer-learning approach to real-time sentiment analysis , 2011, KDD.

[26]  Dirk Hovy,et al.  Multitask Learning for Mental Health Conditions with Limited Social Media Data , 2017, EACL.

[27]  M. Jofre-Bonet,et al.  The impact of the Great Recession on health-related risk factors, behaviour and outcomes in England. , 2018, Social science & medicine.

[28]  H. Shimodaira,et al.  Improving predictive inference under covariate shift by weighting the log-likelihood function , 2000 .

[29]  Eric Horvitz,et al.  Predicting Depression via Social Media , 2013, ICWSM.

[30]  Abhijit Ghatak,et al.  Machine Learning with R , 2017, Springer Singapore.

[31]  Paolo Rosso,et al.  Irony detection via sentiment-based transfer learning , 2019, Inf. Process. Manag..

[32]  Michael E. Jackson,et al.  Detecting Sadness in 140 Characters: Sentiment Analysis and Mourning Michael Jackson on Twitter , 2009 .

[33]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[34]  Héctor M. Pérez Meana,et al.  A Web Scraping Methodology for Bypassing Twitter API Restrictions , 2018, ArXiv.

[35]  Enkhbold Bataa,et al.  An Investigation of Transfer Learning-Based Sentiment Analysis in Japanese , 2019, ACL.