Examining the Negative Sentiments Related to Influenza Vaccination from 2017 to 2022: An Unsupervised Deep Learning Analysis of 261,613 Twitter Posts

Several countries are witnessing significant increases in influenza cases and severity. Despite the availability, effectiveness and safety of influenza vaccination, vaccination coverage remains suboptimal globally. In this study, we examined the prevailing negative sentiments related to influenza vaccination via a deep learning analysis of public Twitter posts over the past five years. We extracted original tweets containing the terms ‘flu jab’, ‘#flujab’, ‘flu vaccine’, ‘#fluvaccine’, ‘influenza vaccine’, ‘#influenzavaccine’, ‘influenza jab’, or ‘#influenzajab’, and posted in English from 1 January 2017 to 1 November 2022. We then identified tweets with negative sentiment from individuals, and this was followed by topic modelling using machine learning models and qualitative thematic analysis performed independently by the study investigators. A total of 261,613 tweets were analyzed. Topic modelling and thematic analysis produced five topics grouped under two major themes: (1) criticisms of governmental policies related to influenza vaccination and (2) misinformation related to influenza vaccination. A significant majority of the tweets were centered around perceived influenza vaccine mandates or coercion to vaccinate. Our analysis of temporal trends also showed an increase in the prevalence of negative sentiments related to influenza vaccination from the year 2020 onwards, which possibly coincides with misinformation related to COVID-19 policies and vaccination. There was a typology of misperceptions and misinformation underlying the negative sentiments related to influenza vaccination. Public health communications should be mindful of these findings.

[1]  S. Alshahrani,et al.  Prevalence and Predictors of Seasonal Influenza Vaccine Uptake in Saudi Arabia Post COVID-19: A Web-Based Online Cross-Sectional Study , 2023, Vaccines.

[2]  P. Sourtzi,et al.  Predictors of Seasonal Influenza Vaccination Willingness among High-Risk Populations Three Years after the Onset of the COVID-19 Pandemic , 2023, Vaccines.

[3]  A. Wagner,et al.  Spillover of Vaccine Hesitancy into Adult COVID-19 and Influenza: The Role of Race, Religion, and Political Affiliation in the United States , 2023, International journal of environmental research and public health.

[4]  R. Vardavas,et al.  Association of COVID-19 Vaccination With Influenza Vaccine History and Changes in Influenza Vaccination , 2022, JAMA Network Open.

[5]  K. Fleischmann,et al.  Misinformation and COVID-19 vaccine hesitancy , 2022, Vaccine.

[6]  E. Lau,et al.  Prediction of upcoming global infection burden of influenza seasons after relaxation of public health and social measures during the COVID-19 pandemic: a modelling study , 2022, The Lancet Global Health.

[7]  M. Horowitz The Vaccine-Hesitant Moment , 2022, The New England journal of medicine.

[8]  P. Catellani,et al.  Counterfactual thinking as a prebunking strategy to contrast misinformation on COVID-19 , 2022, Journal of Experimental Social Psychology.

[9]  Q. Ng,et al.  Examining the Prevailing Negative Sentiments Related to COVID-19 Vaccination: Unsupervised Deep Learning of Twitter Posts over a 16 Month Period , 2022, Vaccines.

[10]  S. Lewandowsky,et al.  Psychological inoculation improves resilience against misinformation on social media , 2022, Science advances.

[11]  Susana Salgado,et al.  Discourses about Fake News, Conspiracies and Counterknowledge in Spain , 2022, Western Journal of Communication.

[12]  N. Jackson,et al.  Association between Covid-19 Vaccination and Influenza Vaccination Rates , 2022, The New England journal of medicine.

[13]  Mark Heitmann,et al.  More than a Feeling: Accuracy and Application of Sentiment Analysis , 2022, International Journal of Research in Marketing.

[14]  M. Coffee,et al.  Exploring Coronavirus Disease 2019 Vaccine Hesitancy on Twitter Using Sentiment Analysis and Natural Language Processing Algorithms. , 2022, Clinical Infectious Diseases.

[15]  Y. Jo,et al.  Trends in Influenza Vaccination Rates in Participants With Airflow Limitation: The Korea National Health and Nutrition Examination Survey 2007–2018 , 2022, Frontiers in Medicine.

[16]  M. Grootendorst BERTopic: Neural topic modeling with a class-based TF-IDF procedure , 2022, ArXiv.

[17]  Jun Liu,et al.  Social Bots’ Involvement in the COVID-19 Vaccine Discussions on Twitter , 2022, International journal of environmental research and public health.

[18]  Jingjing Yi,et al.  Depicting the Emotion Flow: Super-Spreaders of Emotional Messages on Weibo During the COVID-19 Pandemic , 2022, Social Media + Society.

[19]  M. R. Hassan,et al.  Impact of Social Distancing on COVID-19 and Other Related Infectious Disease Transmission: A Systematic Review , 2021, Open Access Macedonian Journal of Medical Sciences.

[20]  C. Lengacher,et al.  The Role of Influential Actors in Fostering the Polarized COVID-19 Vaccine Discourse on Twitter: Mixed Methods of Machine Learning and Inductive Coding , 2021, JMIR infodemiology.

[21]  K. Jamieson,et al.  Conspiratorial thinking, selective exposure to conservative media, and response to COVID-19 in the US , 2021, Social Science & Medicine.

[22]  H. Boomgaarden,et al.  What Does Fake Look Like? A Review of the Literature on Intentional Deception in the News and on Social Media , 2021, Journalism Studies.

[23]  M. Van der Hoeven,et al.  Worldwide Vaccination Willingness for COVID-19: A Systematic Review and Meta-Analysis , 2021, Vaccines.

[24]  L. Grohskopf,et al.  Prevention and Control of Seasonal Influenza with Vaccines: Recommendations of the Advisory Committee on Immunization Practices, United States, 2021–22 Influenza Season , 2021, MMWR. Recommendations and reports : Morbidity and mortality weekly report. Recommendations and reports.

[25]  Karam Abdulahhad,et al.  Changes in Twitter geolocations: Insights and suggestions for future usage , 2021, WNUT.

[26]  L. Cervi,et al.  Populism, Twitter, and COVID-19: Narrative, Fantasies, and Desires , 2021, Social Sciences.

[27]  I. Basheti,et al.  A high rate of COVID-19 vaccine hesitancy in a large-scale survey on Arabs , 2021, eLife.

[28]  Matthew R. DeVerna,et al.  Online misinformation is linked to early COVID-19 vaccination hesitancy and refusal , 2021, Scientific Reports.

[29]  A. Daughton,et al.  “Thought I’d Share First” and Other Conspiracy Theory Tweets from the COVID-19 Infodemic: Exploratory Study , 2021, JMIR public health and surveillance.

[30]  A. Daughton,et al.  "Thought I'd Share First": An Analysis of COVID-19 Conspiracy Theories and Misinformation Spread on Twitter. , 2021, JMIR public health and surveillance.

[31]  Andrew M. Parker,et al.  Mental associations with COVID-19 and how they relate with self-reported protective behaviors: A national survey in the United States , 2021, Social Science & Medicine.

[32]  E. Woo,et al.  Postmarketing safety surveillance of quadrivalent recombinant influenza vaccine: Reports to the vaccine adverse event reporting system. , 2021, Vaccine.

[33]  B. Parkinson,et al.  Negativity Spreads More than Positivity on Twitter After Both Positive and Negative Political Situations , 2021, Affective Science.

[34]  Filippo Menczer,et al.  The COVID-19 Infodemic: Twitter versus Facebook , 2020, Big Data Soc..

[35]  Emily S. Rempel,et al.  Tracking COVID-19 Discourse on Twitter in North America: Infodemiology Study Using Topic Modeling and Aspect-Based Sentiment Analysis , 2020, Journal of medical Internet research.

[36]  S. van der Linden,et al.  Inoculating Against Fake News About COVID-19 , 2020, Frontiers in Psychology.

[37]  David A. Broniatowski,et al.  Not just conspiracy theories: Vaccine opponents and proponents add to the COVID-19 ‘infodemic’ on Twitter , 2020, Harvard Kennedy School misinformation review.

[38]  P. Kuhn,et al.  Modeling the Onset of Symptoms of COVID-19 , 2020, Frontiers in Public Health.

[39]  Catey Bunce,et al.  World leaders’ usage of Twitter in response to the COVID-19 pandemic: a content analysis , 2020, Journal of public health.

[40]  Nathan Walter,et al.  A Meta-Analytic Examination of the Continued Influence of Misinformation in the Face of Correction: How Powerful Is It, Why Does It Happen, and How to Stop It? , 2020, Communication Research.

[41]  知秀 柴田 5分で分かる!? 有名論文ナナメ読み:Jacob Devlin et al. : BERT : Pre-training of Deep Bidirectional Transformers for Language Understanding , 2020 .

[42]  Linhong Wang,et al.  Influenza vaccination rate and its association with chronic diseases in China: Results of a national cross-sectional study. , 2020, Vaccine.

[43]  Cecile Viboud,et al.  Global mortality associated with seasonal influenza epidemics: New burden estimates and predictors from the GLaMOR Project , 2019, Journal of global health.

[44]  Y. Alluhaymid,et al.  Influenza vaccine coverage, awareness, and beliefs regarding seasonal influenza vaccination among people aged 65 years and older in Central Saudi Arabia , 2019, Saudi medical journal.

[45]  Gianluca Demartini,et al.  Novel insights into views towards H1N1 during the 2009 Pandemic: a thematic analysis of Twitter data , 2019, Health information and libraries journal.

[46]  C. Bao,et al.  Influenza vaccination coverage of population and the factors influencing influenza vaccination in mainland China: A meta-analysis. , 2018, Vaccine.

[47]  L. Bode,et al.  See Something, Say Something: Correction of Global Health Misinformation on Social Media , 2018, Health communication.

[48]  M. Stockwell,et al.  Economic burden of seasonal influenza in the United States. , 2018, Vaccine.

[49]  S. Trottier,et al.  Influenza vaccine effectiveness to prevent influenza-related hospitalizations and serious outcomes in Canadian adults over the 2011/12 through 2013/14 influenza seasons: A pooled analysis from the Canadian Immunization Research Network (CIRN) Serious Outcomes Surveillance (SOS Network). , 2018, Vaccine.

[50]  Degui Zhi,et al.  Social media and outbreaks of emerging infectious diseases: A systematic review of literature , 2018, American Journal of Infection Control.

[51]  Ullrich K. H. Ecker,et al.  Beyond Misinformation: Understanding and coping with the post-truth era , 2017 .

[52]  Dolores Albarracín,et al.  Debunking: A Meta-Analysis of the Psychological Efficacy of Messages Countering Misinformation , 2017, Psychological science.

[53]  K. Subbarao,et al.  Influenza , 2017, The Lancet.

[54]  Emily K. Vraga,et al.  I do not believe you: how providing a source corrects health misperceptions across social media platforms , 2017 .

[55]  Cornelia Betsch,et al.  Barriers of Influenza Vaccination Intention and Behavior – A Systematic Review of Influenza Vaccine Hesitancy, 2005 – 2016 , 2017, PloS one.

[56]  Luke S Sloan,et al.  Who Tweets with Their Location? Understanding the Relationship between Demographic Characteristics and the Use of Geoservices and Geotagging on Twitter , 2015, PloS one.

[57]  Guido Caldarelli,et al.  Debunking in a world of tribes , 2015, PloS one.

[58]  B. Nyhan,et al.  Does correcting myths about the flu vaccine work? An experimental evaluation of the effects of corrective information. , 2015, Vaccine.

[59]  M. V. Van Kerkhove,et al.  Influenza-related deaths--available methods for estimating numbers and detecting patterns for seasonal and pandemic influenza in Europe. , 2012, Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin.

[60]  Cecile Viboud,et al.  Excess Mortality Associated with Influenza Epidemics in Portugal, 1980 to 2004 , 2011, PloS one.

[61]  Robert L Davis,et al.  Safety of trivalent inactivated influenza vaccine in children 6 to 23 months old. , 2006, JAMA.

[62]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[63]  OUP accepted manuscript , 2022, Clinical Infectious Diseases.

[64]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[65]  J. Stockman Safety of Trivalent Inactivated Influenza Vaccine in Children 6 to 23 Months Old , 2008 .