KHAN: Knowledge-Aware Hierarchical Attention Networks for Accurate Political Stance Prediction

The political stance prediction for news articles has been widely studied to mitigate the echo chamber effect – people fall into their thoughts and reinforce their pre-existing beliefs. The previous works for the political stance problem focus on (1) identifying political factors that could reflect the political stance of a news article and (2) capturing those factors effectively. Despite their empirical successes, they are not sufficiently justified in terms of how effective their identified factors are in the political stance prediction. Motivated by this, in this work, we conduct a user study to investigate important factors in political stance prediction, and observe that the context and tone of a news article (implicit) and external knowledge for real-world entities appearing in the article (explicit) are important in determining its political stance. Based on this observation, we propose a novel knowledge-aware approach to political stance prediction (KHAN), employing (1) hierarchical attention networks (HAN) to learn the relationships among words and sentences in three different levels and (2) knowledge encoding (KE) to incorporate external knowledge for real-world entities into the process of political stance prediction. Also, to take into account the subtle and important difference between opposite political stances, we build two independent political knowledge graphs (KG) (i.e., KG-lib and KG-con) by ourselves and learn to fuse the different political knowledge. Through extensive evaluations on three real-world datasets, we demonstrate the superiority of KHAN in terms of (1) accuracy, (2) efficiency, and (3) effectiveness.

[1]  Yeon-Chang Lee,et al.  THOR: Self-Supervised Temporal Knowledge Graph Embedding via Three-Tower Graph Convolutional Networks , 2022, 2022 IEEE International Conference on Data Mining (ICDM).

[2]  Taeho Kim,et al.  Is It Enough Just Looking at the Title?: Leveraging Body Text To Enrich Title Words Towards Accurate News Recommendation , 2022, CIKM.

[3]  Zhaojun Chen,et al.  An Empirical Study on IPO Model Construction of Undergraduate Education Quality Evaluation in China from the Statistical Pattern Recognition Approach In NLP , 2022, ACM Trans. Asian Low Resour. Lang. Inf. Process..

[4]  Yun-Yong Ko,et al.  Not All Layers Are Equal: A Layer-Wise Adaptive Approach Toward Large-Scale DNN Training , 2022, WWW.

[5]  Yushim Kim,et al.  D-FEND: a diffusion-based fake news detection framework for news articles related to COVID-19 , 2022, SAC.

[6]  Jundong Li,et al.  KCD: Knowledge Walks and Textual Cues Enhanced Political Perspective Detection in News Media , 2022, NAACL.

[7]  Ming Liu,et al.  Mulan: A Multiple Residual Article-Wise Attention Network for Legal Judgment Prediction , 2022, ACM Trans. Asian Low Resour. Lang. Inf. Process..

[8]  Dongwon Lee,et al.  ChamberBreaker: Mitigating the Echo Chamber Effect and Supporting Information Hygiene through a Gamified Inoculation System , 2021, Proc. ACM Hum. Comput. Interact..

[9]  Shangbin Feng,et al.  KGAP: Knowledge Graph Augmented Political Perspective Detection in News Media , 2021, 2108.03861.

[10]  Dan Goldwasser,et al.  MEAN: Multi-head Entity Aware Attention Networkfor Political Perspective Detection in News Media , 2021, NLP4IF.

[11]  Xuanyu Zhang,et al.  Combining Explicit Entity Graph with Implicit Text Information for News Recommendation , 2021, WWW.

[12]  Chen Gao,et al.  DGCN: Diversified Recommendation with Graph Convolutional Networks , 2021, WWW.

[13]  Matteo Cinelli,et al.  The echo chamber effect on social media , 2021, Proceedings of the National Academy of Sciences.

[14]  Tyler B. Johnson,et al.  AdaScale SGD: A User-Friendly Algorithm for Distributed Training , 2020, ICML.

[15]  Gerhard Weikum,et al.  YAGO 4: A Reason-able Knowledge Base , 2020, ESWC.

[16]  Suyu Ge,et al.  Graph Enhanced Representation Learning for News Recommendation , 2020, WWW.

[17]  Quoc V. Le,et al.  ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators , 2020, ICLR.

[18]  Sergey Vychegzhanin,et al.  Comparison of Named Entity Recognition Tools Applied to News Articles , 2019, 2019 Ivannikov Ispras Open Conference (ISPRAS).

[19]  Silvio C. Ferreira,et al.  Quantifying echo chamber effects in information spreading over political communication networks , 2019, EPJ Data Science.

[20]  Yongdong Zhang,et al.  Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction , 2019, AAAI.

[21]  Bryan C. Semaan,et al.  (Re)Design to Mitigate Political Polarization , 2019, Proc. ACM Hum. Comput. Interact..

[22]  Gabriel Machado Lunardi,et al.  Representing the Filter Bubble: Towards a Model to Diversification in News , 2019, ER Workshops.

[23]  Kevin Gimpel,et al.  ALBERT: A Lite BERT for Self-supervised Learning of Language Representations , 2019, ICLR.

[24]  Omer Levy,et al.  RoBERTa: A Robustly Optimized BERT Pretraining Approach , 2019, ArXiv.

[25]  Xiaofei Zhou,et al.  DAN: Deep Attention Neural Network for News Recommendation , 2019, AAAI.

[26]  Xing Xie,et al.  NPA: Neural News Recommendation with Personalized Attention , 2019, KDD.

[27]  Dan Goldwasser,et al.  Encoding Social Information with Graph Convolutional Networks forPolitical Perspective Detection in News Media , 2019, ACL.

[28]  Benno Stein,et al.  SemEval-2019 Task 4: Hyperpartisan News Detection , 2019, *SEMEVAL.

[29]  Taha Hassan,et al.  Trust and Trustworthiness in Social Recommender Systems , 2019, WWW.

[30]  Romualdo Pastor-Satorras,et al.  Quantifying echo chamber effects in information spreading over political communication networks , 2019, EPJ Data Science.

[31]  Dietmar Jannach,et al.  News recommender systems - Survey and roads ahead , 2018, Inf. Process. Manag..

[32]  Sang-Wook Kim,et al.  Efficient and effective influence maximization in social networks: A hybrid-approach , 2018, Inf. Sci..

[33]  Jian-Yun Nie,et al.  RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space , 2018, ICLR.

[34]  Taylor W. Brown,et al.  Exposure to opposing views on social media can increase political polarization , 2018, Proceedings of the National Academy of Sciences.

[35]  Guodong Zhou,et al.  Stance Detection with Hierarchical Attention Network , 2018, COLING.

[36]  Hanan Samet,et al.  Residual Convolutional LSTM for Tweet Count Prediction , 2018, WWW.

[37]  Soroush Vosoughi,et al.  Me, My Echo Chamber, and I: Introspection on Social Media Polarization , 2018, WWW.

[38]  Luke S. Zettlemoyer,et al.  Deep Contextualized Word Representations , 2018, NAACL.

[39]  Sang-Wook Kim,et al.  Influence maximisation in social networks: A target-oriented estimation , 2018, J. Inf. Sci..

[40]  Gianluca Stringhini,et al.  What is Gab: A Bastion of Free Speech or an Alt-Right Echo Chamber , 2018, WWW.

[41]  Minyi Guo,et al.  DKN: Deep Knowledge-Aware Network for News Recommendation , 2018, WWW.

[42]  Aristides Gionis,et al.  Political Discourse on Social Media: Echo Chambers, Gatekeepers, and the Price of Bipartisanship , 2018, WWW.

[43]  Ruifeng Xu,et al.  Stance Classification with Target-specific Neural Attention , 2017, IJCAI.

[44]  Suhang Wang,et al.  Fake News Detection on Social Media: A Data Mining Perspective , 2017, SKDD.

[45]  Minmin Chen,et al.  Efficient Vector Representation for Documents through Corruption , 2017, ICLR.

[46]  Pasquale Minervini,et al.  Convolutional 2D Knowledge Graph Embeddings , 2017, AAAI.

[47]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[48]  Kaiming He,et al.  Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour , 2017, ArXiv.

[49]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.

[50]  Walter Quattrociocchi,et al.  Echo Chambers on Facebook , 2016 .

[51]  Sang-Wook Kim,et al.  Accurate Path-based Methods for Influence Maximization in Social Networks , 2016, WWW.

[52]  Justin M. Rao,et al.  Filter Bubbles, Echo Chambers, and Online News Consumption , 2016 .

[53]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  Lada A. Adamic,et al.  Exposure to ideologically diverse news and opinion on Facebook , 2015, Science.

[55]  Wai-Tat Fu,et al.  It Is All About Perspective: An Exploration of Mitigating Selective Exposure with Aspect Indicators , 2015, CHI.

[56]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[57]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[58]  Wai-Tat Fu,et al.  Can you hear me now?: mitigating the echo chamber effect by source position indicators , 2014, CSCW.

[59]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[60]  Noah A. Smith,et al.  Learning Topics and Positions from Debatepedia , 2013, EMNLP.

[61]  Sean A. Munson,et al.  Encouraging Reading of Diverse Political Viewpoints with a Browser Widget , 2013, ICWSM.

[62]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[63]  Alan Borning,et al.  Supporting reflective public thought with considerit , 2012, CSCW.

[64]  R. Kelly Garrett,et al.  Resisting Political Fragmentation on the Internet , 2011, Daedalus.

[65]  M. Kuttschreuter,et al.  Framing and tone-of-voice of disaster media coverage: The aftermath of the Enschede fireworks disaster in the Netherlands , 2011 .

[66]  Praveen Paritosh,et al.  Freebase: a collaboratively created graph database for structuring human knowledge , 2008, SIGMOD Conference.

[67]  Wei-Hao Lin,et al.  Which Side are You on? Identifying Perspectives at the Document and Sentence Levels , 2006, CoNLL.

[68]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[69]  Lincoln Dahlberg The Internet and Democratic Discourse: Exploring The Prospects of Online Deliberative Forums Extending the Public Sphere , 2001 .

[70]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[71]  Dan Goldwasser,et al.  Using Social and Linguistic Information to Adapt Pretrained Representations for Political Perspective Identification , 2021, FINDINGS.

[72]  Proceedings of the Fourth Workshop on NLP for Internet Freedom: Censorship, Disinformation, and Propaganda , 2021 .

[73]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[74]  Alec Radford,et al.  Improving Language Understanding by Generative Pre-Training , 2018 .

[75]  Yulan He,et al.  Stance Classification with Target-Specific Neural Attention Networks , 2017 .

[76]  Ralf Dresner,et al.  Rethinking Context Language As An Interactive Phenomenon , 2016 .

[77]  A. Kruglanski Motivated social cognition: Principles of the interface. , 1996 .