Attentional Multi-Channel Convolution With Bidirectional LSTM Cell Toward Hate Speech Prediction

Online social networks(OSNs) facilitate their users in real-time communication but also open the door for several challenging problems like hate speech and fake news. This study discusses hate speech on OSNs and presents an automatic method to identify hate messages. We introduce an attentional multi-channel convolutional-BiLSTM network for the classification of hateful content. Our model uses existing word representation techniques in a multi-channel environment having several filters with different kernel sizes to capture semantics relations at various windows. The encoded representation from multiple channels passes through an attention-aware stacked 2-layer BiLSTM network. The output from stacked 2-layer BiLSTM is weighted by an attention layer and further concatenated and passes via a dense layer. Finally, an output layer employing a sigmoid function classifies the text. We investigate the efficacy of the presented model on three Twitter-related benchmark datasets considering four evaluation metrics. In comparative evaluation, our model beats the five state-of-the-art and the same number of baseline models. The ablation study shows that the exclusion of channels and attention mechanism has the highest impact on the performance of the presented model. The empirical analysis analyzing the impact of different word representation techniques, optimization algorithms, activation functions, and batch size on the presented model ascertains the use of their optimal values.

[1]  A. Haq,et al.  DACBT: deep learning approach for classification of brain tumors using MRI data in IoT healthcare environment , 2022, Scientific Reports.

[2]  Mohd Fazil,et al.  BiCHAT: BiLSTM with deep CNN and hierarchical attention for hate speech detection , 2022, J. King Saud Univ. Comput. Inf. Sci..

[3]  A. Haq,et al.  Diagnostic Approach for Accurate Diagnosis of COVID-19 Employing Deep Learning and Transfer Learning Techniques through Chest X-ray Images Clinical Data in E-Healthcare , 2021, Sensors.

[4]  Viviana Patti,et al.  A joint learning approach with knowledge injection for zero-shot cross-lingual hate speech detection , 2021, Inf. Process. Manag..

[5]  Özlem Uzuner,et al.  A Survey of Offensive Language Detection for the Arabic Language , 2021, ACM Trans. Asian Low Resour. Lang. Inf. Process..

[6]  Tina Esther Trueman,et al.  Comment toxicity detection via a multichannel convolutional bidirectional gated recurrent unit , 2021, Neurocomputing.

[7]  Seid Muhie Yimam,et al.  HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection , 2020, AAAI.

[8]  Mohd Fazil,et al.  Socialbots: Impacts, Threat-Dimensions, and Defense Challenges , 2020, IEEE Technology and Society Magazine.

[9]  Jenq-Haur Wang,et al.  Vulnerable community identification using hate speech detection on social media , 2020, Inf. Process. Manag..

[10]  Muhammad Abulaish,et al.  A Graph-Theoretic Embedding-Based Approach for Rumor Detection in Twitter , 2019, 2019 IEEE/WIC/ACM International Conference on Web Intelligence (WI).

[11]  Wenfa Li,et al.  Stance Detection of Microblog Text Based on Two-Channel CNN-GRU Fusion Network , 2019, IEEE Access.

[12]  Mohd Fazil,et al.  A Multi-Attributed Graph-Based Approach for Text Data Modeling and Event Detection in Twitter , 2019, 2019 11th International Conference on Communication Systems & Networks (COMSNETS).

[13]  Ali Ghodsi,et al.  Text Classification based on Multiple Block Convolutional Highways , 2018, ArXiv.

[14]  David Robinson,et al.  Detecting Hate Speech on Twitter Using a Convolution-GRU Based Deep Neural Network , 2018, ESWC.

[15]  Muhammad Abulaish,et al.  A Hybrid Approach for Detecting Automated Spammers in Twitter , 2018, IEEE Transactions on Information Forensics and Security.

[16]  Gianluca Stringhini,et al.  Large Scale Crowdsourcing and Characterization of Twitter Abusive Behavior , 2018, ICWSM.

[17]  Shervin Malmasi,et al.  Detecting Hate Speech in Social Media , 2017, RANLP.

[18]  Hyeoncheol Kim,et al.  Multi-Channel Lexicon Integrated CNN-BiLSTM Models for Sentiment Analysis , 2017, ROCLING/IJCLCLP.

[19]  Ika Alfina,et al.  Hate speech detection in the Indonesian language: A dataset and preliminary study , 2017, 2017 International Conference on Advanced Computer Science and Information Systems (ICACSIS).

[20]  Xuejie Zhang,et al.  YNU-HPCC at SemEval 2017 Task 4: Using A Multi-Channel CNN-LSTM Model for Sentiment Classification , 2017, SemEval@ACL.

[21]  Pascale Fung,et al.  One-step and Two-step Classification for Abusive Language Detection on Twitter , 2017, ALW@ACL.

[22]  Vasudeva Varma,et al.  Deep Learning for Hate Speech Detection in Tweets , 2017, WWW.

[23]  Ingmar Weber,et al.  Automated Hate Speech Detection and the Problem of Offensive Language , 2017, ICWSM.

[24]  Wenpeng Yin,et al.  Comparative Study of CNN and RNN for Natural Language Processing , 2017, ArXiv.

[25]  Xiao Sun,et al.  Multichannel Convolutional Neural Network for Biological Relation Extraction , 2016, BioMed research international.

[26]  Dirk Hovy,et al.  Hateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter , 2016, NAACL.

[27]  Matthew Leighton Williams,et al.  Cyber Hate Speech on Twitter: An Application of Machine Classification and Statistical Modeling for Policy and Decision Making , 2015 .

[28]  Jing Zhou,et al.  Hate Speech Detection with Comment Embeddings , 2015, WWW.

[29]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[30]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[31]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[32]  Quoc V. Le,et al.  Distributed Representations of Sentences and Documents , 2014, ICML.

[33]  Razvan Pascanu,et al.  How to Construct Deep Recurrent Neural Networks , 2013, ICLR.

[34]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[35]  Yuzhou Wang,et al.  Locate the Hate: Detecting Tweets against Blacks , 2013, AAAI.

[36]  Julia Hirschberg,et al.  Detecting Hate Speech on the World Wide Web , 2012 .

[37]  Mohd Fazil,et al.  HCovBi-Caps: Hate Speech Detection Using Convolutional and Bi-Directional Gated Recurrent Unit With Capsule Network , 2022, IEEE Access.

[38]  Muhammad Abulaish,et al.  DeepSBD: A Deep Neural Network Model With Attention Mechanism for SocialBot Detection , 2021, IEEE Transactions on Information Forensics and Security.

[39]  Pradeep Kumar Roy,et al.  A Framework for Hate Speech Detection Using Deep Convolutional Neural Network , 2020, IEEE Access.

[40]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[41]  Xiaobing Zhou,et al.  YNU_DYX at SemEval-2019 Task 5: A Stacked BiGRU Model Based on Capsule Network in Detection of Hate , 2019, *SEMEVAL.

[42]  Felice Dell'Orletta,et al.  Hate Me, Hate Me Not: Hate Speech Detection on Facebook , 2017, ITASEC.

[43]  Muhammad Abulaish,et al.  Why a socialbot is effective in Twitter? A statistical insight , 2017, 2017 9th International Conference on Communication Systems and Networks (COMSNETS).