Multi-Label Classification of Chinese Humor Texts Using Hypergraph Attention Networks

We use Hypergraph Attention Networks (HyperGAT) to recognize multiple labels of Chinese humor texts. We firstly represent a joke as a hypergraph. The sequential hyperedge and semantic hyperedge structures are used to construct hyperedges. Then, attention mechanisms are adopted to aggregate context information embedded in nodes and hyperedges. Finally, we use trained HyperGAT to complete the multi-label classification task. Experimental results on the Chinese humor multi-label dataset showed that HyperGAT model outperforms previous sequence-based (CNN, BiLSTM, FastText) and graph-based (Graph-CNN, TextGCN, Text Level GNN) deep learning models.

[1]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[2]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[3]  K. Binsted.  Using Humour to Make Natural Language Interfaces More Friendly , 1995 .

[4]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[5]  Xipeng Qiu,et al.  Recurrent Neural Network for Text Classification with MultiTask Learning , 2016 .

[6]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[7]  Jennings Bryant,et al.  Chapter 2: Using Humor to Promote Learning in the Classroom , 1989 .

[8]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[9]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[10]  Yuan Luo,et al.  Graph Convolutional Networks for Text Classification , 2018, AAAI.

[11]  Hsueh-Chih Chen,et al.  Development and Validation of a Corpus for Machine Humor Comprehension , 2020, LREC.

[12]  Mary P. Harper,et al.  Learning from 26 Languages: Program Management and Science in the Babel Program , 2014, COLING.

[13]  Paul E. McGhee,et al.  Humor and Children's Development: A Guide to Practical Applications , 1989 .

[14]  Houfeng Wang,et al.  Text Level Graph Neural Network for Text Classification , 2019, EMNLP.

[15]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[16]  Tomas Mikolov,et al.  Bag of Tricks for Efficient Text Classification , 2016, EACL.

[17]  Jerome R. Bellegarda.  Spoken Language Understanding for Natural Interaction , 2013, SIGDIAL Conference.