论文信息 - More Efficient Topic Modelling Through a Noun Only Approach

More Efficient Topic Modelling Through a Noun Only Approach

This study compared three topic models trained on three versions of a news corpus. The first model was generated from the raw news corpus, the second was generated from the lemmatised version of the news corpus, and the third model was generated from the lemmatised news corpus reduced to nouns only. We found that the removing all words except nouns improved the topics’ semantic coherence. Using the measures developed by Lau et al (2014), the average observed topic coherence improved 6% and the average word intrusion detection improved 8% for the noun only corpus, compared to modelling the raw corpus. Similar improvements on these measures were obtained by simply lemmatising the news corpus, however, the model training times are faster when reducing the articles to the nouns only.

Mark Johnson | Fiona Martin | Mark Johnson | Fiona Martin

[1] David M. Blei,et al. Probabilistic topic models , 2012, Commun. ACM.

[2] Michael I. Jordan,et al. Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[3] Dan Klein,et al. Feature-Rich Part-of-Speech Tagging with a Cyclic Dependency Network , 2003, NAACL.

[4] Andrew McCallum,et al. Optimizing Semantic Coherence in Topic Models , 2011, EMNLP.

[5] Timothy Baldwin,et al. Machine Reading Tea Leaves: Automatically Evaluating Topic Coherence and Topic Model Quality , 2014, EACL.

[6] Michael J. Paul,et al. Unsupervised Part-of-Speech Tagging in Noisy and Esoteric Domains With a Syntactic-Semantic Bayesian HMM , 2012 .

[7] Jing Jiang. Modeling Syntactic Structures of Topics with a Nested HMM-LDA , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[8] Thomas L. Griffiths,et al. Integrating Topics and Syntax , 2004, NIPS.

[9] Maria Leonor Pacheco,et al. of the Association for Computational Linguistics: , 2001 .