论文信息 - Wikipedia2Vec: An Optimized Tool for Learning Embeddings of Words and Entities from Wikipedia

Wikipedia2Vec: An Optimized Tool for Learning Embeddings of Words and Entities from Wikipedia

We present Wikipedia2Vec, an open source tool for learning embeddings of words and entities from Wikipedia. This tool enables users to easily obtain high-quality embeddings of words and entities from a Wikipedia dump with a single command. The learned embeddings can be used as features in downstream natural language processing (NLP) models. The tool can be installed via PyPI. The source code, documentation, and pretrained embeddings for 12 major languages can be obtained at this http URL.

Hiroyuki Shindo | Ikuya Yamada | Hideaki Takeda | Yoshiyasu Takefuji | Akari Asai

[1] Gerhard Weikum,et al. KORE: keyphrase overlap relatedness for entity disambiguation , 2012, CIKM.

[2] Omer Levy,et al. Named Entity Disambiguation for Noisy Text , 2017, CoNLL.

[3] Petr Sojka,et al. Software Framework for Topic Modelling with Large Corpora , 2010 .

[4] Prakhar Gupta,et al. Learning Word Vectors for 157 Languages , 2018, LREC.

[5] Felix Hill,et al. SimLex-999: Evaluating Semantic Models With (Genuine) Similarity Estimation , 2014, CL.

[6] Heiko Paulheim,et al. RDF2Vec: RDF graph embeddings and their applications , 2019, Semantic Web.

[7] Hiroyuki Shindo,et al. Segment-Level Neural Conditional Random Fields for Named Entity Recognition , 2017, IJCNLP.

[8] Jeffrey Dean,et al. Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[9] Ehud Rivlin,et al. Placing search in context: the concept revisited , 2002, TOIS.

[10] Hiroyuki Shindo,et al. Joint Learning of the Embedding of Words and Entities for Named Entity Disambiguation , 2016, CoNLL.

[11] Hiroyuki Shindo,et al. Studio Ousia's Quiz Bowl Question Answering System , 2018, ArXiv.

[12] Jeffrey Pennington,et al. GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[13] Tomas Mikolov,et al. Enriching Word Vectors with Subword Information , 2016, TACL.

[14] Jeffrey Dean,et al. Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.