KACC: A Multi-task Benchmark for Knowledge Abstraction, Concretization and Completion

Knowledge graphs (KGs) contains an instance-level entity graph and an ontology-level concept graph. Recent studies reveal that jointly modeling of these two graphs could improve the understanding of each one. The completion processes on the concept graph and the entity graph can be further regarded as processes of knowledge abstraction and concretization. However, concept graphs in existing datasets are usually small and the links between concepts and entities are usually sparse, which cannot provide sufficient information for knowledge transfer between the two graphs. In this paper, we propose large-scale datasets extracted from Wikidata, which provide more size-balanced concept graphs and abundant cross-view links. Based on the datasets, we further propose a benchmark to test the ability of existing models on knowledge abstraction, concretization and completion (KACC). Our dataset is available at this https URL.

[1]  Zhen Wen,et al.  GIANT: Scalable Creation of a Web-scale Ontology , 2020, SIGMOD Conference.

[2]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[3]  Pasquale Minervini,et al.  Convolutional 2D Knowledge Graph Embeddings , 2017, AAAI.

[4]  Timothy M. Hospedales,et al.  TuckER: Tensor Factorization for Knowledge Graph Completion , 2019, EMNLP.

[5]  Minyi Guo,et al.  TransT: Type-Based Multiple Embedding Representations for Knowledge Graph Completion , 2017, ECML/PKDD.

[6]  Omer Levy,et al.  GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding , 2018, BlackboxNLP@EMNLP.

[7]  Jens Lehmann,et al.  DBpedia - A large-scale, multilingual knowledge base extracted from Wikipedia , 2015, Semantic Web.

[8]  Danai Koutra,et al.  CoDEx: A Comprehensive Knowledge Graph Completion Benchmark , 2020, EMNLP.

[9]  Zhiyuan Liu,et al.  Representation Learning of Knowledge Graphs with Hierarchical Types , 2016, IJCAI.

[10]  Guillaume Bouchard,et al.  Complex Embeddings for Simple Link Prediction , 2016, ICML.

[11]  Haixun Wang,et al.  Probase: a probabilistic taxonomy for text understanding , 2012, SIGMOD Conference.

[12]  Rainer Gemulla,et al.  LibKGE - A knowledge graph embedding library for reproducible research , 2020, EMNLP.

[13]  Zhiyuan Liu,et al.  Learning Entity and Relation Embeddings for Knowledge Graph Completion , 2015, AAAI.

[14]  Lorenzo Rosasco,et al.  Holographic Embeddings of Knowledge Graphs , 2015, AAAI.

[15]  Pingping Huang,et al.  CoKE: Contextualized Knowledge Graph Embedding , 2019, ArXiv.

[16]  Rainer Gemulla,et al.  You CAN Teach an Old Dog New Tricks! On Training Knowledge Graph Embeddings , 2020, ICLR.

[17]  Jun Zhao,et al.  Knowledge Graph Embedding via Dynamic Mapping Matrix , 2015, ACL.

[18]  Jian-Yun Nie,et al.  RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space , 2018, ICLR.

[19]  Nagiza F. Samatova,et al.  Learning Entity Type Embeddings for Knowledge Graph Completion , 2017, CIKM.

[20]  Jianfeng Gao,et al.  Embedding Entities and Relations for Learning and Inference in Knowledge Bases , 2014, ICLR.

[21]  Christopher R'e,et al.  Low-Dimensional Hyperbolic Knowledge Graph Embeddings , 2020, ACL.

[22]  Michael Gamon,et al.  Representing Text for Joint Embedding of Text and Knowledge Bases , 2015, EMNLP.

[23]  Volker Tresp,et al.  Type-Constrained Representation Learning in Knowledge Graphs , 2015, SEMWEB.

[24]  Zhiyuan Liu,et al.  Knowledge Representation Learning with Entities, Attributes and Relations , 2016, IJCAI.

[25]  Fabian M. Suchanek,et al.  YAGO3: A Knowledge Base from Multilingual Wikipedias , 2015, CIDR.

[26]  Yizhou Sun,et al.  Universal Representation Learning of Knowledge Bases by Jointly Embedding Instances and Ontological Concepts , 2019, KDD.

[27]  Dai Quoc Nguyen,et al.  A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Network , 2017, NAACL.

[28]  Yonghua Yang,et al.  AliCoCo: Alibaba E-commerce Cognitive Concept Net , 2020, SIGMOD Conference.

[29]  Danqi Chen,et al.  Reasoning With Neural Tensor Networks for Knowledge Base Completion , 2013, NIPS.

[30]  Zhen Wang,et al.  Knowledge Graph Embedding by Translating on Hyperplanes , 2014, AAAI.

[31]  Zhiyuan Liu,et al.  Differentiating Concepts and Instances for Knowledge Graph Embedding , 2018, EMNLP.

[32]  Markus Krötzsch,et al.  Wikidata , 2014, Commun. ACM.