论文信息 - Laying the Groundwork for Knowledge Base Population: Nine Years of Linguistic Resources for TAC KBP

Laying the Groundwork for Knowledge Base Population: Nine Years of Linguistic Resources for TAC KBP

Knowledge Base Population (KBP) is an evaluation series within the Text Analysis Conference (TAC) evaluation campaign conducted by the National Institute of Standards and Technology (NIST). Over the past nine years TAC KBP evaluations have targeted information extraction technologies for the population of knowledge bases comprised of entities, relations, and events. Linguistic Data Consortium (LDC) has supported TAC KBP since 2009, developing, maintaining, and distributing linguistic resources in three languages for seven distinct evaluation tracks. This paper describes LDC's resource creation efforts for the various KBP tracks, and highlights changes made over the years to support evolving evaluation requirements.

[1] Zhiyi Song,et al. Overview of Linguistic Resources for the TAC KBP 2017 Evaluations: Methodologies and Results , 2017, TAC.

[2] Ellen M. Voorhees,et al. Overview of the TREC 2004 Novelty Track. , 2005 .

[3] Seth Kulick,et al. From Light to Rich ERE: Annotation of Entities, Relations, and Events , 2015, EVENTS@HLP-NAACL.

[4] Yukari Yamakawa,et al. Event Nugget and Event Coreference Annotation , 2016, EVENTS@HLT-NAACL.

[5] Stephanie M. Strassel,et al. Overview of Linguistic Resource for the TAC KBP 2014 Evaluations: Planning, Execution, and Results , 2014 .

[6] Stephanie M. Strassel,et al. Linguistic Resources for 2013 Knowledge Base Population Evaluations , 2012 .

[7] Yukari Yamakawa,et al. Event Nugget Annotation: Processes and Issues , 2015, EVENTS@HLP-NAACL.

[8] Heng Ji,et al. Linguistic Resources for Entity Linking Evaluation: from Monolingual to Cross-lingual , 2012, LREC.

[9] Paul McNamee,et al. An Evaluation of Technologies for Knowledge Base Population , 2010, LREC.

[10] Robert Parker,et al. Wikipedia and the Web of Confusable Entities: Experience from Entity Linking Query Creation for TAC 2009 Knowledge Base Population , 2010, LREC.