The Text Analysis Conference (TAC) is a series of Natural Language Processing evaluation workshops organized by the National Institute of Standards and Technology. The Knowledge Base Population (KBP) track at TAC 2009, a hybrid descendant of the TREC Question Answering track and the Automated Content Extraction (ACE) evaluation program, is designed to support development of systems that are capable of automatically populating a knowledge base with information about entities mined from unstructured text. An important component of the KBP evaluation is the Entity Linking task, where systems must accurately associate text mentions of unknown Person (PER), Organization (ORG), and Geopolitical (GPE) names to entries in a knowledge base. Linguistic Data Consortium (LDC) at the University of Pennsylvania creates and distributes linguistic resources including data, annotations, system assessment, tools and specifications for the TAC KBP evaluations. This paper describes the 2009 resource creation efforts, with particular focus on the selection and development of named entity mentions for the Entity Linking task evaluation.
[1]
Hoa Trang Dang,et al.
Overview of the TREC 2006 Question Answering Track 99
,
2006,
TREC.
[2]
Paul McNamee,et al.
An Evaluation of Technologies for Knowledge Base Population
,
2010,
LREC.
[3]
Mark A. Przybocki,et al.
Linguistic Resources and Evaluation Techniques for Evaluation of Cross-Document Automatic Content Extraction
,
2008,
LREC.
[4]
Ellen M. Voorhees,et al.
Overview of the TREC 2004 Novelty Track.
,
2005
.
[5]
Jimmy J. Lin,et al.
Overview of the TREC 2007 Question Answering Track
,
2008,
TREC.