Recently, the credibility of information on the Web has become an important issue. In addition to telling about content of source documents, indicating how to interpret the content, especially showing interpretation of the relation between statements appeared to contradict each other, is important for helping a user judge the credibility of information. In this paper, we will describe the purpose and the way in the construction of a text summarization corpus. Our purpose in the construction of the corpus includes the following three points; to collect Web documents relevant to several query sentences, to prepare gold standard data to evaluate smaller sub-processes in the extraction process and the summary generation process, to investigate the summaries made by human summarizers. The constructed corpus contains six query sentences, 24 manually-constructed summaries, and 24 collections of source Web documents. We also investigated how the descriptions of interpretation, which help a user judge the credibility of other descriptions in the summary, appear in the corpus. As a result, we confirmed that showing interpretation on conflicts is important for helping a user judge the credibility of information.
[1]
Tatsunori Mori,et al.
Using web page layout for extraction of sender names
,
2009,
IUCS '09.
[2]
Tatsunori Mori,et al.
Mediatory Summary Generation: Summary-Passage Extraction for Information Credibility on the Web
,
2009,
PACLIC.
[3]
Yuji Matsumoto,et al.
Statement map: assisting information crediblity analysis by visualizing arguments
,
2009,
WICOW.
[4]
Chaveevan Pechsiri,et al.
Building an Annotated Corpus for Text Summarization and Question Answering
,
2008,
LREC.
[5]
Dragomir R. Radev,et al.
CST Bank: A Corpus for the Study of Cross-document Structural Relationships
,
2004,
LREC.