Assessing Systematic Topic Difficulty Based on Query and Collection Features.

The National Institute of Standards and Technology (NIST) initiated the Text Retrieval Conference (TREC) in 1990 to evaluate the performance of different retrieval systems and promote the development of text retrieval technology. Intensive experimental studies have been conducted to compare the performance of different systems ever since. A number of influential retrieval systems were able to be forged and enhanced in the conference. The effectiveness of different retrieval systems was compared based on several systematic evaluation measures (e.g. precision, recall or average precision) that were derived from classic Cranfield tests (Cleverdon, Mills & Keen, 1966).