Overview of the Sixth Text REtrieval Conference (TREC-6)

The Text REtrieval Conference is a workshop series designed to encourage research on text retrieval for realistic applications by providing large test collections, uniform scoring procedures and a forum for organizations interested in comparing results. TREC contains two main retrieval tasks plus optional subtasks that allow participants to focus on particular common subproblems in retrieval. The emphasis on individual experiments evaluated in a common setting has proven to be very successful. In the six years since the beginning of TREC, the state of the art in retrieval effectiveness has approximately doubled, and technology transfer among research labs and between research systems and commercial products has accelerated. In addition, TREC has sponsored the first large-scale evaluations of Chinese language retrieval, retrieval of speech and retrieval across different languages.

[1]  Claire Cardie,et al.  Using clustering and SuperConcepts within SMART: TREC 6 , 1997, Inf. Process. Manag..

[2]  Ingrid Renz,et al.  Daimler Benz Research: System and Experiments Routing and Filtering , 1997, TREC.

[3]  Paul Over,et al.  Comparing interactive information retrieval systems across sites: the TREC-6 interactive track matrix experiment , 1998, SIGIR '98.

[4]  A. Lu,et al.  Query processing in TREC6 , 1998 .

[5]  Kui-Lam Kwok,et al.  TREC-5 English and Chinese Retrieval Experiments using PIRCS , 1996, TREC.

[6]  Justin Zobel,et al.  How reliable are the results of large-scale information retrieval experiments? , 1998, SIGIR '98.

[7]  Fredric C. Gey,et al.  Phrase Discovery for English and Cross-language Retrieval at TREC 6 , 1997, TREC.

[8]  Christopher C. Vogt,et al.  Verity at TREC-6: out-of-the-box and beyond , 1997, Inf. Process. Manag..

[9]  Donna Harman,et al.  The Second Text Retrieval Conference (TREC-2) , 1995, Inf. Process. Manag..

[10]  Ophir Frieder,et al.  Expanding Relevance Feedback in the Relational Model , 1997, TREC.

[11]  Eric W. Brown,et al.  The GURU System in TREC-6 , 1997, TREC.

[12]  Peter Schäuble,et al.  ETH TREC-6: Routing, Chinese, Cross-Language and Spoken Document Retrieval , 1997, TREC.

[13]  C. J. van Rijsbergen,et al.  Report on the need for and provision of an 'ideal' information retrieval test collection , 1975 .

[14]  Donna K. Harman,et al.  Overview of the Fifth Text REtrieval Conference (TREC-5) , 1996, TREC.

[15]  Charles L. A. Clarke,et al.  Efficient construction of large test collections , 1998, SIGIR '98.

[16]  Mun-Kew Leong,et al.  Concrete Queries in Specialized Domains: Known Item as Feedback for Query Formulation , 1997, TREC.

[17]  Mohand Boughanem,et al.  Mercure at TREC6 , 1997, TREC.

[18]  Samuel S. L. To,et al.  Passage-Based Re nement ( MultiText Experiments for TREC-6 ) , 1998 .

[19]  Tomek Strzalkowski,et al.  Natural Language Information Retrieval: TREC-8 Report , 1994, TREC.

[20]  James Allan,et al.  Aspect windows, 3-D visualizations, and indirect comparisons of information retrieval systems , 1998, SIGIR '98.

[21]  Donna Harman.  Analysis of data from the second text REtrieval conference (TREC-2) , 1994 .

[22]  Karen Spärck Jones.  Reflections on TREC , 1995, Inf. Process. Manag..

[23]  James Allan,et al.  INQUERY Does Battle With TREC-6 , 1997, TREC.

[24]  Arkadi Kosmynin,et al.  CSIRO Routing and Ad-Hoc Experiments at TREC-6 , 1997, TREC.

[25]  Charles L. A. Clarke,et al.  Passage-Based Refinement (MultiText Experiements for TREC-6) , 1997, TREC.

[26]  Peter Willett,et al.  Readings in information retrieval , 1997 .

[27]  Peter Bailey,et al.  ANU/ACSys TREC-5 Experiments , 1996, TREC.

[28]  Ellen M. Voorhees,et al.  Variations in relevance judgments and the measurement of retrieval effectiveness , 1998, SIGIR '98.

[29]  Donna K. Harman,et al.  Overview of the Fourth Text REtrieval Conference (TREC-4) , 1995, TREC.

[30]  Paul Over,et al.  TREC-7 Interactive Track Report , 1998, TREC.

[31]  Amit Singhal.  AT&T at TREC-6 , 1997, TREC.

[32]  Stephen E. Robertson,et al.  Okapi at TREC-6 Automatic ad hoc, VLC, routing, filtering and QSDR , 1997, TREC.

[33]  James Blustein,et al.  A Statistical Analysis of the TREC-3 Data , 1995, TREC.

[34]  Natasa Milic-Frayling,et al.  Experiments in query optimization the CLARIT system TREC-6 report , 1998 .

[35]  Ross Wilkinson,et al.  MDS TREC6 Report , 1997, TREC.

[36]  Linda Schamber.  Relevance and Information Behavior. , 1994 .