The TREC interactive track: an annotated bibliography

Abstract The study of interactive information retrieval (IR) has been a small but constant part of the Text REtrieval Conferences (TREC 1–8) from the beginning. The main arena for such work has been the Interactive Track (TREC 3–8). This report presents a bibliography of those efforts together with a summary of the evolving experimental framework within which the studies took place.

[1]  Andrew Turpin,et al.  Further Analysis of Whether Batch and User Evaluations Give the Same Results with a Question-Answering Task , 2000, TREC.

[2]  Andrew Turpin,et al.  Do batch and user evaluations give the same results? , 2000, SIGIR '00.

[3]  Ross Wilkinson,et al.  The RMIT/CSIRO Ad Hoc, Q&A, Web, Interactive, and Speech Experiments at TREC 8 , 1999, TREC.

[4]  Stephen E. Robertson,et al.  Okapi at TREC-4 , 1995, TREC.

[5]  James Allan,et al.  Aspect windows, 3-D visualizations, and indirect comparisons of information retrieval systems , 1998, SIGIR '98.

[6]  Nicholas J. Belkin,et al.  Using Relevance Feedback and Ranking in Interactive Searching , 1995, TREC.

[7]  Chris Buckley,et al.  New Retrieval Approaches Using SMART: TREC 4 , 1995, TREC.

[8]  Mark W. Davis,et al.  Document Thumbnail Visualization for Rapid Relevance Judgments: When do They Pay Off? , 1998, TREC.

[9]  Nicholas J. Belkin,et al.  New Tools and Old Habits: The Interactive Searching Behavior of Expert Online Searches using INQUERY , 1994, TREC.

[10]  Paul Over,et al.  Comparing interactive information retrieval systems across sites: the TREC-6 interactive track matrix experiment , 1998, SIGIR '98.

[11]  Stephen E. Robertson,et al.  Okapi at TREC-7: Automatic Ad Hoc, Filtering, VLC and Interactive , 1998, TREC.

[12]  Nicholas J. Belkin,et al.  New tools and old habits : the interactive searching behavior of expert online searchers using INQUERY , 1994 .

[13]  Richard M. Tong.  Interactive Document Retrieval Using TOPIC (A report on the TREC-3 experiment) , 1994, TREC.

[14]  Ellen M. Voorhees,et al.  The Eighth Text REtrieval Conference (TREC-8) , 2000 .

[15]  Mark H. Chignell,et al.  ClickIR: Text Retrieval using a Dynamic Hypertext Interface , 1998, TREC.

[16]  William R. Hersh,et al.  A Large-Scale Comparison of Boolean vs. Natural Language Searching for the TREC-7 Interactive Track , 1998, TREC.

[17]  R. Kirk.  Experimental Design: Procedures for the Behavioral Sciences , 1970 .

[18]  Karen Sparck Jones,et al.  Okapi at TREC{7: automatic ad hoc, ltering, VLC and interactive track , 1999 .

[19]  Peter Schäuble,et al.  Highlighting Relevant Passages for Users of the Interactive SPIDER Retrieval System , 1995, TREC.

[20]  Nicholas J. Belkin,et al.  Rutgers Interactive Track at TREC-5 , 1996, TREC.

[21]  Nicholas J. Belkin,et al.  Rutgers' TREC-6 Interactive Track Experience , 1997, TREC.

[22]  Nipon Charoenkitkarn,et al.  Interactive Exploration as a Formal Text Retrieval Method: How Well can Interactivity Compensate for Unsophisticated Retrieval Algorithms , 1994, TREC.

[23]  Nipon Charoenkitkarn,et al.  Is Recall Relevant? An Analysis of How User Interface Conditions Affect Strategies and Performance in Large Scale Text Retrieval , 1995, TREC.

[24]  William M. Shaw,et al.  Interactive Retrieval using IRIS: TREC-6 Experiments , 1997, TREC.

[25]  Ray R. Larson,et al.  Cheshire II at TREC 6: Interactive Probabilistic Retrieval , 1997, TREC.

[26]  William R. Hersh,et al.  A Comparison of Boolean and Natural Language Searching for the TREC-6 Interactive Task , 1997, TREC.

[27]  Stephen Huffman.  Acquaintance: Language-Independent Document Categorization by N-Grams , 1995, TREC.

[28]  Lokman I. Meho,et al.  IRIS at TREC-7 , 1998, TREC.

[29]  Stephen E. Robertson,et al.  Evaluating Interactive Systems in TREC , 1996, J. Am. Soc. Inf. Sci..

[30]  Ross Wilkinson,et al.  TREC 7 Ad Hoc, Speech, and Interactive tracks at MDS/CSIRO , 1998, TREC.

[31]  P. H. Lindsay.  Human Information Processing , 1977 .

[32]  Fredric C. Gey,et al.  Manual Queries and Machine Translation in Cross-Language Retrieval and Interactive Retrieval with Cheshire II at TREC-7 , 1998, TREC.

[33]  Nicholas J. Belkin,et al.  Rutgers' TREC 2001 Interactive Track Experience , 2001, TREC.

[34]  James Allan,et al.  INQUERY Does Battle With TREC-6 , 1997, TREC.

[35]  Peter W. Foltz,et al.  Interactive Information Retrieval Using Term Relationship Networks , 1997, TREC.

[36]  Stephen E. Robertson,et al.  Okapi at TREC-3 , 1994, TREC.

[37]  Stephen E. Robertson,et al.  GatfordCentre for Interactive Systems ResearchDepartment of Information , 1996 .

[38]  Micheline Hancock-Beaulieu,et al.  Interactive Okapi at Sheffield - TREC-8 , 1999, TREC.

[39]  Nicholas J. Belkin,et al.  Relevance Feedback versus Local Context Analysis as Term Suggestion Devices: Rutgers' TREC-8 Interactive Track Experience , 1999, TREC.

[40]  Kelly Maglaughlin,et al.  IRIS at TREC-8 , 1999, TREC.

[41]  John D. Holt,et al.  Boolean System Revisited: Its Performance and its Behavior , 1995, TREC.

[42]  Hinrich Schütze,et al.  Xerox Site Report: Four TREC-4 Tracks , 1995, TREC.

[43]  Natasa Milic-Frayling,et al.  CLARIT TREC-4 Interactive Experiments , 1995, TREC.

[44]  Christian Lenz Cesar,et al.  IBM Search UI Prototype Evaluation at the Interactive Track of TREC-6 , 1997, TREC.

[45]  Micheline Hancock-Beaulieu,et al.  Interactive Okapi at TREC-6 , 1997, TREC.

[46]  Aravindan Veerasamy.  Interactive TREC-4 at Georgia Tech , 1995, TREC.

[47]  Ross Wilkinson,et al.  MDS TREC6 Report , 1997, TREC.

[48]  Ray R. Larson.  Berkeley's TREC 8 Interactive Track Entry: Cheshire II and Zprise , 1999, TREC.