Information retrieval and digital libraries: lessons of research

This paper reviews lessons from the history of information retrieval research, with particular emphasis on recent developments. These have demonstrated the value of statistical techniques for retrieval, and have also shown that they have an important, though not exclusive, part to play in other information processing tasks, like question asnwering and summarising. The heterogeneous materials that digital libraries are expected to cover, their scale, and their changing composition, imply that statistical methods, which are general-purpose and very flexible, have significant potential value for the digital libraries of the future.

[1]  Philip C. Woodland,et al.  The Cambridge Multimedia Document Retrieval Project: summary of experiments , 2001 .

[2]  Grace Hui Yang,et al.  The Integration of Lexical Knowledge and External Resources for Question Answering , 2002, TREC.

[3]  J Allan,et al.  Readings in information retrieval. , 1998 .

[4]  Karen Sparck Jones,et al.  Book Reviews: Evaluating Natural Language Processing Systems: An Analysis and Review , 1996, CL.

[5]  JonesK. Sparck,et al.  A probabilistic model of information retrieval , 2000 .

[6]  Ellen M. Voorhees,et al.  TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing) , 2005 .

[7]  José Luis Vicedo González,et al.  TREC: Experiment and evaluation in information retrieval , 2007, J. Assoc. Inf. Sci. Technol..

[8]  Carol Tenopir,et al.  DIALOG and Mead Join the Relevance Ranks , 1994 .

[9]  Vanessa Murdock.  Ellen Voorhees and Donna Harman (eds): TREC Experiment and Evaluation in Information Retrieval , 2008, Information Retrieval.

[10]  B. C. Vickery,et al.  Faceted classification schemes , 1966 .

[11]  Stephen E. Robertson,et al.  A probabilistic model of information retrieval: development and comparative experiments - Part 1 , 2000, Inf. Process. Manag..

[12]  Margaret King,et al.  Evaluating natural language processing systems , 1996, CACM.

[13]  C. Borgman.  From Gutenberg to the global information infrastructure: access to information in the networked world , 2000 .

[14]  Julia Galliers,et al.  Evaluating natural language processing systems , 1995 .

[15]  Andrew Hickl,et al.  Lite-GISTexter at DUC 2005 , 2005 .

[16]  Marko Ristin,et al.  Language Modelling in Information Retrieval , 2007 .

[17]  W. Bruce Croft.  Advances in Informational Retrieval: Recent Research from the Center for Intelligent Information Retrieval , 2000 .

[18]  Peter Willett,et al.  Readings in information retrieval , 1997 .

[19]  Cyril Cleverdon,et al.  The Cranfield tests on index language devices , 1997 .

[20]  Gerard Salton,et al.  The SMART Retrieval System , 1971 .

[21]  Carol Tenopir,et al.  TARGET and FREESTYLE: DIALOG and Mead join the relevance ranks , 1997 .

[22]  Stephen E. Robertson,et al.  A probabilistic model of information retrieval: development and comparative experiments - Part 2 , 2000, Inf. Process. Manag..

[23]  M. E. Maron,et al.  On Relevance, Probabilistic Indexing and Information Retrieval , 1960, JACM.