Revisiting informativeness as a process measure for information interaction

The intent of this paper is to re-introduce and discuss the applicability of the informativeness concept to web-based information seeking and retrieval environments. Informativeness is rare among IR evaluation concepts, in that it focuses on the value of the process of interaction with a set of documents, rather than on the success of the algorithm matching documents to information needs. It is notable as an early attempt to bridge traditional system evaluation with the new-at-that-time perspective on the role of the user in the evaluation of the system.

[1]  Kalervo Järvelin,et al.  Task Complexity Affects Information Seeking and Use , 1995, Inf. Process. Manag..

[2]  Pertti Vakkari,et al.  A theory of the task-based information retrieval process: a summary and generalisation of a longitudinal study , 2001, J. Documentation.

[3]  Michael Eisenberg,et al.  Order effects: A study of the possible influence of presentation order on user judgments of document relevance , 1988, J. Am. Soc. Inf. Sci..

[4]  Richard L. Derr.  The concept of information in ordinary discourse , 1985, Inf. Process. Manag..

[5]  Pia Borlund,et al.  The IIR evaluation model: a framework for evaluation of interactive information retrieval systems , 2003, Inf. Res..

[6]  Isola Ajiferuke,et al.  A total relevance and document interaction effects model for the evaluation of information retrieval processes , 1988, Inf. Process. Manag..

[7]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[8]  Ian Soboroff,et al.  Overview of the TREC 2004 Novelty Track , 2004, TREC.

[9]  Jean Tague-Sutcliffe.  Informativeness as an Ordinal Utility Function for Information Retrieval , 1987, SIGIR Forum.

[10]  Michael K. Buckland,et al.  Information as thing , 1991, J. Am. Soc. Inf. Sci..

[11]  Thomas Roelleke.  A frequency-based and a poisson-based definition of the probability of being informative , 2003, SIGIR '03.

[12]  Pia Borlund,et al.  The concept of relevance in IR , 2003, J. Assoc. Inf. Sci. Technol..

[13]  Carol Collier Kuhlthau,et al.  Inside the search process: Information seeking from the user's perspective , 1991, J. Am. Soc. Inf. Sci..

[14]  Joemon M. Jose,et al.  How users assess Web pages for information seeking , 2005, J. Assoc. Inf. Sci. Technol..

[15]  Yazdan Mansourian,et al.  The Turn: Integration of Information Seeking and Retrieval in Context / Peter Ingwersen & Kalervo Järvelin , 2006, Webology.

[16]  Brenda Dervin,et al.  On studying information seeking methodologically: the implications of connecting metatheory to method , 1999, Inf. Process. Manag..

[17]  Jean Tague-Sutcliffe.  Measuring the informativeness of a retrieval process , 1992, SIGIR '92.

[18]  K. Järvelin,et al.  EVALUATING INFORMATION RETRIEVAL SYSTEMS UNDER THE CHALLENGES OF INTERACTION AND MULTIDIMENSIONAL DYNAMIC RELEVANCE , 2002 .

[19]  Peter Ingwersen,et al.  The Turn - Integration of Information Seeking and Retrieval in Context , 2005, The Kluwer International Series on Information Retrieval.

[20]  Tommi S. Jaakkola,et al.  Using term informativeness for named entity detection , 2005, SIGIR '05.

[21]  Jean Tague-Sutcliffe,et al.  Some measures and procedures for evaluation of the user interface in an information retrieval system , 1988, SIGIR '88.

[22]  Jean Tague-Sutcliffe,et al.  Measuring information : an information services perspective , 1995 .