The estimation of Term Relevance weights using Relevance feedback

The term relevance weighting method has been shown to produce optimal information retrieval queries under well‐defined conditions. Unfortunately, the relevance weights cannot be determined in the absence of accurate knowledge of the occurrence frequencies of the terms in the relevant and non‐relevant documents of a collection. This study presents a realistic method for estimating the term relevance weights from information derived in an interactive search environment where relevance assessments for previously retrieved items are used later to construct improved query statements. Procedures are introduced for constructing the initial query weights by using estimated term relevance factors. These initial weights are then modified during the relevance feedback process by utilizing the occurrence frequencies of the terms in the retrieved documents obtained from an earlier search. The procedures used to construct the term relevance weights are covered in detail, and experimental output is included to illustrate the effectiveness of the methods.

[1]  Karen Sparck Jones Search term relevance weighting- some recent results , 1979 .

[2]  Clement T. Yu,et al.  The measurement of term importance in automatic indexing , 1981, J. Am. Soc. Inf. Sci..

[3]  Donald H. Kraft,et al.  Evaluation of information retrieval systems: A decision theory approach , 1978, J. Am. Soc. Inf. Sci..

[4]  Karen Sparck Jones A statistical interpretation of term specificity and its application in retrieval , 1972 .

[5]  Karen Spärck Jones Experiments in relevance weighting of search terms , 1979, Inf. Process. Manag..

[6]  Clement T. Yu,et al.  On models of information retrieval processes , 1979, Inf. Syst..

[7]  Stephen E. Robertson,et al.  Probabilistic models of indexing and searching , 1980, SIGIR '80.

[8]  C. J. van Rijsbergen,et al.  An Evaluation of feedback in Document Retrieval using Co‐Occurrence Data , 1978, J. Documentation.

[9]  Karen Spärck Jones Search Term Relevance Weighting given Little Relevance Information , 1997, J. Documentation.

[10]  W. Bruce Croft,et al.  Using Probabilistic Models of Document Retrieval without Relevance Information , 1979, J. Documentation.

[11]  Clement T. Yu,et al.  Automatic indexing using term discrimination and term precision measurements , 1976, Information Processing & Management.

[12]  Harry Wu On query formulation in information retrieval , 1981 .

[13]  R. K. Waldstein,et al.  Term relevance weights in on-line information retrieval , 1977, Inf. Process. Manag..

[14]  Stephen E. Robertson,et al.  Relevance weighting of search terms , 1976, J. Am. Soc. Inf. Sci..

[15]  Clement T. Yu,et al.  Precision Weighting—An Effective Automatic Indexing Method , 1976, J. ACM.