The Use of Term position Devices in Ranked output Experiments

Term position information, as provided in some Boolean systems in the form of field restriction and term proximity, is reviewed and its value assessed. Non‐Boolean retrieval in the form of the ranked output experiment has not so far used term position information but has concentrated on schemes of term weighting. The use of term proximity devices is proposed here by analogy with Boolean techniques and seven algorithms are devised to incorporate the ideas of sentence matching, proximate terms, term order specification and term distance computations. It is hypothesised that term position will act as a precision device. A new search experiment is then described in which a test collection is processed into sentences and then output ranking using term position is obtained. Results are given for five algorithms compared against quorum searching as the benchmark. The best result increased the precision ratio by 18% and used proximate matching term pairs in sentences plus a distance component.

[1]  Gerard Salton,et al.  Term-Weighting Approaches in Automatic Text Retrieval , 1988, Inf. Process. Manag..

[2]  Cyril W. Cleverdon,et al.  Factors determining the performance of indexing systems , 1966 .

[3]  Kui-Lam Kwok,et al.  Experiments with document components for indexing and retrieval , 1988, Inf. Process. Manag..

[4]  R. J. Hartley,et al.  Online searching : principles and practice , 1990 .

[5]  Carol Tenopir,et al.  Search Strategies for Full Text Databases , 1988 .

[6]  Michael D. Cooper,et al.  Usage patterns of an online search system , 1983, J. Am. Soc. Inf. Sci..

[7]  Jung Soon Ro An evaluation of the applicability of ranking algorithms to improve the effectiveness of full‐text retrieval. I. On the effectiveness of full‐text retrieval , 1988 .

[8]  Robert H. Ledwith On the Difficulties of Applying the Results of Information Retrieval Research to Aid in the Searching of Larg Scientific Databases , 1992, Inf. Process. Manag..

[9]  E. Michael Keen,et al.  Presenting Results of Experimental Retrieval Comparisons , 1997, Inf. Process. Manag..

[10]  Marcia Olmsted,et al.  Dialog Version 2/Questel Plus: A Comparison. , 1986 .

[11]  Bert R. Boyce,et al.  Hedge trimming and the resurrection of the controlled vocabulary in online searching , 1983 .

[12]  Carol Tenopir,et al.  Full text database retrieval performance , 1985 .

[13]  Peter Willett,et al.  Free text retrieval systems: a review and evaluation , 1989 .

[14]  E. Michael Keen Transferring records from CD-ROM to an inhouse database: some practical experiences , 1990 .

[15]  J. J. Schroder,et al.  Study of strategies used in online searching: 2. Positional Logic — an example of the importance of selecting the right Boolean operator , 1982 .

[16]  R. L. Jones,et al.  STATUS with IQ—escaping from the Boolean straitjacket , 1988 .

[17]  Karen Sparck Jones A statistical interpretation of term specificity and its application in retrieval , 1972 .

[18]  Peter Ingwersen,et al.  A cognitive view of three selected online search facilities , 1984 .