Retrieval with Logical Imaging is derived from belief revision and provides a novel mechanism for estimating the relevance of a document through logical implication (i.e. P(q->d). In this poster, we perform the first comprehensive evaluation of Logical Imaging (LI) in Information Retrieval (IR) across several TREC test Collections. When compared against standard baseline models, we show that LI fails to improve performance. This failure can be attributed to a nuance within the model that means non-relevant documents are promoted in the ranking, while relevant documents are demoted. This is an important contribution because it not only contextualizes the effectiveness of LI, but crucially explains why it fails. By addressing this nuance, future LI models could be significantly improved.
[1]
Gianni Amati,et al.
AN INFORMATION RETRIEVAL LOGIC MODEL: IMPLEMENTATION AND EXPERIMENTS*
,
2007
.
[2]
Fabio Crestani,et al.
Probability kinematics in information retrieval
,
1995,
SIGIR '95.
[3]
C. J. van Rijsbergen,et al.
A New Theoretical Framework for Information Retrieval
,
1986,
SIGIR Forum.
[4]
C. J. van Rijsbergen,et al.
(invited paper) A new theoretical framework for information retrieval
,
1986,
SIGIR '86.
[5]
Fabio Crestani,et al.
The Troubles with Using a Logical Model of IR on a Large Collection of Documents
,
1995,
TREC.