Estimation and reliability of retrieval effectiveness measures

Abstract A probabilistic model of the retrieval process is presented. From it, the standard errors of system recall and precision estimators, based on a sample of queries, are derived. The resulting negative binomial model is fitted to empirical data from several retrieval tests.