Evaluating Answer Quality/eeciency Tradeoos

For many emerging applications and environments , information systems designers and im-plementors must consider the tradeoos between eeciency and the quality of query answers. This exibility, while allowing numerous opportunities for optimization, complicates the development of various system components and their performance evaluation. In this short paper, we begin by outlining issues that arise in evaluating quality/eeciency tradeoos. We then describe how we address some of these issues in two ongoing projects.