A Methodology for Extrinsically Evaluating Information Extraction Performance

This paper reports a preliminary study addressing two challenges in measuring the effectiveness of information extraction (IE) technology:• Developing a methodology for extrinsic evaluation of IE; and,• Estimating the impact of improving IE technology on the ability to perform an application task.The methodology described can be employed for further controlled experiments regarding information extraction.