Working towards User-oriented Evaluation

The EU-LRE project TEMAA has extended an existing ISO standard to produce a methodology for the evaluation of language engineering products. The resulting framework has been implemented as a prototype evalu-ator's workbench where product descriptions, user prooles, and test libraries can be parameter-ized to reeect user requirements. As a case study, the test bed has been instantiated for the evaluation of authoring aids, with particular emphasis on spelling checkers.