论文信息 - Evaluation of Spoken Language Systems: the ATIS Domain

Evaluation of Spoken Language Systems: the ATIS Domain

Progress can be measured and encouraged via standards for comparison and evaluation. Though qualitative assessments can be useful in initial stages, quantifiable measures of systems under the same conditions are essential for comparing results and assessing claims. This paper will address the emerging standards for evaluation of spoken language systems.

P. J. Price | P. Price

[1] Lewis M. Norton,et al. Beyond Class A: A Proposal for Automatic Evaluation of Discourse , 1990, HLT.

[2] Beth M. Sundheim. Plans For a Task-Oriented Evaluation of Natural Language Understanding Systems , 1989, HLT.

[3] George R. Doddington,et al. The ATIS Spoken Language Systems Pilot Corpus , 1990, HLT.

[4] John Makhoul,et al. Developing an Evaluation Methodology for Spoken Language Systems , 1990, HLT.

[5] Patti Price,et al. The DARPA 1000-word resource management database for continuous speech recognition , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.