论文信息 - BBN BYBLOS and HARC February 1992 ATIS Benchmark Results

BBN BYBLOS and HARC February 1992 ATIS Benchmark Results

We present results from the February '92 evaluation on the ATIS travel planning domain for HARC, the BBN spoken language system (SLS). In addition, we discuss in detail the individual performance of BYBLOS, the speech recognition (SPREC) component.In the official scoring, conducted by NIST, BBN's HARC system produced a weighted SLS score of 43.7 on all 687 evaluable utterances in the test set. This was the lowest error achieved by any of the 7 systems evaluated.For the SPREC evaluation BBN's BYBLOS system achieved a word error rate of 6.2% on the same 687 utterances and 9.4% on the entire test set of 971 utterances. These results were significantly better than any other speech system evaluated.

[1] Robert J. Bobrow. Statistical Agenda Parsing , 1991, HLT.

[2] Richard M. Schwartz,et al. BYBLOS Speech Recognition Benchmark Results , 1991, HLT.

[3] Richard M. Schwartz,et al. Efficient, High-Performance Algorithms for N-Best Search , 1990, HLT.

[4] Slava M. Katz,et al. Estimation of probabilities from sparse data for the language model component of a speech recognizer , 1987, IEEE Trans. Acoust. Speech Signal Process..

[5] David Stallard,et al. Syntactic/Semantic Coupling in the BBN DELPHI System , 1992, HLT.

[6] Lynette Hirschman,et al. Multi-Site Data Collection for a Spoken Language Corpus , 1992, HLT.

[7] David Stallard,et al. Fragment Processing in the DELPHI System , 1992, HLT.

[8] Richard M. Schwartz,et al. The N-Best Algorithm: Efficient Procedure for Finding Top N Sentence Hypotheses , 1989, HLT.

[9] David Stallard. Unification-Based Semantic Interpretation in the BBN Spoken Language System , 1989, HLT.