A first-pass approach for evaluating machine translation systems

This paper describes a short-term survey and evaluation project that covered a large number of machine translation products and research. We discuss our evaluation approach and address certain issues and implications relevant to our findings. We represented a variety of potential users of MT systems and were faced with the task of identifying which systems would best help them solve their translation problems.

[1]  John R. Pierce,et al.  Language and Machines: Computers in Translation and Linguistics , 1966 .

[2]  Jaime G. Carbonell,et al.  Steps Toward Knowledge-Based Machine Translation , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Georges Van Slype,et al.  Conception d’une méthodologie générale d’evaluation de la traduction automatique , 1982 .

[4]  Georges Van Slype.  Conception d’une méthodologie générale d’evaluation de la traduction automatique , 1982 .

[5]  Jonathan Slocum,et al.  The LRC Machine Translation System , 1985, Comput. Linguistics.

[6]  Pierre Isabelle,et al.  TAUM-AVIATION: Its Technical Features and Some Experimental Results , 1985, Comput. Linguistics.

[7]  Jun'ichi Tsujii,et al.  The Japanese Government Project for Machine Translation , 1985, Comput. Linguistics.

[8]  Muriel Vasconcellos,et al.  SPANAM and ENGSPAN: Machine Translation at the Pan American Health Organization , 1985, Comput. Linguistics.

[9]  Tom Gilb,et al.  Principles of software engineering management , 1988 .

[10]  Iain D. Craig,et al.  Principles of Software Engineering Management by Tom Gilb with Susannah Pinzi, Addison-Wesley, Wokingham, UK, 442 pages (incl. index) (£17.95) , 1989, Robotica (Cambridge. Print).

[11]  Dick Bowman,et al.  Principles of software engineering management , 1989, APLQ.

[12]  Timothy W. Finin,et al.  Workshop on the Evaluation of Natural Language Processing Systems , 1990, Comput. Linguistics.

[13]  Margaret King,et al.  Using Test Suites in Evaluation of Machine Translation Systems , 1990, COLING.