Developing Language Technologies with the Support of Language Resources and Evaluation Programs

The role of language resources and language technology evaluation is now recognized as being crucial for the development of written and spoken language processing systems. Given the increasing challenge of multilingualism in Europe, the development of language technologies requires a more internationally distributed effort. This paper first describes several recent and on-going activities in France aimed at the development of language resources and evaluation. We then outline a new project intended to enhance collaboration, cooperation, and resource sharing among the international language processing research community.

[1]  Widad Mustafa El Hadi,et al.  EVALDA-CESART Project: Terminological Resources Acquisition Tools Evaluation Campaign , 2004, LREC.

[2]  Christophe d'Alessandro,et al.  Objective evaluation of grapheme to phoneme conversion for text-to-speech synthesis in French , 1998, Comput. Speech Lang..

[3]  Kamel Smaïli,et al.  A first evaluation campaign for language models , 1998 .

[4]  Patrick Paroubek,et al.  The Ongoing Evaluation Campaign of Syntactic Parsing of French: EASY , 2004, LREC.

[5]  Bruno Landi,et al.  AMARYLLIS: an evaluation experiment on search engines in a French-speaching context , 1998 .

[6]  Guillaume Gravier,et al.  Corpus description of the ESTER Evaluation Campaign for the Rich Transcription of French Broadcast News , 2004, LREC.

[7]  Khalid Choukri,et al.  Technolangue: A Permanent Evaluation and Information Infrastructure , 2004, LREC.

[8]  Laurent Romary,et al.  Vers une normalisation des ressources linguistiques : le serveur SILFIDE , 2000 .

[9]  Jean Caelen,et al.  DQR test suites for a qualitative evaluation of spoken dialogue systems: from speech understanding to dialogue strategy , 1998 .

[10]  Martin Rajman,et al.  Work-in-progress project report: CESTA - machine translation evaluation campaign , 2004 .

[11]  M. T. Lino,et al.  Proceedings of the 4th International Conference on Language Resources and Evaluation , 2004 .

[12]  Frédéric Béchet,et al.  The French MEDIA/EVALDA Project: the Evaluation of the Understanding Capability of Spoken Language Dialogue Systems , 2004, LREC.

[13]  Christophe Jouis,et al.  Terminology extraction and acquisition from textual data: criteria for evaluating tools and methods , 1998 .

[14]  Patrick Paroubek,et al.  The GRACE french part-of-speech tagging evaluation task , 1998, LREC.

[15]  Patrick Paroubek.  Language Resources as by-Product of Evaluation: The MULTITAG Example , 2000, LREC.

[16]  Jean Véronis,et al.  ARCADE: a cooperative research project on parallel text alignment evaluation , 1998 .