论文信息 - The Typology of Unknown Words: An Experimental Study of Two Corpora

The Typology of Unknown Words: An Experimental Study of Two Corpora

Most current state-of-the-art natural language processing (NLP) systems, when presented with real-life texts, have problems recognizing each and every word present in the input. Depending on the application, the consequences can be severe. For example, in a machine translation system the quality of the processing may suffer and sometimes further processing may even be impossible.There are two main reasons why a word might not be recograzed and thus be considered unknown by the system:

Xiaobo Ren | François Perrault

[1] Philip J. Hayes,et al. Flexible Parsing , 1980, ACL.

[2] Joseph J. Pollock,et al. Spelling error Detection and correction by Computer: some Notes and a Bibliography , 1982, J. Documentation.

[3] Jean Véronis,et al. Correction of phonographic errors in natural language interfaces , 1988, SIGIR '88.

[4] James L. Peterson,et al. Computer programs for detecting and correcting spelling errors , 1980, CACM.

[5] Michael J. Fischer,et al. The String-to-String Correction Problem , 1974, JACM.

[6] Sargur N. Srihari,et al. Computer Text Recognition and Error Correction , 1985 .

[7] Antonio Zamora,et al. Collection and characterization of spelling errors in scientific and scholarly text , 1983, J. Am. Soc. Inf. Sci..

[8] A. J. Szanser. Error-correcting methods in natural language processing , 1968, IFIP Congress.

[9] Fred J. Damerau,et al. A technique for computer detection and correction of spelling errors , 1964, CACM.