论文信息 - Tokenization and proper noun recognition for information retrieval

Tokenization and proper noun recognition for information retrieval

In this paper we consider a set of natural language processing techniques that can be used to analyze large amounts of texts, focusing on the advanced tokenizer which accounts for a number of complex linguistic phenomena, as well as for pre-tagging tasks such as proper noun recognition. We also show the results of several experiments performed in order to study the impact of the strategy chosen for the recognition of proper nouns.

[1] Paul Thompson,et al. Name Recognition and Retrieval Performance , 1999 .

[2] Norbert Fuhr,et al. Retrieval Effectiveness of Proper Name Search Methods , 1996, Inf. Process. Manag..

[3] Andrei Mikheev,et al. Document centered approach to text normalization , 2000, SIGIR '00.

[4] Miguel A. Alonso,et al. Applying Productive Derivational Morphology to Term Indexing of Spanish Texts , 2001, CICLing.

[5] Evelyne Tzoukermann,et al. NLP for Term Variant Extraction: Synergy Between Morphology, Lexicon, and Syntax , 1999 .

[6] Jungyun Seo,et al. Corpus-Based Learning of Compound Noun Indexing , 2000 .

[7] Miguel A. Alonso,et al. Towards the Development of Heuristics for Automatic Query Expansion , 2001, DEXA.

[8] Jean-Cédric Chappelier,et al. Integrating external dictionaries into stochastic part-of-speech taggers , 2001 .

[9] Miguel A. Alonso,et al. Using Syntactic Dependency-Pairs Conflation to Improve Retrieval Performance in Spanish , 2002, CICLing.

[10] Jean-pierre Chanod. A Non-deterministic Tokeniser for Finite-State Parsing , 1996 .

[11] Thorsten Brants,et al. TnT – A Statistical Part-of-Speech Tagger , 2000, ANLP.

[12] Andrei Mikheev,et al. Tagging Sentence Boundaries , 2000, ANLP.