论文信息 - Japanese Dependency Structure Analysis Based on Maximum Entropy Models

Japanese Dependency Structure Analysis Based on Maximum Entropy Models

This paper describes a dependency structure analysis of Japanese sentences based on the maximum entropy models. Our model is created by learning the weights of some features from a training corpus to predict the dependency between bunsetsus or phrasal units. The dependency accuracy of our system is 87.2% using the Kyoto University corpus. We discuss the contribution of each feature set and the relationship between the number of training data and the accuracy.

Hitoshi Isahara | Satoshi Sekine | Kiyotaka Uchimoto

[1] Michael Collins,et al. A New Statistical Parser Based on Bigram Lexical Dependencies , 1996, ACL.

[2] Adam L. Berger,et al. A Maximum Entropy Approach to Natural Language Processing , 1996, CL.

[3] Masaki Murata,et al. Bunsetsu Identification Using Category-Exclusive Rules , 2000, COLING.

[4] Kentaro Inui,et al. A Framework of Integrating Syntactic and Lexical Statistics in Statistical Parsing , 1998 .

[5] Adam L. Berger,et al. A Comparison of Criteria for Maximum Entropy/ Minimum Divergence Feature Selection , 1998, EMNLP.

[6] Eric Sven Ristad,et al. Maximum Entropy Modeling Toolkit , 1996, ArXiv.

[7] Masakazu Fujio,et al. Japanese Dependency Structure Analysis based on Lexicalized Statistics , 1998, EMNLP.

[8] Adwait Ratnaparkhi,et al. A Linear Observed Time Statistical Parser Based on Maximum Entropy Models , 1997, EMNLP.