A Hardware Algorithm for High Speed Morpheme Extraction and its Implementation

This paper describes a new hardware algorithm for morpheme extraction and its implementation on a specific machine (MEX-I), as the first step toward achieving natural language parsing accelerators. It also shows the machine's performance, 100--1,000 times faster than a personal computer. This machine can extract morphemes from 10,000 character Japanese text by searching an 80,000 morpheme dictionary in 1 second. It can treat multiple text streams, which are composed of character candidates, as well as one text stream. The algorithm is implemented on the machine in linear time for the number of candidates, while conventional sequential algorithms are implemented in combinational time.

[1]  Katsuhiko Yuura,et al.  A Kana-Kanji Translation System for Non-Segmented Input Sentences Based on Syntactic and Semantic Analysis , 1986, COLING.

[2]  Kimmo Koskenniemi,et al.  Two-Level Model for Morphological Analysis , 1983, IJCAI.

[3]  Yuji Matsumoto.  A Parallel Parsing System for Natural Language Analysis , 1986, ICLP.

[4]  Andrew R. Haas.  Parallel Parsing for Unification Grammars , 1987, IJCAI.

[5]  Stephen G. Pulman,et al.  A Dictionary and Morphological Analyser for English , 1986, COLING.

[6]  Yoshitake Suzuki,et al.  Hardware-Matching Algorithm for High-Speed Linguistic Processing in Continuous Speech-Recognition Systems , 1988, Systems and Computers in Japan.

[7]  John Bear.  A Morphological Recognizer with Syntactic and Phonological Rules , 1986, COLING.

[8]  Lawrence Chisvin,et al.  Content-addressable and associative memory: alternatives to the ubiquitous RAM , 1989, Computer.

[9]  Toshikazu Fukushima,et al.  A Sentence Analysis Method for a Japanese Book Reading Machine for the Blind , 1986, ACL.

[10]  Donald E. Knuth,et al.  Ordered Hash Tables , 1974, Comput. J..

[11]  宮井 均,et al.  Natural Language Parsing Accelerators(1) : An Experimental Machine for Morpheme Extraction , 1989 .

[12]  Wojciech Rytter.  Parallel Time O(log n) Recognition of Unambiguous Context-free Languages , 1987, Inf. Comput..

[13]  Donald E. Knuth,et al.  Sorting and Searching , 1973 .

[14]  H. Nagai,et al.  A high-speed string-search engine , 1987 .