论文信息 - An Improved Chinese Segmentation Algorithm Based on New Dictionary Construction

An Improved Chinese Segmentation Algorithm Based on New Dictionary Construction

In this paper we make use of the result of word frequency statistics design a new dictionary construction and propose an improved FMM algorithm which based on analysis the principle and characteristics of traditional FMM algorithm. Through the time complexity analysis and experimental comparison, the improved FMM algorithm can further improve the efficiency of the Chinese word segmentation.

Yan Niu | Lala Li

[1] Cui Hong-yan. Research on an improved Chinese segmentation algorithm based on word frequency statistic , 2008 .

[2] Hao Tian-yong. The State of the Art and Difficulties in Automatic Chinese Word Segmentation , 2005 .

[3] Jiajun Chen,et al. A Hybrid Approach to Chinese Word Segmentation around CRFs , 2005, SIGHAN@IJCNLP 2005.

[4] Han Li-kai. Research of a Fast Web Chinese Participle Algorithm , 2007 .

[5] Chen Gui. A KIND OF HIGHLY EFFICIENT DATA STRUCTURE FOR CHINESE ELECTRONIC THESAURUS , 2000 .