论文信息 - Parallel Information Extraction on Shared Memory Multi-processor System

Parallel Information Extraction on Shared Memory Multi-processor System

Text mining is one of the best solutions for today and the future's information explosion. With the development of modern processor technologies, it will be a mass market desktop application in the many-core era. In text mining system, information extraction is a representative module and is the most compute intensive part. In this paper, we study the performance of parallel information extraction on shared memory multi-processor systems in order to gain some insights of such applications on the future's many-core architecture. In implementation, conditional random fields (CRFs) algorithm is selected as the core of module information extraction. Based on the newest CRFs toolkit FlexCRFs, we make several serial optimizations and then parallelize it with MPI and System V. IPC/shm. We also conduct a detailed performance analysis of this parallel application on the target system

Jiulong Shan | Yimin Zhang | Yurong Chen | Qian Diao

[1] Xinmin Tian,et al. Compiler support of the workqueuing execution model for Intel SMP architectures , 2002 .

[2] P.P. Gelsinger,et al. Microprocessors for the new millennium: Challenges, opportunities, and new frontiers , 2001, 2001 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC (Cat. No.01CH37177).

[3] Andreas Stolcke,et al. Using Conditional Random Fields for Sentence Boundary Detection in Speech , 2005, ACL.

[4] Ray Bryant,et al. Filesystem Performance and Scalability in Linux 2.4.17 , 2002, USENIX Annual Technical Conference, FREENIX Track.

[5] Andrew McCallum,et al. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[6] Fernando Pereira,et al. Shallow Parsing with Conditional Random Fields , 2003, NAACL.

[7] Minh Le Nguyen,et al. FlexCRFs: Flexible Conditional Random Fields , 2005 .