Natural Language Multiprocessing: A Case Study

This paper presents two case studies of parallelization of large Natural Language Processing (NLP) applications using a parallel logic programming system (called "ACE") that automatically exploits implicit parallelism. The first system considered is Artwork, a system for semantic disambiguation, speech act resolution, and temporal reference resolution. The second system is ULTRA, a multilingual translation system. Both applications were originally developed in Prolog without any consideration for parallel processing. The results obtained confirm that NLP is a ripe area for exploitation of parallelism. Most previous work on parallelism in NLP focused primarily on parallelizing the parsing phase of language processing. The case studies presented here show that parallelism is also present in the semantic and discourse processing phases, which are often the most computationally intensive part of the application.

[1]  Patrick Saint-Dizier,et al.  Review of Prolog and natural-language analysis: CSLI lecture notes 10 by Fernando C. N. Pereira and Stuart M. Shieber. Center for the Study of Language and Information 1987. , 1988 .

[2]  Doug DeGroot,et al.  Restricted AND-Parallelism , 1984, FGCS.

[3]  Enrico Pontelli,et al.  ACE: And/Or-parallel Copying-based Execution of Logic Programs , 1994, ICLP.

[4]  Johnny Chen,et al.  ARTWORK: Discourse Processing in Machine Translation of Dialog , 1995 .

[5]  Stuart M. Shieber,et al.  Prolog and Natural-Language Analysis , 1987 .

[6]  Pascal Van Hentenryck ACE: And/Or-parallel Copying-based Execution of Logic Programs , 1994 .

[7]  Norbert Reithinger,et al.  Utilizing Statistical Dialogue Act Processing in Verbrnobil , 1995, ACL.

[8]  Yorick Wilks,et al.  ULTRA: A Multi-lingual Machine Translator , 1991, MTSUMMIT.

[9]  Enrico Pontelli,et al.  Efficient parallel execution of prolog programs , 1997 .

[10]  Geert Adriaens,et al.  Parallel Natural Language Processing , 1994 .

[11]  Rajiv Trehan,et al.  A Parallel Chart Parser for the Committed Choice Non-Deterministic Logic Languages , 1988, ICLP/SLP.

[12]  Janyce Wiebe,et al.  An Empirical Approach to Temporal Reference Resolution , 1997, EMNLP.

[13]  George K. Papakonstantinou,et al.  Automatic generation of portable parallel natural language parsers , 1997, Proceedings Ninth IEEE International Conference on Tools with Artificial Intelligence.

[14]  Carolyn Penstein Rosé,et al.  Discourse Processing of Dialogues with Multiple Threads , 1995, ACL.

[15]  Yuji Matsumoto A Parallel Parsing System for Natural Language Analysis , 1986, ICLP.

[16]  Khayri A. M. Ali,et al.  The Muse Or-Parallel Prolog Model and its Performance , 1990, NACLP.

[17]  Peter J. Stuckey,et al.  Incremental Analysis of Logic Programs , 1995, ICLP.