论文信息 - High speed text retrieval from large databases on a massively parallel processor

High speed text retrieval from large databases on a massively parallel processor

Abstract A word-based text document retrieval system is being implemented by AMT (Active Memory Technology) on the AMT DAP series of massively parallel computers. For a 20 G Byte database of 10 million documents a system with 2 DAP 610s can sustain around 70 Boolean queries per second. Any of these parameters can be extended. In the initial application the addition of two DAP 610s to a cluster of four large VAXes will increase the performance by several hundred times.

S. F. Reddaway

[1] S. F. Reddaway,et al. High speed data searching with a processor array , 1988 .

[2] D. J. Hunt. AMT DAP—a processor array in a workstation environment , 1989 .

[3] David L. Waltz,et al. A parallel indexed algorithm for information retrieval , 1989, SIGIR '89.

[4] Roger L. Haskin,et al. Architecture and Operation of a Large, Full-Text Information-Retrieval System , 1983, Advanced Database Machine Architecture.

[5] Craig Stanfill,et al. Parallel free-text search on the connection machine system , 1986, CACM.

[6] D. A. Morris. Processor matches text at high speeds , 1983 .

[7] Craig Stanfill. Partitioned posting files: a parallel inverted file structure for information retrieval , 1989, SIGIR '90.

[8] Edward Babb,et al. Implementing a relational database by means of specialzed hardware , 1979, TODS.