The Jaccard/Tanimoto coefficient is an important workload, used in a large variety of problems including drug design fingerprinting, clustering analysis, similarity web searching and image segmentation. This paper evaluates the Jaccard coefficient on three platforms: the Cell Broadband EngineTMprocessor Intel ®Xeon ®dual-core platform and Nvidia ®8800 GTX GPU. In our work, we have developed a novel parallel algorithm specially suited for the Cell/B.E. architecture for all-to-all Jaccard comparisons, that minimizes DMA transfers and reuses data in the local store. We show that our implementation on Cell/B.E. outperforms the implementations on comparable Intel platforms by 6-20X with full accuracy, and from 10-50X in reduced accuracy mode, depending on the size of the data, and by more than 60X compared to Nvidia 8800 GTX. In addition to performance, we also discuss in detail our efforts to optimize our workload on these architectures and explain how avenues for optimization on each architecture are very different and vary from one architecture to another for our workload. Our work shows that the algorithms or kernels employed for the Jaccard coefficient calculation are heavily dependent on the traits of the target hardware.
[1]
Peter Willett,et al.
Similarity-based virtual screening using 2D fingerprints.
,
2006,
Drug discovery today.
[2]
Tsuyoshi Murata,et al.
Machine Discovery Based on the Co-occurrence of References in a Search Engine
,
1999,
Discovery Science.
[3]
Andreas Mild,et al.
Collaborative Filtering Methods for Binary Market Basket Data Analysis
,
2001,
Active Media Technology.
[4]
P. Jaccard.
THE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE.1
,
1912
.
[5]
Eyas El-Qawasmeh.
Performance Investigation of Bit-Counting Algorithms with a Speedup to Lookup Table
,
2000,
J. Res. Pract. Inf. Technol..
[6]
Jon M. Kleinberg,et al.
The link-prediction problem for social networks
,
2007,
J. Assoc. Inf. Sci. Technol..
[7]
D. Geer,et al.
Chip makers turn to multicore processors
,
2005,
Computer.