MOTIVATION
Sequence clustering replaces groups of similar sequences in a database with single representatives. Clustering large protein databases like the NCBI Non-Redundant database (NR) using even the best currently available clustering algorithms is very time-consuming and only practical at relatively high sequence identity thresholds. Our previous program, CD-HI, clustered NR at 90% identity in approximately 1 h and at 75% identity in approximately 1 day on a 1 GHz Linux PC (Li et al., Bioinformatics, 17, 282, 2001); however even faster clustering speed is needed because the size of protein databases are rapidly growing and many applications desire a lower attainable thresholds.
RESULTS
For our previous algorithm (CD-HI), we have employed short-word filters to speed up the clustering. In this paper, we show that tolerating some redundancy makes for more efficient use of these short-word filters and increases the program's speed 100 times. Our new program implements this technique and clusters NR at 70% identity within 2 h, and at 50% identity in approximately 5 days. Although some redundancy is present after clustering, our new program's results only differ from our previous program's by less than 0.4%.
[1]
Liisa Holm,et al.
RSDB: representative protein sequence databases have high information content
,
2000,
Bioinform..
[2]
Chris Sander,et al.
Removing near-neighbour redundancy from large protein sequence collections
,
1998,
Bioinform..
[3]
Thomas L. Madden,et al.
Gapped BLAST and PSI-BLAST: a new generation of protein database search programs.
,
1997,
Nucleic acids research.
[4]
T. N. Bhat,et al.
The Protein Data Bank
,
2000,
Nucleic Acids Res..
[5]
Robert D. Finn,et al.
The Pfam protein families database
,
2004,
Nucleic Acids Res..
[6]
U. Hobohm,et al.
Selection of representative protein data sets
,
1992,
Protein science : a publication of the Protein Society.
[7]
Adam Godzik,et al.
Clustering of highly homologous sequences to reduce the size of large protein databases
,
2001,
Bioinform..