A retrospective analysis of CASP2 threading predictions

Analysis of CASP2 protein threading results shows that the success rate of structure predictions varies widely among prediction targets. We set “critical” thresholds in fold recognition specificity and threading model accuracy at the points where “incorrect” CASP2 predictions just outnumber “correct” predictions. Using these thresholds we find that correct predictions were made for all of those targets and for only those targets where more than 50% of target residues may be superimposed on previously known structures. Three‐fourths of these correct predictions were furthermore made for targets with greater than 12% residue identity in structural alignment, where characteristic sequence motifs are also present. Based on these observations we suggest that the sustained performance of threading methods is best characterized by counting the numbers of correct predictions for targets of increasing “difficulty.” We suggest that target difficulty may be assigned, once the true structure of the target is known, according to the fraction of residues superimposable onto previously known structures and the fraction of identical residues in those structural alignments. Proteins, Suppl. 1:83–91, 1997. © 1998 Wiley‐Liss, Inc.

[1]  W R Taylor,et al.  SSAP: sequential structure alignment program for protein structure comparison. , 1996, Methods in enzymology.

[2]  S. Wodak,et al.  Protein structure prediction by threading methods: Evaluation of current techniques , 1995, Proteins.

[3]  E Pennisi Teams Tackle Protein Prediction , 1996, Science.

[4]  Roland L. Dunbrack,et al.  Meeting review: the Second meeting on the Critical Assessment of Techniques for Protein Structure Prediction (CASP2), Asilomar, California, December 13-16, 1996. , 1997, Folding & design.

[5]  David C. Jones,et al.  Progress in protein structure prediction. , 1997, Current opinion in structural biology.

[6]  Janet M. Thornton,et al.  Protein fold recognition , 1993, J. Comput. Aided Mol. Des..

[7]  K Fidelis,et al.  A large‐scale experiment to assess protein structure prediction methods , 1995, Proteins.

[8]  S. Bryant,et al.  Threading a database of protein cores , 1995, Proteins.

[9]  J F Gibrat,et al.  Surprising similarities in structure comparison. , 1996, Current opinion in structural biology.

[10]  D. Eisenberg Into the black of night , 1997, Nature Structural Biology.

[11]  D Shortle Structure prediction: Folding proteins by pattern recognition , 1997, Current Biology.

[12]  M J Sippl,et al.  Progress in fold recognition , 1995, Proteins.

[13]  S H Bryant,et al.  Measures of threading specificity and accuracy , 1997, Proteins.

[14]  J Moult,et al.  The current state of the art in protein structure prediction. , 1996, Current opinion in biotechnology.

[15]  S. Bryant Evaluation of threading specificity and accuracy , 1996, Proteins.

[16]  M Levitt,et al.  Competitive assessment of protein fold recognition and alignment accuracy , 1997, Proteins.

[17]  S H Bryant,et al.  A measure of success in fold recognition. , 1997, Trends in biochemical sciences.

[18]  C Sander,et al.  Mapping the Protein Universe , 1996, Science.