Numerical criteria for the evaluation of ab initio predictions of protein structure

As part of the CASP2 protein structure prediction experiment, a set of numerical criteria were defined for the evaluation of “ab initio” predictions. The evaluation package comprises a series of electronic submission formats, a submission validator, evaluation software, and a series of scripts to summarize the results for the CASP2 meeting and for presentation via the World Wide Web (WWW). The evaluation package is accessible for use on new predictions via WWW so that results can be compared to those submitted to CASP2. With further input from the community, the evaluation criteria are expected to evolve into a comprehensive set of measures capturing the overall quality of a prediction as well as critical detail essential for further development of prediction methods. We discuss present measures, limitations of the current criteria, and possible improvements. Proteins, Suppl. 1:140–150; 1997. © 1998 Wiley‐Liss, Inc.

[1]  B. Rost,et al.  Redefining the goals of protein secondary structure prediction. , 1994, Journal of molecular biology.

[2]  C. Sander,et al.  Protein structure comparison by alignment of distance matrices. , 1993, Journal of molecular biology.

[3]  C. Sander,et al.  Database of homology‐derived protein structures and the structural meaning of sequence alignment , 1991, Proteins.

[4]  G. Rose,et al.  Rigid domains in proteins: An algorithmic approach to their identification , 1995, Proteins.

[5]  P. Kraulis.  A program to produce both detailed and schematic plots of protein structures , 1991 .

[6]  A M Lesk,et al.  Systematic representation of protein folding patterns. , 1995, Journal of molecular graphics.

[7]  Burkhard Rost,et al.  PHD - an automatic mail server for protein secondary structure prediction , 1994, Comput. Appl. Biosci..

[8]  W. Kabsch,et al.  Dictionary of protein secondary structure: Pattern recognition of hydrogen‐bonded and geometrical features , 1983, Biopolymers.

[9]  P. Argos,et al.  Knowledge‐based protein secondary structure assignment , 1995, Proteins.

[10]  G. Barton,et al.  The limits of protein secondary structure prediction accuracy from multiple sequence alignment. , 1993, Journal of molecular biology.

[11]  F E Cohen,et al.  Evaluation of current techniques for Ab initio protein structure prediction , 1995, Proteins.

[12]  M. Totrov,et al.  Contact area difference (CAD): a robust measure to evaluate accuracy of protein models. , 1997, Journal of molecular biology.

[13]  N. Go,et al.  Common spatial arrangements of backbone fragments in homologous and non-homologous proteins. , 1992, Journal of molecular biology.

[14]  C. Sander,et al.  Fast and simple monte carlo algorithm for side chain optimization in proteins: Application to model building by homology , 1992, Proteins.

[15]  D. Bacon,et al.  A fast algorithm for rendering space-filling molecule pictures , 1988 .

[16]  B. Rost,et al.  A modified definition of Sov, a segment‐based measure for protein secondary structure prediction assessment , 1999, Proteins.

[17]  W R Taylor,et al.  A local alignment method for protein structure motifs. , 1993, Journal of molecular biology.

[18]  K Fidelis,et al.  A large‐scale experiment to assess protein structure prediction methods , 1995, Proteins.