A further leap of improvement in tertiary structure prediction in CASP13 prompts new routes for future assessments

We present our assessment of tertiary structure predictions for hard targets in Critical Assessment of Structure Prediction round 13 (CASP13). The analysis includes (a) assignment and discussion of best models through scores‐aided visual inspection of models for each evaluation unit (EU); (b) ranking of predictors resulting from this evaluation and from global scores; and (c) evaluation of progress, state of the art, and current limitations of protein structure prediction. We witness a sizable improvement in tertiary structure prediction building on the progress observed from CASP11 to CASP12, with (a) top models reaching backbone RMSD <3 å for several EUs of size <150 residues, contributed by many groups; (b) at least one model that roughly captures global topology for all EUs, probably unprecedented in this track of CASP; and (c) even quite good models for full, unsplit targets. Better structure predictions are brought about mainly by improved residue‐residue contact predictions, and since this CASP also by distance predictions, achieved through state‐of‐the‐art machine learning methods which also progressed to work with slightly shallower alignments compared to CASP12. As we reach a new realm of tertiary structure prediction quality, new directions are proposed and explored for future CASPs: (a) dropping splitting into EUs, (b) rethinking difficulty metrics probably in terms of contact and distance predictions, (c) assessing also side chains for models of high backbone accuracy, and (d) assessing residue‐wise and possibly residue‐residue quality estimates.

[1]  Hongjun Bai,et al.  Assessment of template‐free modeling in CASP10 and ROLL , 2014, Proteins.

[2]  Joachim Frank,et al.  New Opportunities Created by Single-Particle Cryo-EM: The Mapping of Conformational Space , 2018, Biochemistry.

[3]  Lisa N Kinch,et al.  CASP13 target classification into tertiary structure prediction categories , 2019, Proteins.

[4]  Yang Zhang,et al.  How significant is a protein structure similarity with TM-score = 0.5? , 2010, Bioinform..

[5]  Andriy Kryshtafovych,et al.  Assessment of hard target modeling in CASP12 reveals an emerging role of alignment‐based contact prediction methods , 2018, Proteins.

[6]  Yang Zhang,et al.  Scoring function for automated assessment of protein structure template quality , 2004, Proteins.

[7]  Kliment Olechnovic,et al.  Comparative analysis of methods for evaluation of protein models against native structures , 2018, Bioinform..

[8]  Krzysztof Fidelis,et al.  CASP11 statistics and the prediction center evaluation system , 2016, Proteins.

[9]  Yuxing Liao,et al.  CASP9 assessment of free modeling target predictions , 2011, Proteins.

[10]  J. Sussman,et al.  JSmol and the Next-Generation Web-Based Representation of 3D Molecular Structure as Applied to Proteopedia , 2013 .

[11]  Vincent B. Chen,et al.  Correspondence e-mail: , 2000 .

[12]  Marco Biasini,et al.  lDDT: a local superposition-free score for comparing protein structures and models using distance difference tests , 2013, Bioinform..

[13]  Luciano A. Abriata,et al.  Web Apps Come of Age for Molecular Sciences , 2017, Informatics.

[14]  C Venclovas,et al.  Processing and analysis of CASP3 protein structure predictions , 1999, Proteins.

[15]  Lisa N Kinch,et al.  Definition and classification of evaluation units for tertiary structure prediction in CASP12 facilitated through semi‐automated metrics , 2018, Proteins.

[16]  A. Tramontano,et al.  Critical assessment of methods of protein structure prediction: Progress and new directions in round XI , 2016, Proteins.

[17]  Luc Patiny,et al.  Augmenting Research, Education, and Outreach with Client-Side Web Programming. , 2018, Trends in biotechnology.

[18]  Jacek Blazewicz,et al.  SphereGrinder - reference structure-based tool for quality assessment of protein structural models , 2015, 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[19]  Andriy Kryshtafovych,et al.  Assessment of contact predictions in CASP12: Co‐evolution and deep learning coming of age , 2017, Proteins.

[20]  Mohammed AlQuraishi,et al.  AlphaFold at CASP13 , 2019, Bioinform..