Towards a consensus on datasets and evaluation metrics for developing B‐cell epitope prediction tools

A B‐cell epitope is the three‐dimensional structure within an antigen that can be bound to the variable region of an antibody. The prediction of B‐cell epitopes is highly desirable for various immunological applications, but has presented a set of unique challenges to the bioinformatics and immunology communities. Improving the accuracy of B‐cell epitope prediction methods depends on a community consensus on the data and metrics utilized to develop and evaluate such tools. A workshop, sponsored by the National Institute of Allergy and Infectious Disease (NIAID), was recently held in Washington, DC to discuss the current state of the B‐cell epitope prediction field. Many of the currently available tools were surveyed and a set of recommendations was devised to facilitate improvements in the currently existing tools and to expedite future tool development. An underlying theme of the recommendations put forth by the panel is increased collaboration among research groups. By developing common datasets, standardized data formats, and the means with which to consolidate information, we hope to greatly enhance the development of B‐cell epitope prediction tools. Copyright © 2007 John Wiley & Sons, Ltd.

[1]  Avner Schlessinger,et al.  Epitome: database of structure-inferred antigenic epitopes , 2005, Nucleic Acids Res..

[2]  R. Raz,et al.  ProMate: a structure based prediction program to identify the location of protein-protein binding sites. , 2004, Journal of molecular biology.

[3]  Conrad C. Huang,et al.  UCSF Chimera—A visualization system for exploratory research and analysis , 2004, J. Comput. Chem..

[4]  Sandor Vajda,et al.  ClusPro: an automated docking and discrimination method for the prediction of protein complexes , 2004, Bioinform..

[5]  Vladimir Brusic,et al.  Computational methods for prediction of T-cell epitopes--a framework for modelling, testing, and applications. , 2004, Methods.

[6]  Frances S. House,et al.  Genetic and structural determinants of virus neutralizing antibodies , 2001, Immunologic research.

[7]  Bonnie Kirkpatrick,et al.  A New Method for Mapping Discontinuous Antibody Epitopes to Reveal Structural Features of Proteins , 2003, J. Comput. Biol..

[8]  R E Cachau,et al.  A new addition to the structural bioinformatics toolbox: 3D models of short bioactive peptides from multiple sequences using feedback restrained molecular dynamics (FRMD). , 2003, Cellular and molecular biology.

[9]  Ole Lund,et al.  Immunological Bioinformatics (Computational Molecular Biology) , 2005 .

[10]  Anne S. De Groot,et al.  Immunomics: discovering new targets for vaccines and therapeutics , 2006 .

[11]  D. Flower,et al.  Benchmarking B cell epitope prediction: Underperformance of existing methods , 2005, Protein science : a publication of the Protein Society.

[12]  T. N. Bhat,et al.  The Protein Data Bank , 2000, Nucleic Acids Res..

[13]  Ruth Nussinov,et al.  Efficient Unbound Docking of Rigid Molecules , 2002, WABI.

[14]  Morten Nielsen,et al.  Immunological bioinformatics , 2005, Computational molecular biology.

[15]  Channa K. Hattotuwagama,et al.  AntiJen: a quantitative immunology database integrating functional, thermodynamic, kinetic, biophysical, and cellular data , 2005, Immunome research.

[16]  Erwin L Roggen,et al.  An in silico method using an epitope motif database for predicting the location of antigenic determinants on proteins in a structural context , 2006, Journal of molecular recognition : JMR.

[17]  R. Hodges,et al.  New hydrophilicity scale derived from high-performance liquid chromatography peptide retention data: correlation of predicted surface residues with antigenicity and X-ray-derived accessible sites. , 1986, Biochemistry.

[18]  Anne S De Groot,et al.  Immunomics: discovering new targets for vaccines and therapeutics. , 2006, Drug discovery today.

[19]  O. Lund,et al.  The Immune Epitope Database and Analysis Resource: From Vision to Blueprint , 2005, PLoS biology.

[20]  R. Meloen,et al.  Mimotopes: realization of an unlikely concept , 2000, Journal of molecular recognition : JMR.

[21]  Harpreet Kaur Saini,et al.  BIOINFORMATICS APPLICATIONS NOTE Structural bioinformatics Meta-DP: domain prediction meta-server , 2022 .

[22]  Minoru Kanehisa,et al.  AAindex: Amino Acid index database , 2000, Nucleic Acids Res..

[23]  Urmila Kulkarni-Kale,et al.  CEP: a conformational epitope prediction server , 2005, Nucleic Acids Res..

[24]  Burkhard Rost,et al.  Static benchmarking of membrane helix predictions , 2003, Nucleic Acids Res..

[25]  Nicole Frahma,et al.  HIV Molecular Immunology 2005 , 2006 .

[26]  M. Bhasin,et al.  Bcipep: A database of B-cell epitopes , 2005, BMC Genomics.

[27]  Morten Nielsen,et al.  Improved method for predicting linear B-cell epitopes , 2006, Immunome research.

[28]  Bernd Mayer,et al.  Machine learning approaches for prediction of linear B‐cell epitopes on proteins , 2006, Journal of molecular recognition : JMR.

[29]  P. Underwood,et al.  An antigenic map of the haemagglutinin of the influenza Hong Kong subtype (H3N2), constructed using mouse monoclonal antibodies. , 1984, Molecular immunology.

[30]  Marc A. Martí-Renom,et al.  EVA: evaluation of protein structure prediction servers , 2003, Nucleic Acids Res..

[31]  M. H. Regenmortel,et al.  Immunoinformatics may lead to a reappraisal of the nature of B cell epitopes and of the feasibility of synthetic peptide vaccines. , 2006 .

[32]  Marc H V Van Regenmortel,et al.  Immunoinformatics may lead to a reappraisal of the nature of B cell epitopes and of the feasibility of synthetic peptide vaccines , 2006, Journal of molecular recognition : JMR.

[33]  Jean-Luc Pellequer,et al.  BEPITOPE: predicting the location of continuous epitopes and patterns in proteins , 2003, Journal of molecular recognition : JMR.

[34]  David R. Westhead,et al.  Improved prediction of protein-protein binding sites using a support vector machines approach. , 2005, Bioinformatics.

[35]  M.H.V. Van Regenmortel,et al.  Antigenicity and immunogenicity of synthetic peptides. , 2001 .

[36]  E Westhof,et al.  Correlation between the location of antigenic sites and the prediction of turns in proteins. , 1993, Immunology letters.

[37]  Johannes Söllner,et al.  Selection and combination of machine learning classifiers for prediction of linear B‐cell epitopes on proteins , 2006, Journal of molecular recognition : JMR.

[38]  Sudipto Saha,et al.  Prediction of continuous B‐cell epitopes in an antigen using recurrent neural network , 2006, Proteins.

[39]  J A Swets,et al.  Measuring the accuracy of diagnostic systems. , 1988, Science.

[40]  M. V. Van Regenmortel,et al.  Antigenicity and immunogenicity of synthetic peptides. , 2001, Biologicals : journal of the International Association of Biological Standardization.

[41]  R A Houghten,et al.  Crystal structure of a peptide complex of anti-influenza peptide antibody Fab 26/9. Comparison of two different antibodies bound to the same peptide antigen. , 1994, Journal of molecular biology.

[42]  Arne Elofsson,et al.  Structure prediction meta server , 2001, Bioinform..