Comparison of Annotation Services for Next-Generation Sequencing in a Large-Scale Precision Oncology Program.

PURPOSE Next-generation sequencing (NGS) multigene panel testing has become widespread, including the Veterans Affairs (VA), through the VA National Precision Oncology Program (NPOP). The interpretation of genomic alterations remains a bottleneck for realizing precision medicine. We sought to examine the concordance for pathogenicity determination and clinical actionability of annotation services in NPOP. METHODS Unique gene variants were generated from NGS gene panel results using two sequencing services. For each unique gene variant, annotations were provided through N-of-One (NoO), IBM Watson for Genomics (WfG), and OncoKB. Annotations for pathogenicity (all three sources) and actionability (WfG and OncoKB) were examined for concordance. Cohen's kappa statistic was calculated to measure agreement between annotation services. RESULTS Among 1,227 NGS results obtained between 2015 and 2017, 1,388 unique variants were identified in 117 genes. The genes with the largest number of variants included TP53 (270), STK11 (92), and CDKN2A (81). The most common cancer type was lung adenocarcinoma (440), followed by colon adenocarcinoma (113). For pathogenic and likely pathogenic variants, there was 30% agreement between WfG and NoO (kappa, -0.26), 76% agreement between WfG and OncoKB (kappa, 0.22), and 42% agreement between NoO and OncoKB (kappa, -0.07). For level 1 drug actionability of gene variant-diagnosis combinations, there was moderate agreement between WfG and OncoKB (96.9%; kappa, 0.44), with 27 combinations identified as level 1 by both services, 58 by WfG alone, and 6 variants by OncoKB alone. CONCLUSION There is substantial variability in pathogenicity assessment of NGS variants in solid tumors by annotation services. In addition, there was only moderate agreement in level 1 therapeutic actionability recommendations between WfG and OncoKB. Improvement in the precision of NGS multigene panel annotation is needed.

[1]  Brian R. Gastman,et al.  NCCN Guidelines® insights: Melanoma, version 3.2016: Featured updates to the NCCN Guidelines , 2016 .

[2]  R. Mannel,et al.  Is the NCI MATCH trial a match for gynecologic oncology? , 2016, Gynecologic oncology.

[3]  T. Brettin,et al.  Genomic Analysis of Metastatic Solid Tumors in Veterans: Findings From the VHA National Precision Oncology Program. , 2019, JCO precision oncology.

[4]  Woon-Kee Lee,et al.  Gene expression assay and Watson for Oncology for optimization of treatment in ER-positive, HER2-negative breast cancer , 2018, PloS one.

[5]  Shashikant Kulkarni,et al.  Good laboratory practice for clinical next-generation sequencing informatics pipelines , 2015, Nature Biotechnology.

[6]  Marina N Nikiforova,et al.  Guidelines for Validation of Next-Generation Sequencing-Based Oncology Panels: A Joint Consensus Recommendation of the Association for Molecular Pathology and College of American Pathologists. , 2017, The Journal of molecular diagnostics : JMD.

[7]  H. West.  No Solid Evidence, Only Hollow Argument for Universal Tumor Sequencing: Show Me the Data. , 2016, JAMA oncology.

[8]  Bert Vogelstein,et al.  PD-1 Blockade in Tumors with Mismatch-Repair Deficiency. , 2015, The New England journal of medicine.

[9]  Larry Wright,et al.  Overview and Utilization of the NCI Thesaurus , 2004, Comparative and functional genomics.

[10]  Nicolas Servant,et al.  Molecularly targeted therapy based on tumour molecular profiling versus conventional therapy for advanced cancer (SHIVA): a multicentre, open-label, proof-of-concept, randomised, controlled phase 2 trial. , 2015, The Lancet. Oncology.

[11]  Edward S. Kim,et al.  Rationale and Design of the Targeted Agent and Profiling Utilization Registry (TAPUR) Study. , 2018, JCO precision oncology.

[12]  M. Robson,et al.  American Society of Clinical Oncology Policy Statement Update: Genetic and Genomic Testing for Cancer Susceptibility. , 2010, Journal of Clinical Oncology.

[13]  Jyotishman Pathak,et al.  The Role of Next-Generation Sequencing in Precision Medicine: A Review of Outcomes in Oncology , 2018, Journal of personalized medicine.

[14]  Eliot Y. Zhu,et al.  Cancer Driver Log (CanDL): Catalog of Potentially Actionable Cancer Mutations. , 2015, The Journal of molecular diagnostics : JMD.

[15]  Moriah H Nissan,et al.  OncoKB: A Precision Oncology Knowledge Base. , 2017, JCO precision oncology.

[16]  S. O'toole,et al.  BRAF inhibitor activity in V600R metastatic melanoma. , 2013, European journal of cancer.

[17]  Marilyn M. Li,et al.  Standards and Guidelines for the Interpretation and Reporting of Sequence Variants in Cancer: A Joint Consensus Recommendation of the Association for Molecular Pathology, American Society of Clinical Oncology, and College of American Pathologists. , 2017, The Journal of molecular diagnostics : JMD.

[18]  Anuradha Lakshminarayana,et al.  The clinical trial landscape in oncology and connectivity of somatic mutational profiles to targeted therapies , 2016, Human Genomics.

[19]  Alexis B. Carter,et al.  Standards and Guidelines for Validating Next-Generation Sequencing Bioinformatics Pipelines: A Joint Recommendation of the Association for Molecular Pathology and the College of American Pathologists. , 2018, The Journal of molecular diagnostics : JMD.

[20]  Marcin Imielinski,et al.  The cancer precision medicine knowledge base for structured clinical-grade mutations and interpretations , 2016, J. Am. Medical Informatics Assoc..

[21]  Benjamin E. Gross,et al.  The cBio cancer genomics portal: an open platform for exploring multidimensional cancer genomics data. , 2012, Cancer discovery.

[22]  D. Hayes,et al.  The next steps in next-gen sequencing of cancer genomes. , 2015, The Journal of clinical investigation.

[23]  Ludmila V. Danilova,et al.  Mismatch repair deficiency predicts response of solid tumors to PD-1 blockade , 2017, Science.

[24]  Yi-long Wu,et al.  Molecular characteristics and clinical outcomes of EGFR exon 19 indel subtypes to EGFR TKIs in NSCLC patients , 2017, Oncotarget.

[25]  Benjamin J. Raphael,et al.  Mutational landscape and significance across 12 major cancer types , 2013, Nature.

[26]  Marie-Cécile Le Deley,et al.  High-Throughput Genomics and Clinical Outcome in Hard-to-Treat Advanced Cancers: Results of the MOSCATO 01 Trial. , 2017, Cancer discovery.

[27]  Laxmi Parida,et al.  Watson for Genomics: Moving Personalized Medicine Forward. , 2016, Trends in cancer.

[28]  P. Lavori,et al.  The VA Point-of-Care Precision Oncology Program: Balancing Access with Rapid Learning in Molecular Cancer Medicine , 2016, Biomarkers in cancer.

[29]  J. Reis-Filho,et al.  Pan-cancer analysis of intratumor heterogeneity as a prognostic determinant of survival , 2016, Oncotarget.

[30]  Funda Meric-Bernstam,et al.  Personalized cancer therapy—leveraging a knowledge base for clinical decision-making , 2018, Cold Spring Harbor molecular case studies.

[31]  Alex H. Wagner,et al.  A harmonized meta-knowledgebase of clinical interpretations of somatic genomic variants in cancer , 2020, Nature Genetics.

[32]  Razelle Kurzrock,et al.  Personalized Medicine for Patients with Advanced Cancer in the Phase I Program at MD Anderson: Validation and Landmark Analyses , 2014, Clinical Cancer Research.

[33]  Christine M. Micheel,et al.  The Path(way) Less Traveled: A Pathway-Oriented Approach to Providing Information about Precision Cancer Medicine on My Cancer Genome12 , 2016, Translational oncology.

[34]  W. Berger,et al.  Results of the extended analysis for cancer treatment (EXACT) trial: a prospective translational study evaluating individualized treatment regimens in oncology , 2019, Oncotarget.

[35]  E H Shortliffe,et al.  Watson for Oncology and breast cancer treatment recommendations: agreement with an expert multidisciplinary tumor board , 2018, Annals of oncology : official journal of the European Society for Medical Oncology.

[36]  Michael P. Schroeder,et al.  Cancer Genome Interpreter annotates the biological and clinical relevance of tumor alterations , 2017, Genome Medicine.

[37]  Razelle Kurzrock,et al.  Personalized Medicine in a Phase I Clinical Trials Program: The MD Anderson Cancer Center Initiative , 2012, Clinical Cancer Research.

[38]  Laxmi Parida,et al.  Enhancing Next‐Generation Sequencing‐Guided Cancer Care Through Cognitive Computing , 2017, The oncologist.

[39]  Chia-Chi Lin,et al.  New data on clinical decisions in NSCLC patients with uncommon EGFR mutations , 2017, Expert review of respiratory medicine.

[40]  Steven J. M. Jones,et al.  CIViC is a community knowledgebase for expert crowdsourcing the clinical interpretation of variants in cancer , 2017, Nature Genetics.