Proficiency Testing for bacterial whole genome sequencing in assuring the quality of microbiology diagnostics in clinical and public health laboratories

The adoption of whole genome sequencing (WGS) data over the past decade for pathogen surveillance, and decision-making for infectious diseases has rapidly transformed the landscape of clinical microbiology and public health. However, for successful transition to routine use of these techniques, it is crucial to ensure the WGS data generated meet defined quality standards for pathogen identification, typing, antimicrobial resistance detection and surveillance. Further, the ongoing development of these standards will ensure that the bioinformatic processes are capable of accurately identifying and characterising organisms of interest, and thereby facilitate the integration of WGS into routine clinical and public health laboratory setting. A pilot proficiency testing (PT) program for WGS of infectious agents was developed to facilitate widely applicable standardisation and benchmarking standards for WGS across a range of laboratories. The PT participating laboratories were required to generate WGS data from two bacterial isolates, and submit the raw data for independent bioinformatics analysis, as well as analyse the data with their own processes and answer relevant questions about the data. Overall, laboratories used a diverse range of bioinformatics tools and could generate and analyse high-quality data, either meeting or exceeding the minimum requirements. This pilot has provided valuable insight into the current state of genomics in clinical microbiology and public health laboratories across Australia. It will provide a baseline guide for the standardisation of WGS and enable the development of a PT program that allows an ongoing performance benchmark for accreditation of WGS-based test processes.

[1]  G. Van Domselaar,et al.  Comparison of Sample Preparation Methods Used for the Next-Generation Sequencing of Mycobacterium tuberculosis , 2016, PloS one.

[2]  Natalie Morrell,et al.  Bead-linked transposomes enable a normalization-free workflow for NGS library preparation , 2018, BMC Genomics.

[3]  Ruth Timme,et al.  Practical Value of Food Pathogen Traceability through Building a Whole-Genome Sequencing Network and Database , 2016, Journal of Clinical Microbiology.

[4]  F. Bonfiglio,et al.  Evaluation of Rapid Library Preparation Protocols for Whole Genome Sequencing Based Outbreak Investigation , 2019, Front. Public Health.

[5]  Vitali Sintchenko,et al.  Proficiency testing for bacterial whole genome sequencing: an end-user survey of current capabilities, requirements and priorities , 2015, BMC Infectious Diseases.

[6]  Rebecca J Hutchins,et al.  Practical Guidance to Implementing Quality Management Systems in Public Health Laboratories Performing Next-Generation Sequencing: Personnel, Equipment, and Process Management (Phase 1) , 2019, Journal of Clinical Microbiology.

[7]  Sven Rahmann,et al.  Genome analysis , 2022 .

[8]  Tetsuya Hayashi,et al.  Evaluation of SNP calling methods for closely related bacterial isolates and a novel high-accuracy pipeline: BactSNP , 2019, Microbial genomics.

[9]  Björn Usadel,et al.  Trimmomatic: a flexible trimmer for Illumina sequence data , 2014, Bioinform..

[10]  J. Musser,et al.  A Genomic Day in the Life of a Clinical Microbiology Laboratory , 2013, Journal of Clinical Microbiology.

[11]  Alexey A. Gurevich,et al.  QUAST: quality assessment tool for genome assemblies , 2013, Bioinform..

[12]  Marc L. Salit,et al.  Best practices for evaluating single nucleotide variant calling methods for microbial genomics , 2015, Front. Genet..

[13]  Keith A Jolley,et al.  Open-access bacterial population genomics: BIGSdb software, the PubMLST.org website and their applications , 2018, Wellcome open research.

[14]  M. Gwinn,et al.  Next-Generation Sequencing of Infectious Pathogens. , 2019, JAMA.

[15]  Shashikant Kulkarni,et al.  Good laboratory practice for clinical next-generation sequencing informatics pipelines , 2015, Nature Biotechnology.

[16]  Matthias Reumann,et al.  WGS Analysis and Interpretation in Clinical and Public Health Microbiology Laboratories: What Are the Requirements and How Do Existing Tools Compare? , 2014, Pathogens.

[17]  G. Pavesi,et al.  Evaluation of Quality Assessment Protocols for High Throughput Genome Resequencing Data , 2017, Front. Genet..

[18]  F. van Nieuwerburgh,et al.  Library construction for next-generation sequencing: overviews and challenges. , 2014, BioTechniques.

[19]  T. Clark,et al.  Discordant bioinformatic predictions of antimicrobial resistance from whole-genome sequencing data of bacterial isolates: an inter-laboratory study , 2019, bioRxiv.

[20]  Brian D. Ondov,et al.  Mash: fast genome and metagenome distance estimation using MinHash , 2015, Genome Biology.

[21]  Martin Beer,et al.  Proficiency Testing of Virus Diagnostics Based on Bioinformatics Analysis of Simulated In Silico High-Throughput Sequencing Data Sets , 2019, Journal of Clinical Microbiology.

[22]  V. Sintchenko,et al.  The importance of public health genomics for ensuring health security for Australia , 2019, The Medical journal of Australia.

[23]  Derrick E. Wood,et al.  Kraken: ultrafast metagenomic sequence classification using exact alignments , 2014, Genome Biology.

[24]  Sergey I. Nikolenko,et al.  SPAdes: A New Genome Assembly Algorithm and Its Applications to Single-Cell Sequencing , 2012, J. Comput. Biol..

[25]  Eduardo N. Taboada,et al.  The Salmonella In Silico Typing Resource (SISTR): An Open Web-Accessible Tool for Rapidly Typing and Subtyping Draft Salmonella Genome Assemblies , 2016, PloS one.

[26]  J A Carriço,et al.  A primer on microbial bioinformatics for nonbioinformaticians. , 2018, Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases.

[27]  Liam P. Shaw,et al.  Genomic diversity affects the accuracy of bacterial SNP calling pipelines , 2019, bioRxiv.

[28]  Daniel J. Wilson,et al.  Transforming clinical microbiology with bacterial genome sequencing , 2012, Nature Reviews Genetics.

[29]  Ruth E. Timme,et al.  GenomeTrakr proficiency testing for foodborne pathogen surveillance: an exercise from 2015 , 2018, Microbial genomics.

[30]  Vanessa Sochat,et al.  Singularity: Scientific containers for mobility of compute , 2017, PloS one.

[31]  Barbara Zehnbauer,et al.  Current landscape and new paradigms of proficiency testing and external quality assessment for molecular genetics. , 2013, Archives of pathology & laboratory medicine.