Quark enables semi‐reference‐based compression of RNA‐seq data

Motivation The past decade has seen an exponential increase in biological sequencing capacity, and there has been a simultaneous effort to help organize and archive some of the vast quantities of sequencing data that are being generated. Although these developments are tremendous from the perspective of maximizing the scientific utility of available data, they come with heavy costs. The storage and transmission of such vast amounts of sequencing data is expensive. Results We present Quark, a semi‐reference‐based compression tool designed for RNA‐seq data. Quark makes use of a reference sequence when encoding reads, but produces a representation that can be decoded independently, without the need for a reference. This allows Quark to achieve markedly better compression rates than existing reference‐free schemes, while still relieving the burden of assuming a specific, shared reference sequence between the encoder and decoder. We demonstrate that Quark achieves state‐of‐the‐art compression rates, and that, typically, only a small fraction of the reference sequence must be encoded along with the reads to allow reference‐free decompression. Availability and implementation Quark is implemented in C ++11, and is available under a GPLv3 license at www.github.com/COMBINE‐lab/quark. Contact rob.patro@cs.stonybrook.edu Supplementary information Supplementary data are available at Bioinformatics online.

[1]  Alistair Moffat,et al.  Lossy compression of quality scores in genomic data , 2014, Bioinform..

[2]  Rob Patro,et al.  Sailfish enables alignment-free isoform quantification from RNA-seq reads using lightweight algorithms , 2013, Nature Biotechnology.

[3]  Lior Pachter,et al.  Near-optimal probabilistic RNA-seq quantification , 2016, Nature Biotechnology.

[4]  Steven L Salzberg,et al.  Fast gapped-read alignment with Bowtie 2 , 2012, Nature Methods.

[5]  Jacob Pritt,et al.  Boiler: Lossy compression of RNA-seq alignments using coverage vectors , 2016 .

[6]  Avi Srivastava,et al.  RapMap: A Rapid, Sensitive and Accurate Tool for Mapping RNA-seq Reads to Transcriptomes , 2015 .

[7]  Walter L. Ruzzo,et al.  Compression of next-generation sequencing reads aided by highly efficient de novo assembly , 2012, Nucleic acids research.

[8]  Robert Patro,et al.  Data-dependent bucketing improves reference-free compression of sequencing reads , 2015, Bioinform..

[9]  Yong Zhang,et al.  DNA sequence compression using the Burrows-Wheeler Transform , 2002, Proceedings. IEEE Computer Society Bioinformatics Conference.

[10]  James K. Bonfield,et al.  Compression of FASTQ and SAM Format Sequencing Data , 2013, PloS one.

[11]  Mikel Hernaez,et al.  QVZ: lossy compression of quality values , 2018, Bioinform..

[12]  Robert Patro,et al.  Sailfish: Alignment-free Isoform Quantification from RNA-seq Reads using Lightweight Algorithms , 2013, ArXiv.

[13]  Jihoon Kim,et al.  HUGO: Hierarchical mUlti-reference Genome cOmpression for aligned reads , 2013, J. Am. Medical Informatics Assoc..

[14]  L. Coin,et al.  Haplotype and isoform specific expression estimation using multi-mapping RNA-seq reads , 2011, Genome Biology.

[15]  Markus Hsi-Yang Fritz,et al.  Efficient storage of high throughput DNA sequencing data using reference-based compression. , 2011, Genome research.

[16]  Thomas R. Gingeras,et al.  STAR: ultrafast universal RNA-seq aligner , 2013, Bioinform..

[17]  Dominique Lavenier,et al.  Reference-free compression of high throughput sequencing data with a probabilistic de Bruijn graph , 2015, BMC Bioinformatics.

[18]  Rob Patro,et al.  Salmon provides fast and bias-aware quantification of transcript expression , 2017, Nature Methods.

[19]  James K. Bonfield,et al.  The Scramble conversion tool , 2014, bioRxiv.

[20]  Bonnie Berger,et al.  Compressive mapping for next-generation sequencing , 2016, Nature Biotechnology.

[21]  Faraz Hach,et al.  SCALCE: boosting sequence compression algorithms using locally consistent encoding , 2012, Bioinform..

[22]  Zhen Ji,et al.  Compression of next-generation sequencing quality scores using memetic algorithm , 2014, BMC Bioinformatics.

[23]  Giovanna Rosone,et al.  Adaptive reference-free compression of sequence quality scores , 2014, Bioinform..

[24]  Robert Patro,et al.  Reference-based compression of short-read sequences using path encoding , 2015, Bioinform..