Benchmarking single-cell RNA-sequencing protocols for cell atlas projects

Single-cell RNA sequencing (scRNA-seq) is the leading technique for characterizing the transcriptomes of individual cells in a sample. The latest protocols are scalable to thousands of cells and are being used to compile cell atlases of tissues, organs and organisms. However, the protocols differ substantially with respect to their RNA capture efficiency, bias, scale and costs, and their relative advantages for different applications are unclear. In the present study, we generated benchmark datasets to systematically evaluate protocols in terms of their power to comprehensively describe cell types and states. We performed a multicenter study comparing 13 commonly used scRNA-seq and single-nucleus RNA-seq protocols applied to a heterogeneous reference sample resource. Comparative analysis revealed marked differences in protocol performance. The protocols differed in library complexity and their ability to detect cell-type markers, impacting their predictive value and suitability for integration into reference cell atlases. These results provide guidance both for individual researchers and for consortium projects such as the Human Cell Atlas. A multicenter study compares 13 commonly used single-cell RNA-seq protocols.

[1]  P. Kharchenko,et al.  Bayesian approach to single-cell differential expression analysis , 2014, Nature Methods.

[2]  Christian H. Holland,et al.  Robustness and applicability of transcription factor and pathway analysis tools on single-cell RNA-seq data , 2020, Genome Biology.

[3]  Chun Jimmie Ye,et al.  Multiplexed droplet single-cell RNA-sequencing using natural genetic variation , 2017, Nature Biotechnology.

[4]  Tetsutaro Hayashi,et al.  Quartz-Seq2: a high-throughput single-cell RNA-sequencing method that effectively uses limited sequence reads , 2017, Genome Biology.

[5]  I. Amit,et al.  Single-cell transcriptome conservation in cryopreserved cells and tissues , 2016, Genome Biology.

[6]  David A. Weitz,et al.  Scaling by shrinking: empowering single-cell 'omics' with microfluidic devices , 2017, Nature Reviews Genetics.

[7]  Lucas E. Wange,et al.  Sensitive and powerful single-cell RNA sequencing using mcSCRB-seq , 2018, Nature Communications.

[8]  Aviv Regev,et al.  Nuclei multiplexing with barcoded antibodies for single-nucleus genomics , 2018 .

[9]  Holger Heyn,et al.  Tutorial: guidelines for the experimental design of single-cell RNA sequencing studies , 2018, Nature Protocols.

[10]  Timur Zhiyentayev,et al.  Single-cell in situ RNA profiling by sequential hybridization , 2014, Nature Methods.

[11]  A. van Oudenaarden,et al.  Single-cell sequencing reveals dissociation-induced gene expression in tissue subpopulations , 2017, Nature Methods.

[12]  Giovanni Iacono,et al.  Sampling artifacts in single-cell genomics cohort studies , 2020, bioRxiv.

[13]  I. Hellmann,et al.  Comparative Analysis of Single-Cell RNA Sequencing Methods , 2016, bioRxiv.

[14]  Michael C. Heinold,et al.  A comprehensive assessment of somatic mutation detection in cancer using whole-genome sequencing , 2015, Nature Communications.

[15]  A. Regev,et al.  Spatial reconstruction of single-cell gene expression data , 2015 .

[16]  Yarden Katz,et al.  A single-cell survey of the small intestinal epithelium , 2017, Nature.

[17]  Aviv Regev,et al.  A revised airway epithelial hierarchy includes CFTR-expressing ionocytes , 2018, Nature.

[18]  Jennifer L Hu,et al.  MULTI-seq: sample multiplexing for single-cell RNA sequencing using lipid-tagged indices , 2019, Nature Methods.

[19]  Helder I Nakaya,et al.  Molecular degree of perturbation of plasma inflammatory markers associated with tuberculosis reveals distinct disease profiles between Indian and Chinese populations , 2019, Scientific Reports.

[20]  Foo Wei Ten,et al.  Single nucleus RNA sequencing maps acinar cell states in a human pancreas cell atlas , 2019, bioRxiv.

[21]  Sarah A Teichmann,et al.  A test metric for assessing single-cell RNA-seq batch correction , 2018, Nature Methods.

[22]  Åsa K. Björklund,et al.  Tn5 transposase and tagmentation procedures for massively scaled sequencing projects , 2014, Genome research.

[23]  Jun-An Ma,et al.  Homochirality in biomineral suprastructures induced by assembly of single-enantiomer amino acids from a nonracemic mixture , 2019, Nature Communications.

[24]  Fan Zhang,et al.  Fast, sensitive, and accurate integration of single cell data with Harmony , 2018, bioRxiv.

[25]  Fabian J Theis,et al.  Cell type atlas and lineage tree of a whole complex animal by single-cell transcriptomics , 2018, Science.

[26]  Charlotte Soneson,et al.  Bias, robustness and scalability in single-cell differential expression analysis , 2018, Nature Methods.

[27]  Dominic Grün,et al.  A Human Liver Cell Atlas reveals Heterogeneity and Epithelial Progenitors , 2019, Nature.

[28]  Shila Ghazanfar,et al.  scMerge leverages factor analysis, stable expression, and pseudoreplication to merge multiple single-cell RNA-seq datasets , 2019, Proceedings of the National Academy of Sciences.

[29]  Francisco Azuaje,et al.  A cluster validity framework for genome expression data , 2002, Bioinform..

[30]  Fabian J Theis,et al.  The Human Cell Atlas , 2017, bioRxiv.

[31]  Allon M. Klein,et al.  Single-cell mapping of gene expression landscapes and lineage in the zebrafish embryo , 2018, Science.

[32]  Cuong To,et al.  Miniaturization Technologies for Efficient Single-Cell Library Preparation for Next-Generation Sequencing , 2016, Journal of laboratory automation.

[33]  Salah Ayoub,et al.  The Drosophila Embryo at Single Cell Transcriptome Resolution , 2017, bioRxiv.

[34]  Hugo de Jonge,et al.  Faculty of 1000 evaluation for A single-cell atlas of the airway epithelium reveals the CFTR-rich pulmonary ionocyte. , 2018 .

[35]  James T. Webber,et al.  Single-cell transcriptomics of 20 mouse organs creates a Tabula Muris , 2018, Nature.

[36]  Valentine Svensson,et al.  Power Analysis of Single Cell RNA-Sequencing Experiments , 2016, Nature Methods.

[37]  Bertrand Z. Yeung,et al.  Cell Hashing with barcoded antibodies enables multiplexing and doublet detection for single cell genomics , 2018, Genome Biology.

[38]  Grace X. Y. Zheng,et al.  Massively parallel digital transcriptional profiling of single cells , 2016, Nature Communications.

[39]  Foo Wei Ten,et al.  Single nucleus and in situ RNA sequencing reveals cell topographies in the human pancreas. , 2020, Gastroenterology.

[40]  Principal Investigators,et al.  Single-cell transcriptomics of 20 mouse organs creates a Tabula Muris , 2018 .

[41]  David A. Knowles,et al.  Batch effects and the effective design of single-cell gene expression studies , 2016, Scientific Reports.

[42]  Christoph Ziegenhain,et al.  The impact of amplification on differential expression analyses by RNA-seq , 2016, Scientific Reports.

[43]  Hans Clevers,et al.  Single-cell messenger RNA sequencing reveals rare intestinal cell types , 2015, Nature.

[44]  Andrew C. Adey,et al.  Single-Cell Transcriptional Profiling of a Multicellular Organism , 2017 .

[45]  Åsa K. Björklund,et al.  Smart-seq2 for sensitive full-length transcriptome profiling in single cells , 2013, Nature Methods.

[46]  Shuqiang Li,et al.  CEL-Seq2: sensitive highly-multiplexed single-cell RNA-Seq , 2016, Genome Biology.

[47]  Jonathan S. Weissman,et al.  MULTI-seq: Scalable sample multiplexing for single-cell RNA sequencing using lipid-tagged indices , 2018, bioRxiv.

[48]  S. Teichmann,et al.  Exponential scaling of single-cell RNA-seq in the past decade , 2017, Nature Protocols.

[49]  Hazen P Babcock,et al.  High-throughput single-cell gene-expression profiling with multiplexed error-robust fluorescence in situ hybridization , 2016, Proceedings of the National Academy of Sciences.

[50]  Yvan Saeys,et al.  A comparison of single-cell trajectory inference methods , 2019, Nature Biotechnology.

[51]  G. Leparc,et al.  DMSO cryopreservation is the method of choice to preserve cells for droplet-based single-cell RNA sequencing , 2019, Scientific Reports.