Diagnostic accuracy of serological tests for covid-19: systematic review and meta-analysis

Abstract Objective To determine the diagnostic accuracy of serological tests for coronavirus disease-2019 (covid-19). Design Systematic review and meta-analysis. Data sources Medline, bioRxiv, and medRxiv from 1 January to 30 April 2020, using subject headings or subheadings combined with text words for the concepts of covid-19 and serological tests for covid-19. Eligibility criteria and data analysis Eligible studies measured sensitivity or specificity, or both of a covid-19 serological test compared with a reference standard of viral culture or reverse transcriptase polymerase chain reaction. Studies were excluded with fewer than five participants or samples. Risk of bias was assessed using quality assessment of diagnostic accuracy studies 2 (QUADAS-2). Pooled sensitivity and specificity were estimated using random effects bivariate meta-analyses. Main outcome measures The primary outcome was overall sensitivity and specificity, stratified by method of serological testing (enzyme linked immunosorbent assays (ELISAs), lateral flow immunoassays (LFIAs), or chemiluminescent immunoassays (CLIAs)) and immunoglobulin class (IgG, IgM, or both). Secondary outcomes were stratum specific sensitivity and specificity within subgroups defined by study or participant characteristics, including time since symptom onset. Results 5016 references were identified and 40 studies included. 49 risk of bias assessments were carried out (one for each population and method evaluated). High risk of patient selection bias was found in 98% (48/49) of assessments and high or unclear risk of bias from performance or interpretation of the serological test in 73% (36/49). Only 10% (4/40) of studies included outpatients. Only two studies evaluated tests at the point of care. For each method of testing, pooled sensitivity and specificity were not associated with the immunoglobulin class measured. The pooled sensitivity of ELISAs measuring IgG or IgM was 84.3% (95% confidence interval 75.6% to 90.9%), of LFIAs was 66.0% (49.3% to 79.3%), and of CLIAs was 97.8% (46.2% to 100%). In all analyses, pooled sensitivity was lower for LFIAs, the potential point-of-care method. Pooled specificities ranged from 96.6% to 99.7%. Of the samples used for estimating specificity, 83% (10 465/12 547) were from populations tested before the epidemic or not suspected of having covid-19. Among LFIAs, pooled sensitivity of commercial kits (65.0%, 49.0% to 78.2%) was lower than that of non-commercial tests (88.2%, 83.6% to 91.3%). Heterogeneity was seen in all analyses. Sensitivity was higher at least three weeks after symptom onset (ranging from 69.9% to 98.9%) compared with within the first week (from 13.4% to 50.3%). Conclusion Higher quality clinical studies assessing the diagnostic accuracy of serological tests for covid-19 are urgently needed. Currently, available evidence does not support the continued use of existing point-of-care serological tests. Study registration PROSPERO CRD42020179452.

[1]  F. Yu,et al.  Serology characteristics of SARS-CoV-2 infection since exposure and post symptom onset , 2020, European Respiratory Journal.

[2]  Akihide Ryo,et al.  Interpreting Diagnostic Tests for SARS-CoV-2. , 2020, JAMA.

[3]  Mark S. Anderson,et al.  Test performance evaluation of SARS-CoV-2 serological assays , 2020, medRxiv.

[4]  K. Tamura,et al.  Clinical evaluation of an immunochromatographic IgM/IgG antibody assay and chest computed tomography for the diagnosis of COVID-19 , 2020, Journal of Clinical Virology.

[5]  B. Graham,et al.  Validation of a SARS-CoV-2 spike protein ELISA for use in contact investigations and serosurveillance , 2020, bioRxiv.

[6]  T. Jin,et al.  Characteristics of patients with coronavirus disease (COVID‐19) confirmed using an IgM‐IgG antibody test , 2020, Journal of medical virology.

[7]  C. Taddei,et al.  Diagnostic accuracy of an automated chemiluminescent immunoassay for anti‐SARS‐CoV‐2 IgM and IgG antibodies: an Italian experience , 2020, Journal of medical virology.

[8]  Daniel S. Chertow,et al.  Detection of Nucleocapsid Antibody to SARS-CoV-2 is More Sensitive than Antibody to Spike Protein in COVID-19 Patients , 2020, medRxiv.

[9]  Zhenhua Chen,et al.  Rapid and Sensitive Detection of anti-SARS-CoV-2 IgG, Using Lanthanide-Doped Nanoparticles-Based Lateral Flow Immunoassay , 2020, Analytical chemistry.

[10]  Yajuan Li,et al.  COVID-19 diagnosis and study of serum SARS-CoV-2 specific IgA, IgM and IgG by a quantitative and sensitive immunoassay , 2020, medRxiv.

[11]  A. Maxmen The researchers taking a gamble with antibody tests for coronavirus , 2020, Nature.

[12]  P. Li,et al.  Development and Multicenter Performance Evaluation of The First Fully Automated SARS-CoV-2 IgM and IgG Immunoassays , 2020, medRxiv.

[13]  N. Watkins,et al.  Evaluation of antibody testing for SARS-Cov-2 using ELISA and lateral flow immunoassays , 2020, medRxiv.

[14]  Yan-ling Ma,et al.  Antibody Detection and Dynamic Characteristics in Patients with COVID-19 , 2020, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[15]  C. Boesecke,et al.  Rapid point-of-care testing for SARS-CoV-2 in a community screening setting shows low sensitivity , 2020, Public Health.

[16]  Felipe García,et al.  Rapid diagnosis of SARS-CoV-2 infection by detecting IgG and IgM antibodies with an immunochromatographic device: a prospective single-center study , 2020, medRxiv.

[17]  K. Krogfelt,et al.  Evaluation of nine commercial SARS-CoV-2 immunoassays , 2020, medRxiv.

[18]  Yangchun Feng,et al.  Optimize Clinical Laboratory Diagnosis of COVID-19 from Suspect Cases by Likelihood Ratio of SARS-CoV-2 IgM and IgG antibody , 2020, medRxiv.

[19]  N. Beeching,et al.  Covid-19: testing times , 2020, BMJ.

[20]  A. Paradiso,et al.  Clinical meanings of rapid serological assay in patients tested for SARS-Co2 RT-PCR , 2020, medRxiv.

[21]  A. Xu,et al.  Diagnostic value and dynamic variance of serum antibody in coronavirus disease 2019 , 2020, International Journal of Infectious Diseases.

[22]  A. Petherick Developing antibody tests for SARS-CoV-2 , 2020, The Lancet.

[23]  Malik Peiris,et al.  Serological assays for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), March 2020 , 2020, Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin.

[24]  Shangen Zheng,et al.  Evaluation of Nucleocapsid and Spike Protein-Based Enzyme-Linked Immunosorbent Assays for Detecting Antibodies against SARS-CoV-2 , 2020, Journal of Clinical Microbiology.

[25]  Mingxia Zhang,et al.  Evaluations of serological test in the diagnosis of 2019 novel coronavirus (SARS-CoV-2) infections during the COVID-19 outbreak , 2020, medRxiv.

[26]  Feng Qi Han,et al.  Evaluation the auxiliary diagnosis value of antibodies assays for detection of novel coronavirus (SARS-Cov-2) causing an outbreak of pneumonia (COVID-19) , 2020, medRxiv.

[27]  Feifei Ren,et al.  Diagnostic Indexes of a Rapid IgG/IgM Combined Antibody Test for SARS-CoV-2 , 2020, medRxiv.

[28]  Francesco Mojoli,et al.  Performance of VivaDiag COVID‐19 IgM/IgG Rapid Test is inadequate for diagnosis of COVID‐19 in acute patients referring to emergency room department , 2020, Journal of medical virology.

[29]  Sha Lin,et al.  Serology characteristics of SARS-CoV-2 infection since the exposure and post symptoms onset , 2020, medRxiv.

[30]  Hao Song,et al.  Serological diagnostic kit of SARS-CoV-2 antibodies using CHO-expressed full-length SARS-CoV-2 S1 proteins , 2020, medRxiv.

[31]  Hui-xia Gao,et al.  Detection of serum immunoglobulin M and immunoglobulin G antibodies in 2019 novel coronavirus infected patients from different stages , 2020, Chinese medical journal.

[32]  Ping Shuai,et al.  Detection of serum IgM and IgG for COVID-19 diagnosis , 2020, Science China Life Sciences.

[33]  K. Mandl,et al.  Early in the epidemic: impact of preprints on global discourse about COVID-19 transmissibility , 2020, The Lancet Global Health.

[34]  O. Tsang,et al.  Temporal profiles of viral load in posterior oropharyngeal saliva samples and serum antibody responses during infection by SARS-CoV-2: an observational cohort study , 2020, The Lancet Infectious Diseases.

[35]  S. Zhang,et al.  The index case of SARS-CoV-2 in Scotland , 2020, Journal of Infection.

[36]  Qi Jin,et al.  Profiling Early Humoral Response to Diagnose Novel Coronavirus Disease (COVID-19) , 2020, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[37]  Shiyue Li,et al.  Evaluation of recombinant nucleocapsid and spike proteins for serological diagnosis of novel coronavirus disease 2019 (COVID-19) , 2020, medRxiv.

[38]  Pu Liao,et al.  Antibody responses to SARS-CoV-2 in COVID-19 patients: the perspective application of serological tests in clinical practice , 2020, medRxiv.

[39]  S. Zheng,et al.  Evaluation of Nucleocapsid and Spike Protein-based ELISAs for detecting antibodies against SARS-CoV-2 , 2020, medRxiv.

[40]  A Patient with COVID-19 Presenting a False-Negative Reverse Transcriptase Polymerase Chain Reaction Result , 2020, Korean journal of radiology.

[41]  Yunbao Pan,et al.  Serological immunochromatographic approach in diagnosis with SARS-CoV-2 infected COVID-19 patients , 2020, Journal of Infection.

[42]  Lei Liu,et al.  A preliminary study on serological assay for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in 238 admitted hospital patients , 2020, Microbes and Infection.

[43]  X. Jia,et al.  Clinical significance of IgM and IgG test for diagnosis of highly suspected COVID-19 infection , 2020, medRxiv.

[44]  Shaoqiang Li,et al.  Development and clinical application of a rapid IgM‐IgG combined antibody test for SARS‐CoV‐2 infection diagnosis , 2020, Journal of medical virology.

[45]  P. Winichakoon,et al.  Negative Nasopharyngeal and Oropharyngeal Swabs Do Not Rule Out COVID-19 , 2020, Journal of Clinical Microbiology.

[46]  Lei Liu,et al.  Antibody responses to SARS-CoV-2 in patients of novel coronavirus disease 2019 , 2020, medRxiv.

[47]  Ping Liu,et al.  A Peptide-based Magnetic Chemiluminescence Enzyme Immunoassay for Serological Diagnosis of Coronavirus Disease 2019 (COVID-19) , 2020, medRxiv.

[48]  Å. Lundkvist,et al.  Evaluation of a COVID-19 IgM and IgG rapid test; an efficient tool for assessment of past exposure to SARS-CoV-2 , 2020, Infection ecology & epidemiology.

[49]  Wei Zhang,et al.  Molecular and serological investigation of 2019-nCoV infected patients: implication of multiple shedding routes , 2020, Emerging microbes & infections.

[50]  Heinz Holling,et al.  Meta-Analysis of Diagnostic Accuracy with mada , 2015 .

[51]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[52]  Christian Drosten,et al.  Serological assays for emerging coronaviruses: Challenges and pitfalls , 2014, Virus Research.

[53]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[54]  Susan Mallett,et al.  QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies , 2011, Annals of Internal Medicine.

[55]  J. Ioannidis,et al.  The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration , 2009, BMJ : British Medical Journal.

[56]  J. Ioannidis,et al.  The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration , 2009, Annals of Internal Medicine [serial online].

[57]  P. Woo,et al.  Differential Sensitivities of Severe Acute Respiratory Syndrome (SARS) Coronavirus Spike Polypeptide Enzyme-Linked Immunosorbent Assay (ELISA) and SARS Coronavirus Nucleocapsid Protein ELISA for Serodiagnosis of SARS Coronavirus Pneumonia , 2005, Journal of Clinical Microbiology.

[58]  P. Woo,et al.  Detection of Specific Antibodies to Severe Acute Respiratory Syndrome (SARS) Coronavirus Nucleocapsid Protein for Serodiagnosis of SARS Coronavirus Pneumonia , 2004, Journal of Clinical Microbiology.

[59]  Jonathan J Deeks,et al.  Systematic reviews in health care: Systematic reviews of evaluations of diagnostic and screening tests. , 2001, BMJ.

[60]  A. Saah,et al.  Sensitivity and Specificity Reconsidered: The Meaning of These Terms in Analytical and Diagnostic Settings , 1997, Annals of Internal Medicine.

[61]  F. Vitale,et al.  Free and antibody‐complexed antigen and antibody profile in apparently healthy HIV seropositive individuals and in aids patients , 1990, Journal of medical virology.