Design, quality, and bias in randomized controlled trials of systemic lupus erythematosus.

OBJECTIVE To appraise systematically the study design and quality of reporting of randomized controlled trials (RCT) on systemic lupus erythematosus (SLE) and to identify potential defects and biases. METHODS RCT with at least 5 patients with SLE were retrieved from MEDLINE, EMBASE, and the Cochrane Library. We analyzed study design, quality of reporting, and trial results. RESULTS Ninety-four trial reports (37 on lupus nephritis) were eligible with 2,257 SLE patients (n = 795 in lupus nephritis trials). Median sample size was 28 patients. Fifty-one trials (54.3%) were double blind, but only 31 (33.0%) mentioned the randomization mode, only 19 (20.2%) described allocation concealment, and only 7 (7.5%) were adequately powered. Sixty-three trials (67%) described adequately reasons for withdrawals. Nephritis trials had on average longer followup (p = 0.001) and were less likely to be double blind (p < 0.001), to describe reasons for withdrawals [both overall (p = 0.008) and per arm (p = 0.009)] and to involve a comparison against placebo or no treatment (p < 0.001). Larger trials scored higher on several quality characteristics. Significant efficacy or trend for efficacy was claimed in 72 reports (76.6%) and this was even more common in trials published in 1999-2002 (89.5%). Significant efficacy was found more frequently in trials that clearly specified withdrawals per arm (p = 0.001) and outcomes (p = 0.001) and used intention-to-treat analyses (p = 0.03). Besides outcome specification, no other quality variables seemed to improve significantly over time. CONCLUSION Several aspects of the design and reporting of RCT on SLE can be improved. Larger, adequately powered, and accurately reported trials are needed.

[1]  A. Walker,et al.  Improving the quality of reporting in randomised controlled trials. , 2004, Journal of wound care.

[2]  G. Illei,et al.  Renal flares are common in patients with severe proliferative lupus nephritis treated with pulse immunosuppressive therapy: long-term followup of a cohort of 145 patients participating in randomized controlled studies. , 2002, Arthritis and rheumatism.

[3]  D. Felson,et al.  Secular changes in the quality of published randomized clinical trials in rheumatology. , 2002, Arthritis and rheumatism.

[4]  J. Ioannidis,et al.  Design and quality considerations for randomized controlled trials in systemic sclerosis. , 2002, Arthritis and rheumatism.

[5]  J. Ioannidis,et al.  Comparison of evidence of treatment effects in randomized and nonrandomized studies. , 2001, JAMA.

[6]  J. Ioannidis,et al.  Bias in uncontrolled therapeutic trials in rheumatology due to selection of populations with extreme characteristics. , 2001, The Journal of rheumatology.

[7]  D. Moher,et al.  The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration , 2001, Annals of Internal Medicine.

[8]  Anna-Bettina Haidich,et al.  Any casualties in the clash of randomised and observational evidence? , 2001, BMJ : British Medical Journal.

[9]  J. Ioannidis,et al.  Completeness of safety reporting in randomized trials: an evaluation of 7 medical areas. , 2001, JAMA.

[10]  P. Tugwell,et al.  Endpoints: consensus recommendations from OMERACT IV. Outcome Measures in Rheumatology. , 2000, Lupus.

[11]  D. Isenberg,et al.  Assessing patients with lupus: towards a drug responder index. , 1999, Rheumatology.

[12]  S. Bae,et al.  Methodological issues of corticosteroid use in SLE clinical trials , 1999, Lupus.

[13]  G. Hughes,et al.  Morbidity and mortality in systemic lupus erythematosus during a 5-year period - A multicenter prospective study of 1,000 patients , 1999 .

[14]  M. Ward.  Hospital experience and mortality in patients with systemic lupus erythematosus. , 1999, Arthritis and rheumatism.

[15]  G. Hughes,et al.  Morbidity and mortality in systemic lupus erythematosus during a 5-year period. A multicenter prospective study of 1,000 patients. European Working Party on Systemic Lupus Erythematosus. , 1999, Medicine.

[16]  D. Boumpas,et al.  Outcome criteria for lupus nephritis trials: A critical overview , 1998, Lupus.

[17]  D. Cook,et al.  Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? , 1998, The Lancet.

[18]  J. Ioannidis,et al.  Can quality of clinical trials and meta-analyses be quantified? , 1998, The Lancet.

[19]  A R Jadad,et al.  The randomized controlled trial gets a middle-aged checkup. , 1998, JAMA.

[20]  J. Ioannidis.  Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. , 1998, JAMA.

[21]  J. Lau,et al.  The impact of high-risk patients on the results of clinical trials. , 1997, Journal of clinical epidemiology.

[22]  J. Beto,et al.  Treatment of lupus nephritis: a meta-analysis of clinical trials. , 1997, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[23]  I. Olkin,et al.  Improving the quality of reporting of randomized controlled trials. The CONSORT statement. , 1996, JAMA.

[24]  R. J. Hayes,et al.  Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. , 1995, JAMA.

[25]  D. Moher,et al.  Statistical power, sample size, and their reporting in randomized controlled trials. , 1994, JAMA.

[26]  J M Lachin,et al.  Use of spending functions for occasional or continuous monitoring of data in clinical trials. , 1993, Statistics in medicine.

[27]  D L DeMets,et al.  Monitoring of clinical trials: issues and recommendations. , 1993, Controlled clinical trials.

[28]  A. Steinberg,et al.  Controlled trial of pulse methylprednisolone versus two regimens of pulse cyclophosphamide in severe lupus nephritis , 1992, The Lancet.

[29]  E. Lewis,et al.  A controlled trial of plasmapheresis therapy in severe lupus nephritis. The Lupus Nephritis Collaborative Study Group. , 1992, The New England journal of medicine.

[30]  P. Easterbrook,et al.  Publication bias in clinical research , 1991, The Lancet.

[31]  P H Plotz,et al.  Therapy of lupus nephritis. Controlled trial of prednisone and cytotoxic drugs. , 1986, The New England journal of medicine.

[32]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[33]  D. Felson,et al.  Evidence for the superiority of immunosuppressive drugs and prednisone over prednisone alone in lupus nephritis. Results of a pooled analysis. , 1984, The New England journal of medicine.

[34]  R Peto,et al.  Why do we need some large, simple randomized trials? , 1984, Statistics in medicine.