Trials within trials: confirmatory subgroup analyses in controlled clinical experiments.

Subgroup analyses remain a popular and necessary component of controlled clinical trials. However, lack of prospective specification, inadequate sample size, inability to maintain power, and the cumulative effect of sampling error can complicate their interpretation. This article demonstrates that clinical trial design tools that would allow the medical community to draw confirmatory and not just exploratory conclusions from specific subgroup evaluations are available to methodologists. Distinct from the use of a treatment by subgroup interaction term, this methodology provides an evaluation of the effect of an intervention within a particular subgroup stratum prospectively declared to be of interest to the investigators. The necessary prespecification of stratum-specific type I error rates, when combined with (1) a stratum-specific event rate in the subgroup, (2) a stratum-specific primary endpoint, (3) a stratum-specific endpoint precision, and/or (4) a stratum-specific efficacy, satisfies the requirements for a subgroup stratum's "stand-alone" interpretation at the trial's conclusion.

[1]  C M O'Connor,et al.  Effect of amlodipine on morbidity and mortality in severe chronic heart failure. Prospective Randomized Amlodipine Survival Evaluation Study Group. , 1996, The New England journal of medicine.

[2]  G. W. Snedecor.  STATISTICAL METHODS , 1967 .

[3]  R W Makuch,et al.  Can treatment that is helpful on average be harmful to some patients? A study of the conflicting information needs of clinical inquiry and drug regulation. , 1996, Journal of clinical epidemiology.

[4]  C. Meinert.  Clinical Trials: Design, Conduct, and Analysis , 1986 .

[5]  J. Cohn,et al.  The effect of carvedilol on morbidity and mortality in patients with chronic heart failure. U.S. Carvedilol Heart Failure Study Group. , 1996, The New England journal of medicine.

[6]  B. Kasiske,et al.  Proteinuria is a risk factor for mortality over 10 years of follow-up. MRFIT Research Group. Multiple Risk Factor Intervention Trial. , 1997, Kidney international. Supplement.

[7]  Carvedilol and the Food and Drug Administration-Approval Process , 1999 .

[8]  C. E. Davis,et al.  Empirical Bayes estimates of subgroup effects in clinical trials. , 1990, Controlled clinical trials.

[9]  C F Starmer,et al.  Clinical Judgment and Statistics: Lessons from a Simulated Randomized Trial in Coronary Artery Disease , 1980, Circulation.

[10]  D G Altman,et al.  Within trial variation--a false trail? , 1998, Journal of clinical epidemiology.

[11]  R. Collins,et al.  Prevention of cardiovascular events and death with pravastatin in patients with coronary heart disease and a broad range of initial cholesterol levels. , 1998, The New England journal of medicine.

[12]  Stephen Senn,et al.  Statistical Issues in Drug Development , 1997 .

[13]  A Donner,et al.  A Bayesian approach to the interpretation of subgroup results in clinical trials. , 1982, Journal of chronic diseases.

[14]  D. DeMets,et al.  Fundamentals of Clinical Trials , 1982 .

[15]  K. von Olshausen,et al.  Carvedilol in patients with chronic heart failure. , 1996, The New England journal of medicine.

[16]  A R Feinstein,et al.  The problem of cogent subgroups: a clinicostatistical tragedy. , 1998, Journal of Clinical Epidemiology.

[17]  L. Moye.  Alpha calculus in clinical trials: considerations and commentary for the new millennium. , 2000, Statistics in medicine.

[18]  J. Wittes,et al.  Analysis and interpretation of treatment effects in subgroups of patients in randomized clinical trials. , 1991, JAMA.

[19]  S. Pocock,et al.  Clinical Trials: A Practical Approach , 1984 .

[20]  Bertram Pitt,et al.  Randomised trial of losartan versus captopril in patients over 65 with heart failure (Evaluation of Losartan in the Elderly Study, ELITE) , 1997, The Lancet.

[21]  L. Fisher.  Carvedilol and the Food and Drug Administration (FDA) approval process: the FDA paradigm and reflections on hypothesis testing. , 1999, Controlled clinical trials.

[22]  B. Davis,et al.  Uniformity of captopril benefit in the SAVE study : subgroup analysis , 1994 .

[23]  E. J. Brown,et al.  Effect of captopril on mortality and morbidity in patients with left ventricular dysfunction after myocardial infarction. Results of the survival and ventricular enlargement trial. The SAVE Investigators. , 1992, The New England journal of medicine.

[24]  Lemuel A. Moyé,et al.  Statistical Reasoning in Medicine , 2000 .

[25]  L. Moyé.  End-point interpretation in clinical trials: the case for discipline. , 1999, Controlled clinical trials.

[26]  Bertram Pitt,et al.  Effect of losartan compared with captopril on mortality in patients with symptomatic heart failure: randomised trial—the Losartan Heart Failure Survival Study ELITE II , 2000, The Lancet.

[27]  M. Pfeffer,et al.  Effect of pravastatin on cardiovascular events in women after myocardial infarction: the cholesterol and recurrent events (CARE) trial. , 1998, Journal of the American College of Cardiology.

[28]  R Peto,et al.  Large-scale randomized evidence: large, simple trials and overviews of trials. , 1993, Annals of the New York Academy of Sciences.

[29]  Barry J. Davis,et al.  Effect of Pravastatin on Cardiovascular Events in Older Patients with Myocardial Infarction and Cholesterol Levels in the Average Range: Results of the Cholesterol and Recurrent Events (CARE) Trial , 1998, Annals of Internal Medicine.

[30]  A simultaneous inference procedure for clinical trials , 1987 .

[31]  S. Assmann,et al.  Subgroup analysis and other (mis)uses of baseline data in clinical trials , 2000, The Lancet.

[32]  T. Louis.  Estimating a population of parameter values using Bayes and empirical Bayes methods , 1984 .

[33]  L A Moyé,et al.  P-value interpretation and alpha allocation in clinical trials. , 1998, Annals of epidemiology.

[34]  Lemuel A. Moyé,et al.  Carvedilol and the Food and Drug Administration approval process: an introduction. , 1999, Controlled clinical trials.

[35]  R. Simon,et al.  Patient subsets and variation in therapeutic efficacy. , 1982, British journal of clinical pharmacology.

[36]  B. Davis,et al.  The effect of pravastatin on coronary events after myocardial infarction in patients with average cholesterol levels. Cholesterol and Recurrent Events Trial investigators. , 1996, The New England journal of medicine.

[37]  P. Peduzzi,et al.  Clinical judgment and statistics. , 1981, Circulation.