A win ratio approach to the re-analysis of Multiple Risk Factor Intervention Trial

Background: Composite outcomes, which combine multiple types of clinical events into a single outcome, are common in clinical trials. The usual analysis considers the time to first occurrence of any event in the composite. The major criticisms of such an approach are (1) this implicitly treats the outcomes as if they were of equal importance, but they often vary in terms of clinical relevance and severity, (2) study participants often experience more than one type of event, and (3) often less severe events occur before more severe ones, but the usual analysis disregards any information beyond that first event. Methods: A novel approach, referred to as the win ratio, which addresses the aforementioned criticisms of composite outcomes, is illustrated with a re-analysis of data on fatal and non-fatal cardiovascular disease time-to-event outcomes reported for the Multiple Risk Factor Intervention Trial. In this trial, 12,866 participants were randomized to a special intervention group (n = 6428) or a usual care (n = 6438) group. Non-fatal outcomes were ranked by risk of cardiovascular disease death up to 20 years after trial. In one approach, participants in the special intervention and usual care groups were first matched on coronary heart disease risk at baseline and time of enrollment. Each matched pair was categorized as a winner or loser depending on which one experienced a cardiovascular disease death first. If neither died of cardiovascular disease causes, they were evaluated on the most severe non-fatal outcome. This process continued for all the non-fatal outcomes. A second win ratio statistic, obtained from Cox partial likelihood, was also estimated. This statistic provides a valid estimate of the win ratio using multiple events if the marginal and conditional survivor functions of each outcome satisfy proportional hazards. Loss ratio statistics (inverse of win ratios) are compared to hazard ratios from the usual first event analysis. A larger 11-event composite was also considered. Results: For the 7-event cardiovascular disease composite, the previously reported first event analysis based on 581 events in the special intervention group and 652 events in the usual care group yielded a hazard ratio (95% confidence interval) of 0.89 (0.79–0.99), compared to 0.86 (0.77–0.97) and 0.91 (0.81–1.02) for the severity ranked estimates. Results for the 11-event composite also confirmed the findings of the first event analysis. Conclusion: The win ratio analysis was able to leverage information collected past the first experienced event and rank events by severity. The results were similar to and confirmed previously reported traditional first event analysis. The win ratio statistic is a useful adjunct to the traditional first event analysis for trials with composite outcomes.

[1]  D. Schoenfeld,et al.  Graphing the Win Ratio and its components over time , 2018, Statistics in medicine.

[2]  Pamela A Shaw,et al.  Use of composite outcomes to assess risk–benefit in clinical trials , 2018, Clinical trials.

[3]  S. Solomon,et al.  Comparison of Time-to-First Event and Recurrent-Event Methods in Randomized Clinical Trials , 2018, Circulation.

[4]  S. Pocock,et al.  The Primary Outcome Is Positive - Is That Good Enough? , 2016, The New England journal of medicine.

[5]  D. Oakes On the win-ratio statistic in clinical trials with multiple types of event , 2016 .

[6]  M. Vandemeulebroecke,et al.  A generalized analytic solution to the win ratio to analyze a composite endpoint considering the clinical importance order among components , 2016, Pharmaceutical statistics.

[7]  P. Parfrey,et al.  The win ratio approach to analyzing composite outcomes: An application to the EVOLVE trial. , 2016, Contemporary clinical trials.

[8]  M Buyse,et al.  Statistical controversies in clinical research: end points other than overall survival are vital for regulatory approval of anticancer agents. , 2016, Annals of oncology : official journal of the European Society for Medical Oncology.

[9]  P. Armstrong,et al.  Impact of weighted composite compared to traditional composite endpoints for the design of randomized controlled trials , 2015, Statistical methods in medical research.

[10]  P. Armstrong,et al.  Applying novel methods to assess clinical outcomes: insights from the TRILOGY ACS trial. , 2015, European heart journal.

[11]  W. Brannath,et al.  Opportunities and challenges of combined effect measures based on prioritized outcomes , 2014, Statistics in medicine.

[12]  J. Cutler,et al.  Multiple Risk Factor Intervention Trial Revisited: A New Perspective Based on Nonfatal and Fatal Composite Endpoints, Coronary and Cardiovascular, During the Trial , 2012, Journal of the American Heart Association.

[13]  C. Meinert Clinical Trials Dictionary: Terminology and Usage Recommendations, Second Edition , 2012 .

[14]  S. Pocock,et al.  The win ratio: a new approach to the analysis of composite endpoints in clinical trials based on clinical priorities , 2011, European heart journal.

[15]  J. Saver,et al.  Weighting Components of Composite End Points in Clinical Trials: An Approach Using Disability-Adjusted Life-Years , 2011, Stroke.

[16]  K. Zou,et al.  Composite outcomes: weighting component events according to severity assisted interpretation but reduced statistical power. , 2010, Journal of clinical epidemiology.

[17]  Lisa M. Schwartz,et al.  Definition, reporting, and interpretation of composite outcomes in clinical trials: systematic review , 2010, BMJ : British Medical Journal.

[18]  D. Altman,et al.  Composite Outcomes in Cardiovascular Research: A Survey of Randomized Trials , 2008, Annals of Internal Medicine.

[19]  Daniel J Sargent,et al.  End points for colon cancer adjuvant trials: observations and recommendations based on individual patient data from 20,898 patients enrolled onto 18 randomized trials from the ACCENT Group. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[20]  Gordon H Guyatt,et al.  Problems with use of composite end points in cardiovascular trials: systematic review of randomised controlled trials , 2007, BMJ : British Medical Journal.

[21]  Gerry Gray,et al.  Key issues in end point selection for heart failure trials: composite end points. , 2005, Journal of cardiac failure.

[22]  G. Guyatt,et al.  Validity of composite end points in clinical trials , 2005, BMJ : British Medical Journal.

[23]  Avis J. Thomas,et al.  Multiple-stage screening and mortality in the Multiple Risk Factor Intervention Trial , 2004, Clinical trials.

[24]  Nick Freemantle,et al.  Composite outcomes in randomized trials: greater precision but with greater uncertainty? , 2003, JAMA.

[25]  J. Hodges,et al.  Rule-based ranking schemes for antiretroviral trials. , 1997, Statistics in Medicine.

[26]  M D Hughes,et al.  Power considerations for clinical trials using multivariate time-to-event data. , 1997, Statistics in medicine.

[27]  A. Gotto The Multiple Risk Factor Intervention Trial (MRFIT). A return to a landmark trial. , 1997, JAMA.

[28]  J. Neaton,et al.  Considerations in choice of a clinical endpoint for AIDS clinical trials. Terry Beirn Community Programs for Clinical Research on AIDS (CPCRA). , 1994, Statistics in medicine.

[29]  W. Weaver,et al.  A method of assigning scores to the components of a composite outcome: an example from the MITI trial. , 1992, Controlled clinical trials.

[30]  D. Spodick Multiple risk factor intervention trial. , 1985, The American journal of cardiology.

[31]  J. Lachin,et al.  Large sample inference for a win ratio analysis of a composite outcome based on prioritized components. , 2016, Biostatistics.

[32]  C. Meinert Clinical Trials Dictionary: Terminology and Usage Recommendations , 1996 .

[33]  J. Cutler,et al.  The use of subjective rankings in clinical trials with an application to cardiovascular disease. , 1992, Statistics in medicine.

[34]  K. Anderson,et al.  An updated coronary risk profile. A statement for health professionals. , 1991, Circulation.

[35]  L. J. Wei,et al.  Regression analysis of multivariate incomplete failure time data by modeling marginal distributions , 1989 .