Improving interpretation of clinical studies by use of confidence levels, clinical significance curves, and risk-benefit contours

The process of interpreting the results of clinical studies and translating them into clinical practice is being debated. Here we examine the role of p values and confidence intervals in clinical decision-making, and draw attention to confusion in their interpretation. To improve result reporting, we propose the use of confidence levels and plotting of clinical significance curves and risk-benefit contours. These curves and contours provide degrees of probability of both the potential benefit of treatment and the detriment due to toxicity. Additionally, they provide clinicians with a mechanism of translating the results of studies into treatment for individual patients, thus improving the clinical decision-making process. We illustrate the application of these curves and contours by reference to published studies. Confidence levels, clinical significance curves, and risk-benefit contours can be easily calculated with a hand calculator or standard statistical packages. We advocate their incorporation into the published results of clinical studies.

[1]  M. Gardner,et al.  Confidence intervals for research findings , 1992, British journal of obstetrics and gynaecology.

[2]  M J Al,et al.  Costs, effects and C/E-ratios alongside a clinical trial. , 1994, Health economics.

[3]  T. Fahey,et al.  Quantitative systematic review of randomised controlled trials comparing antibiotic with placebo for acute cough in adults , 1998, BMJ.

[4]  Hale Je,et al.  Identification of ampoules. , 1973 .

[5]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[6]  D L Sackett,et al.  On the need for evidence-based medicine. , 1995, Therapie.

[7]  M J Campbell,et al.  Use of check lists in assessing the statistical content of medical studies. , 1986, British medical journal.

[8]  R. Simon,et al.  Confidence intervals for reporting results of clinical trials. , 1986, Annals of internal medicine.

[9]  C. D. Atkins.  Dissection of regional lymph nodes in cutaneous melanoma , 1998, The Lancet.

[10]  S. Pocock,et al.  Estimation issues in clinical trials and overviews. , 1990, Statistics in medicine.

[11]  N. Cascinelli,et al.  Immediate or delayed dissection of regional nodes in patients with melanoma of the trunk: a randomised trial , 1998, The Lancet.

[12]  L. Braitman.  Confidence intervals extract clinically useful information from data. , 1988, Annals of internal medicine.

[13]  Leonard E. Brahman.  Confidence Intervals Assess Both Clinical Significance and Statistical Significance , 1991 .

[14]  A H Briggs,et al.  Handling uncertainty when performing economic evaluation of healthcare interventions. , 1999, Health technology assessment.

[15]  G Berry,et al.  Statistical significance and confidence intervals , 1986, The British journal of clinical practice.

[16]  M. Leblanc,et al.  Chemoradiotherapy versus radiotherapy in patients with advanced nasopharyngeal cancer: phase III randomized Intergroup study 0099. , 1998, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[17]  S. Goodman.  Toward Evidence-Based Medical Statistics. 1: The P Value Fallacy , 1999, Annals of Internal Medicine.

[18]  M J Campbell,et al.  Clinical significance not statistical significance: a simple Bayesian alternative to p values. , 1998, Journal of epidemiology and community health.