Design of implementation studies for quality improvement programs: an effectiveness-cost-effectiveness framework.

Translational research applies basic science discoveries in clinical and community settings. Implementation research is often limited by tremendous variability among settings; therefore, generalization of findings may be limited. Adoption of a novel procedure in a community practice is usually a local decision guided by setting-specific knowledge. The conventional statistical framework that aims to produce generalizable knowledge is inappropriate for local quality improvement investigations. We propose an analytic framework based on cost-effectiveness of the implementation study design, taking into account prior knowledge from local experts. When prior knowledge does not indicate a clear preference between the new and standard procedures, local investigation should guide the choice. The proposed approach requires substantially smaller sample sizes than the conventional approach. Sample size formulae and general guidance are provided.

[1]  David R. Holtgrave,et al.  Alternatives to the randomized controlled trial. , 2008, American journal of public health.

[2]  A. Briggs,et al.  Statistical Analysis of Cost-effectiveness Data: Willan/Statistical Analysis of Cost-effectiveness Data , 2006 .

[3]  Ying Kuen Cheung,et al.  Calibration of prior variance in the Bayesian continual reassessment method , 2011, Statistics in medicine.

[4]  L. J. Savage Elicitation of Personal Probabilities and Expectations , 1971 .

[5]  F. J. Anscombe Sequential Medical Trials , 1963 .

[6]  P. Kaufmann,et al.  Efficiency perspectives on adaptive designs in stroke clinical trials. , 2011, Stroke.

[7]  M. Segal,et al.  Simple, Defensible Sample Sizes Based on Cost Efficiency , 2008, Biometrics.

[8]  Peter F Thall,et al.  Continuous Bayesian adaptive randomization based on event times with covariates , 2006, Statistics in medicine.

[9]  M. Zelen,et al.  Play the Winner Rule and the Controlled Clinical Trial , 1969 .

[10]  C. Sherbourne,et al.  Impact of disseminating quality improvement programs for depression in managed primary care: a randomized controlled trial. , 2000, JAMA.

[11]  Karl Claxton,et al.  Dimensions of Design Space: A Decision-Theoretic Approach to Optimal Research Design , 2009, Medical decision making : an international journal of the Society for Medical Decision Making.

[12]  T. Colton A Model for Selecting One of Two Medical Treatments , 1963 .

[13]  D. Berry,et al.  Adaptive assignment versus balanced randomization in clinical trials: a decision analysis. , 1995, Statistics in medicine.

[14]  T L Lai,et al.  Sequential medical trials. , 1980, Proceedings of the National Academy of Sciences of the United States of America.

[15]  B. Nebiyou Bekele,et al.  Dose-Finding Based on Multiple Toxicities in a Soft Tissue Sarcoma Trial , 2004 .

[16]  Karl Claxton,et al.  The Value of Implementation and the Value of Information: Combined and Uneven Development , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.