An epistemology of patient safety research: a framework for study design and interpretation. Part 2. Study design

This is the second in a four-part series of articles detailing the epistemology of patient safety research. This article concentrates on issues of study design. It first considers the range of designs that may be used in the evaluation of patient safety interventions, highlighting the circumstances in which each is appropriate. The paper then provides details about an innovative study design, the stepped wedge, which may be particularly appropriate in the context of patient safety interventions, since these are expected to do more good than harm. The unit of allocation in patient safety research is also considered, since many interventions need to be delivered at cluster or service level. The paper also discusses the need to ensure the masking of patients, caregivers, observers and analysts wherever possible to minimise information biases and the Hawthorne effect. The difficulties associated with masking in patient safety research are described and suggestions given on how these can be ameliorated. The paper finally considers the role of study design in increasing confidence in the generalisability of study results over time and place. The extent to which findings can be generalised over time and place should be considered as part of an evaluation, for example by undertaking qualitative or quantitative measures of fidelity, attitudes or subgroup effects.

[1]  The National Evaluation of Sure Start , 2007 .

[2]  Trisha Greenhalgh,et al.  Realist review to understand the efficacy of school feeding programmes , 2007, British medical journal.

[3]  F. Song,et al.  Contamination in trials of educational interventions. , 2007, Health technology assessment.

[4]  T. Burns,et al.  Use of intensive case management to reduce time in hospital in people with severe mental illness: systematic review and meta-regression , 2007, BMJ : British Medical Journal.

[5]  R. Thomson,et al.  Qualitative methods in a randomised controlled trial: the role of an integrated qualitative process evaluation in providing evidence to discontinue the intervention in one arm of a trial of a decision support tool , 2007, Quality and Safety in Health Care.

[6]  Carl R May,et al.  A patient decision aid to support shared decision-making on anti-thrombotic treatment of patients with atrial fibrillation: randomised controlled trial , 2007, Quality and Safety in Health Care.

[7]  J. Hughes,et al.  Design and analysis of stepped wedge cluster randomized trials. , 2007, Contemporary clinical trials.

[8]  P. Pronovost,et al.  An intervention to decrease catheter-related bloodstream infections in the ICU. , 2006, The New England journal of medicine.

[9]  R. Lilford,et al.  Bmc Medical Research Methodology Open Access the Stepped Wedge Trial Design: a Systematic Review , 2022 .

[10]  Elizabeth Allen,et al.  Process evaluation in randomised controlled trials of complex interventions , 2006, BMJ : British Medical Journal.

[11]  K. Hillman,et al.  Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial , 2005, The Lancet.

[12]  A. Bowling Techniques of questionnaire design , 2005 .

[13]  J. Gurwitz,et al.  Evaluation of Nationally Mandated Drug Use Reviews to Improve Patient Safety in Nursing Homes: A Natural Experiment , 2005, Journal of the American Geriatrics Society.

[14]  J. Donovan,et al.  Handbook of Health Research Methods , 2005 .

[15]  D. Bates,et al.  Effect of reducing interns' work hours on serious medical errors in intensive care units. , 2004, The New England journal of medicine.

[16]  Alan D Hutson,et al.  The utility of partial cross-over designs in early phase randomized prevention trials. , 2004, Controlled clinical trials.

[17]  David W Nierenberg,et al.  Educational epidemiology: applying population-based design and analytic approaches to study medical education. , 2004, JAMA.

[18]  J Martin Bland,et al.  Cluster randomised trials in the medical literature: two bibliometric surveys , 2018 .

[19]  F. Healey,et al.  Using targeted risk factor reduction to prevent falls in older in-patients: a randomised controlled trial. , 2004, Age and ageing.

[20]  Ziyad Mahfoud,et al.  What Is an Intracluster Correlation Coefficient? Crucial Concepts for Primary Care Researchers , 2004, The Annals of Family Medicine.

[21]  Arash Rashidian,et al.  Introducing Critical Care Outreach: a ward-randomised trial of phased introduction in a general hospital , 2004, Intensive Care Medicine.

[22]  Richard Lilford,et al.  Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma , 2004, The Lancet.

[23]  D. Altman,et al.  CONSORT statement: extension to cluster randomised trials , 2004, BMJ : British Medical Journal.

[24]  Jeremy M. Grimshaw,et al.  Sample size calculator for cluster randomized trials , 2004, Comput. Biol. Medicine.

[25]  Sanjay Saint,et al.  Use of critical pathways to improve efficiency: a cautionary tale. , 2003, The American journal of managed care.

[26]  Cheryl L. Hoying,et al.  The impact of dedicated medication nurses on the medication administration error rate: a randomized controlled trial. , 2003, Archives of internal medicine.

[27]  Iain Chalmers,et al.  Trying to do more Good than Harm in Policy and Practice: The Role of Rigorous, Transparent, Up-to-Date Evaluations , 2003 .

[28]  D. Bates,et al.  Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. , 2003, Archives of internal medicine.

[29]  David M. Murray,et al.  Methods To Reduce The Impact Of Intraclass Correlation In Group-Randomized Trials , 2003, Evaluation review.

[30]  D. Bates,et al.  What practices will most improve safety? Evidence-based medicine meets patient safety. , 2002, JAMA.

[31]  Kenneth F Schulz,et al.  Blinding in randomised trials: hiding who got what , 2002, The Lancet.

[32]  A. Donner,et al.  Design and Analysis of Cluster Randomised Trials , 2001 .

[33]  P. Sandercock,et al.  Framework for design and evaluation of complex interventions to improve health , 2000, BMJ : British Medical Journal.

[34]  J A Espinosa,et al.  Reducing errors made by emergency physicians in interpreting radiographs: longitudinal study , 2000, BMJ : British Medical Journal.

[35]  R. Lilford,et al.  Organisational research methods: closing the gap , 2000, The Lancet.

[36]  R J Lilford,et al.  Trials and fast changing technologies: the case for tracker studies , 2000, BMJ : British Medical Journal.

[37]  M. Marshall,et al.  Assertive community treatment for people with severe mental disorders. , 2000, The Cochrane database of systematic reviews.

[38]  R Lilford,et al.  Commissioning Health Services Research: An Iterative Method , 1999, Journal of health services research & policy.

[39]  Richard J Lilford,et al.  Ethical issues in the design and conduct of cluster randomised controlled trials , 1999, BMJ.

[40]  J. Sterne,et al.  Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review. , 1999, Health technology assessment.

[41]  S. Edwards,et al.  Executive summary Ethical issues in the design and conduct of randomised controlled trials , 1998 .

[42]  R. Morrow,et al.  Field trials of health interventions in developing countries : a toolbox , 1996 .

[43]  R J Lilford,et al.  Equipoise and the ethics of randomization. , 1995, Journal of the Royal Society of Medicine.

[44]  R. Lilford Formal measurement of clinical uncertainty: prelude to a trial in perinatal medicine , 1994, BMJ.

[45]  R J Lilford,et al.  Effect of using protocols on medical care: randomised trial of three methods of taking an antenatal history. , 1992, BMJ.

[46]  K L Posner,et al.  Effect of outcome on physician judgments of appropriateness of care. , 1991, JAMA.

[47]  L. Delbeke Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[48]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .