How do we know?

We know that every improvement is a change—but how do we know that a change is an improvement?1 Improvement experts and patients, each in their own terms, ask this question with appropriate impatience.23 For example, how can valid conclusions be drawn when an improvement initiative employs no control population, or if the study employs predominantly qualitative measures? Indeed, some argue that if the RCT is the gold standard, how can improvement scientists settle for less?4 Others counter that this frame actually constrains the options for knowing.56 Flyvbjerg describes these debates in the larger scientific community—at their most vehement—as the Science Wars.7 That goes far beyond where I intend to take this modest essay. Increasingly there are calls for a rich discussion and appraisal of new ways of knowing while striving to improve existing methodologies in healthcare improvement and patient safety.23 I propose that this journal, given its unique subject matter, provides an appropriate test bed to assess the rigour and utility of scholarly reports in these fields. While doing so, we must also be mindful that there are emerging media that …

[1]  R. Thomson,et al.  An epistemology of patient safety research: a framework for study design and interpretation. Part 3. End points and measurement , 2008, Quality & Safety in Health Care.

[2]  R J Lilford,et al.  An epistemology of patient safety research: a framework for study design and interpretation. Part 4. One size does not fit all , 2008, Quality & Safety in Health Care.

[3]  R J Lilford,et al.  An epistemology of patient safety research: a framework for study design and interpretation. Part 2. Study design , 2008, Quality & Safety in Health Care.

[4]  R J Lilford,et al.  An epistemology of patient safety research: a framework for study design and interpretation. Part 1. Conceptualising and developing interventions , 2008, Quality & Safety in Health Care.

[5]  D. Berwick The science of improvement. , 2008, JAMA.

[6]  T. Boat,et al.  From waste to value in health care. , 2008, JAMA.

[7]  Trisha Greenhalgh,et al.  Realist review to understand the efficacy of school feeding programmes , 2007, British medical journal.

[8]  F. Davidoff,et al.  What is “quality improvement” and how can it transform healthcare? , 2007, Quality and Safety in Health Care.

[9]  P. Tugwell,et al.  School feeding for improving the physical and psychosocial health of disadvantaged elementary school children. , 2007, The Cochrane database of systematic reviews.

[10]  P. Tugwell,et al.  School feeding for improving the physical and psychosocial health of disadvantaged students , 2006 .

[11]  E. Wagner,et al.  Transform residency training in chronic illness care -- now. , 2006, Academic medicine : journal of the Association of American Medical Colleges.

[12]  P. Pronovost,et al.  Proposed standards for quality improvement research and publication: one step forward and two steps back , 2006, Quality and Safety in Health Care.

[13]  F Davidoff,et al.  Toward stronger evidence on quality improvement. Draft publication guidelines: the beginning of a consensus project , 2005, Quality and Safety in Health Care.

[14]  T. Greenhalgh,et al.  Realist review - a new method of systematic review designed for complex policy interventions , 2005, Journal of health services research & policy.

[15]  F Moss,et al.  A new structure for quality improvement reports , 1999, Quality & safety in health care.

[16]  Brian T. Austin,et al.  Improving chronic illness care: translating evidence into action. , 2001, Health affairs.

[17]  E H Wagner,et al.  Quality improvement in chronic illness care: a collaborative approach. , 2001, The Joint Commission journal on quality improvement.

[18]  B. Flyvbjerg Making Social Science Matter , 2001 .