Evaluating priority setting success in healthcare: a pilot study

BackgroundIn healthcare today, decisions are made in the face of serious resource constraints. Healthcare managers are struggling to provide high quality care, manage resources effectively, and meet changing patient needs. Healthcare managers who are constantly making difficult resource decisions desire a way to improve their priority setting processes. Despite the wealth of existing priority setting literature (for example, program budgeting and marginal analysis, accountability for reasonableness, the 'describe-evaluate-improve' strategy) there are still no tools to evaluate how healthcare resources are prioritised. This paper describes the development and piloting of a process to evaluate priority setting in health institutions. The evaluation process was designed to examine the procedural and substantive dimensions of priority setting using a multi-methods approach, including a staff survey, decision-maker interviews, and document analysis.MethodsThe evaluation process was piloted in a mid-size community hospital in Ontario, Canada while its leaders worked through their annual budgeting process. Both qualitative and quantitative methods were used to analyze the data.ResultsThe evaluation process was both applicable to the context and it captured the budgeting process. In general, the pilot test provided support for our evaluation process and our definition of success, (i.e., our conceptual framework).ConclusionsThe purpose of the evaluation process is to provide a simple, practical way for an organization to better understand what it means to achieve success in its priority setting activities and identify areas for improvement. In order for the process to be used by healthcare managers today, modification and contextualization of the process are anticipated. As the evaluation process is applied in more health care organizations or applied repeatedly in an organization, it may become more streamlined.

[1]  David Short Setting Limits Fairly: Can We Learn to Share Medical Resources? , 2003 .

[2]  S. Bryan,et al.  Understanding the limited impact of economic evaluation in health care resource allocation: a conceptual framework. , 2007, Health policy.

[3]  C. Ham,et al.  Reasonable Rationing: international experience of priority setting in health care , 2003 .

[4]  Craig Mitton,et al.  Priority setting in health authorities: a novel approach to a historical activity. , 2003, Social science & medicine.

[5]  Douglas K. Martin,et al.  Priority-setting decisions for new cancer drugs: a qualitative case study , 2001, The Lancet.

[6]  Vivek Goel,et al.  Leadership and priority setting: the perspective of hospital CEOs. , 2006, Health policy.

[7]  C. Mitton,et al.  Setting priorities and allocating resources in health regions: lessons from a project evaluating program budgeting and marginal analysis (PBMA). , 2003, Health policy.

[8]  Jim Collins,et al.  Good to Great - (Why Some Companies Make the Leap and others Don't) , 2009 .

[9]  Douglas K. Martin,et al.  The effect of priority setting decisions for new cancer drugs on medical oncologists' practice in Ontario: a qualitative study , 2007, BMC Health Services Research.

[10]  Douglas K. Martin,et al.  Priority setting: what constitutes success? A conceptual framework for successful priority setting , 2009, BMC health services research.

[11]  C. Donaldson,et al.  Managing to manage healthcare resources in the English NHS? What can health economics teach? What can health economics learn? , 2007, Health policy.

[12]  Douglas K. Martin,et al.  Priority setting for new technologies in medicine: qualitative case study , 2000, BMJ : British Medical Journal.

[13]  C. Mitton,et al.  Tools of the trade: a comparative analysis of approaches to priority setting in healthcare , 2003, Health services management research.

[14]  M. Drummond,et al.  Inclusion of cost effectiveness in licensing requirements of new drugs : The fourth hurdle , 2017 .

[15]  N. Daniels,et al.  Limits to health care: fair procedures, democratic deliberation, and the legitimacy problem for insurers. , 1997, Philosophy & public affairs.

[16]  C. Mitton,et al.  Priority setting in the provincial health services authority: survey of key decision makers , 2007, BMC Health Services Research.

[17]  Douglas K. Martin,et al.  Priority setting in a hospital drug formulary: a qualitative case study and evaluation. , 2003, Health policy.

[18]  Edward B. Fiske Champions of Change: The Impact of the Arts on Learning. , 1999 .

[19]  Norway. , 1988, Revue scientifique et technique.

[20]  Stuart Peacock,et al.  Using economics to set pragmatic and ethical priorities , 2006, BMJ : British Medical Journal.

[21]  M. Scriven Types of Evaluation and Types of Evaluator , 1996 .

[22]  Douglas K. Martin,et al.  Ethics and economics: does programme budgeting and marginal analysis contribute to fair priority setting? , 2006, Journal of health services research & policy.

[23]  Douglas K. Martin,et al.  BMC Health Services Research BioMed Central Debate Setting priorities in health care organizations: criteria, processes, and parameters of success , 2004 .

[24]  N Mays,et al.  Qualitative Research: Rigour and qualitative research , 1995 .

[25]  Douglas K. Martin,et al.  Bedside Rationing by Health Practitioners: A Case Study in a Ugandan Hospital , 2007, Medical decision making : an international journal of the Society for Medical Decision Making.

[26]  Steve Morgan,et al.  Centralized drug review processes: are they fair? , 2006, Social science & medicine.

[27]  Douglas K. Martin,et al.  Priority-setting for healthcare: who, how, and is it fair? , 2007, Health policy.

[28]  Norman Daniels,et al.  Setting Limits Fairly: Can We Learn to Share Medical Resources? , 2002 .

[29]  Angela Coulter,et al.  The Global Challenge of Health Care Rationing , 2000 .

[30]  M. Crossan The Knowledge-Creating Company: How Japanese Companies Create the Dynamics of Innovation , 1996 .

[31]  S. Peacock An evaluation of program budgeting and marginal analysis applied in South Australian hospitals , 1998 .

[32]  A. Shorr,et al.  An update on cost-effectiveness analysis in critical care , 2002, Current opinion in critical care.

[33]  I. Nonaka,et al.  How Japanese Companies Create the Dynamics of Innovation , 1995 .

[34]  C. Riessman,et al.  Narrative in Social Work A Critical Review , 2005 .