Combining evidence and values in priority setting: testing the balance sheet method in a low-income country

BackgroundProcedures for priority setting need to incorporate both scientific evidence and public values. The aim of this study was to test out a model for priority setting which incorporates both scientific evidence and public values, and to explore use of evidence by a selection of stakeholders and to study reasons for the relative ranking of health care interventions in a setting of extreme resource scarcity.MethodsSystematic search for and assessment of relevant evidence for priority setting in a low-income country. Development of a balance sheet according to Eddy's explicit method. Eight group interviews (n-85), using a modified nominal group technique for eliciting individual and group rankings of a given set of health interventions.ResultsThe study procedure made it possible to compare the groups' ranking before and after all the evidence was provided to participants. A rank deviation is significant if the rank order of the same intervention differed by two or more points on the ordinal scale. A comparison between the initial rank and the final rank (before deliberation) showed a rank deviation of 67%. The difference between the initial rank and the final rank after discussion and voting gave a rank deviation of 78%.ConclusionEvidence-based and deliberative decision-making does change priorities significantly in an experimental setting. Our use of the balance sheet method was meant as a demonstration project, but could if properly developed be feasible for health planners, experts and health workers, although more work is needed before it can be used for laypersons.

[1]  B. New,et al.  Setting priorities: is there a role for citizens' juries? , 1996, BMJ.

[2]  J. Bryant,et al.  Benchmarks of fairness for health care reform: a policy tool for developing countries. , 2000, Bulletin of the World Health Organization.

[3]  S. Redman,et al.  Consulting about priorities for the NHMRC National Breast Cancer Centre: how good is the nominal group technique , 1977, Australian and New Zealand journal of public health.

[4]  A. Fleming,et al.  Cost-effectiveness of malaria control in sub-Saharan Africa , 1999, The Lancet.

[5]  P. Jha,et al.  The cost-effectiveness of forty health interventions in Guinea. , 1998, Health policy and planning.

[6]  K. Floyd,et al.  Cost-effectiveness of HIV/AIDS interventions in Africa: a systematic review of the evidence , 2002, The Lancet.

[7]  Rob Baltussen,et al.  Programme costs in the economic evaluation of health interventions , 2003, Cost effectiveness and resource allocation : C/E.

[8]  D. Eddy,et al.  Clinical decision making: from theory to practice. Guidelines for policy statements: the explicit approach. , 1990, JAMA.

[9]  Anthony Costello,et al.  Integrated management of childhood illness , 1997, The Lancet.

[10]  G. Mbaruku,et al.  Randomised trial of alternative malaria chemoprophylaxis strategies among pregnant women in Kigoma, Tanzania: II. Results from baseline studies. , 2009, East African medical journal.

[11]  S. Egwaga,et al.  Trend in HIV prevalence among tuberculosis patients in Tanzania, 1991-1998. , 2001, The international journal of tuberculosis and lung disease : the official journal of the International Union against Tuberculosis and Lung Disease.

[12]  P. Taylor.  Clinical Decision Making: From Theory to Practice , 1996 .

[13]  P. IsazaNieto.  Health sector reform , 1995 .

[14]  M. Emmelin,et al.  Monitoring of HIV-1 infection prevalence and trends in the general population using pregnant women as a sentinel population: 9 years experience from the Kagera region of Tanzania. , 2000 .

[15]  C. Charles,et al.  Lay participation in health care decision making: a conceptual framework. , 1993, Journal of health politics, policy and law.

[16]  M. Whitehead,et al.  The concepts and principles of equity and health. , 1992, International journal of health services : planning, administration, evaluation.

[17]  D. Eddy.  Guidelines for Policy Statements: the Explicit Approach , 1990 .

[18]  Dennis F. Thompson,et al.  Democracy and Disagreement , 1996 .

[19]  Elly Stolk,et al.  Towards a multi-criteria approach for priority setting: an application to Ghana. , 2006, Health economics.

[20]  Benchmarks of Fairness: A Moral Framework for Assessing Equity , 1999, International journal of health services : planning, administration, evaluation.

[21]  R. Varley,et al.  A reassessment of the cost-effectiveness of water and sanitation interventions in programmes for controlling childhood diarrhoea. , 1998, Bulletin of the World Health Organization.

[22]  R. Baltussen,et al.  Priority setting of health interventions: the need for multi-criteria decision analysis , 2006, Cost effectiveness and resource allocation : C/E.

[23]  C. Kilewo,et al.  HIV Counseling and Testing of Pregnant Women in Sub‐Saharan Africa: Experiences From a Study on Prevention of Mother‐to‐Child HIV‐1 Transmission in Dar Es Salaam, Tanzania , 2001, Journal of acquired immune deficiency syndromes.

[24]  D B Evans,et al.  Development of WHO guidelines on generalized cost-effectiveness analysis. , 2000, Health economics.

[25]  L. Kapiriri,et al.  Whose priorities count? Comparison of community‐identified health problems and Burden‐of‐Disease‐assessed health priorities in a district in Uganda , 2002, Health expectations : an international journal of public participation in health care and health policy.

[26]  R. Hayes,et al.  HIV‐associated adult mortality in a rural Tanzanian population , 1997, AIDS.

[27]  A. Mills,et al.  The cost-effectiveness of antenatal malaria prevention in sub-Saharan Africa. , 2001, The American journal of tropical medicine and hygiene.

[28]  Elliot Marseille,et al.  Cost effectiveness of single-dose nevirapine regimen for mothers and babies to decrease vertical HIV-1 transmission in sub-Saharan Africa , 1999, The Lancet.

[29]  Alan D. Lopez,et al.  Evidence-Based Health Policy--Lessons from the Global Burden of Disease Study , 1996, Science.

[30]  A. Mills,et al.  Economic analysis of malaria control in Sub-Saharan Africa , 2000 .

[31]  C. Drakeley,et al.  Estimates of the infectious reservoir of Plasmodium falciparum malaria in The Gambia and in Tanzania. , 2000, Transactions of the Royal Society of Tropical Medicine and Hygiene.

[32]  J. Stringer,et al.  Cost‐Effective Use of Nevirapine to Prevent Vertical HIV Transmission in Sub‐Saharan Africa , 2000, Journal of acquired immune deficiency syndromes.

[33]  Norman Daniels,et al.  Accountability for reasonableness , 2000, BMJ : British Medical Journal.

[34]  C. Goodman,et al.  The evidence base on the cost-effectiveness of malaria control measures in Africa. , 1999, Health policy and planning.

[35]  K. Floyd,et al.  Comparison of cost effectiveness of directly observed treatment (DOT) and conventionally delivered treatment for tuberculosis: experience from rural South Africa , 1997, BMJ.

[36]  S. Sonnad,et al.  HIV counseling and testing of pregnant women. , 1996, JAMA.

[37]  S. Gregorich,et al.  Cost-effectiveness of voluntary HIV-1 counselling and testing in reducing sexual transmission of HIV-1 in Kenya and Tanzania , 2000, The Lancet.

[38]  P. Singer.  Resource allocation: beyond evidence-based medicine and cost-effectiveness analysis. , 1997, ACP journal club.

[39]  T. Edejer,et al.  Generalized cost-effectiveness analysis for national-level priority-setting in the health sector , 2003, Cost effectiveness and resource allocation : C/E.

[40]  T. Hu,et al.  Setting Health Priorities: Community Boards Accurately Reflect the Preferences of the Community's Residents , 1997, Journal of Community Health.

[41]  M. Emmelin,et al.  Monitoring of HIV‐1 Infection Prevalence and Trends in the General Population Using Pregnant Women as a Sentinel Population: 9 Years Experience From the Kagera Region of Tanzania , 2000, Journal of Acquired Immune Deficiency Syndromes.

[42]  Richard Cookson,et al.  Effect of discussion and deliberation on the public's views of priority setting in health care: focus group study , 1999, BMJ.

[43]  N. Daniels,et al.  Accountability for reasonableness. , 2000, BMJ.

[44]  Norman Daniels,et al.  Setting Limits Fairly: Can We Learn to Share Medical Resources? , 2002 .