Step-wedge cluster-randomised community-based trials: An application to the study of the impact of community health insurance

BackgroundWe describe a step-wedge cluster-randomised community-based trial which has been conducted since 2003 to accompany the implementation of a community health insurance (CHI) scheme in West Africa. The trial aims at overcoming the paucity of evidence-based information on the impact of CHI. Impact is defined in terms of changes in health service utilisation and household protection against the cost of illness. Our exclusive focus on the description and discussion of the methods is justified by the fact that the study relies on a methodology previously applied in the field of disease control, but never in the field of health financing.MethodsFirst, we clarify how clusters were defined both in respect of statistical considerations and of local geographical and socio-cultural concerns. Second, we illustrate how households within clusters were sampled. Third, we expound the data collection process and the survey instruments. Finally, we outline the statistical tools to be applied to estimate the impact of CHI.ConclusionWe discuss all design choices both in relation to methodological considerations and to specific ethical and organisational concerns faced in the field. On the basis of the appraisal of our experience, we postulate that conducting relatively sophisticated trials (such as our step-wedge cluster-randomised community-based trial) aimed at generating sound public health evidence, is both feasible and valuable also in low income settings. Our work shows that if accurately designed in conjunction with local health authorities, such trials have the potential to generate sound scientific evidence and do not hinder, but at times even facilitate, the implementation of complex health interventions such as CHI.

[1]  Juan Manuel Medina,et al.  Monetary incentives in primary health care and effects on use and coverage of preventive health care interventions in rural Honduras: cluster randomised trial , 2004, The Lancet.

[2]  R. J. Hayes,et al.  Design and analysis issues in cluster-randomized trials of interventions against infectious diseases , 2000, Statistical methods in medical research.

[3]  R. D'Agostino.  Adjustment Methods: Propensity Score Methods for Bias Reduction in the Comparison of a Treatment to a Non‐Randomized Control Group , 2005 .

[4]  J. Grimshaw,et al.  Intracluster correlation coefficients in cluster randomized trials: empirical insights into how should they be reported , 2004, BMC medical research methodology.

[5]  E. Keeler,et al.  Health insurance and the demand for medical care: evidence from a randomized experiment. , 1987, The American economic review.

[6]  J. Bryce,et al.  Evidence-based public health: moving beyond randomized trials. , 2004, American journal of public health.

[7]  Indu Bhushan,et al.  Achieving the Twin Objectives of Efficiency and Equity: Contracting Health Services in Cambodia , 2002 .

[8]  Lung-fei Lee.  Generalized Econometric Models with Selectivity , 1983 .

[9]  R. Sauerborn,et al.  The Nouna Health District Household Survey Design and Implementation , 2001 .

[10]  David M. Dror,et al.  Micro-Insurance: Extending Health Insurance to the Excluded , 1999 .

[11]  A. Tatem,et al.  Mapping the environmental coverage of the INDEPTH demographic surveillance system network in rural Africa , 2006, Tropical medicine & international health : TM & IH.

[12]  David M. Murray,et al.  Design and Analysis of Group- Randomized Trials , 1998 .

[13]  David M. Murray,et al.  Methods To Reduce The Impact Of Intraclass Correlation In Group-Randomized Trials , 2003, Evaluation review.

[14]  H. Becher,et al.  Health research in developing countries : a collaboration between Burkina Faso and Germany , 2005 .

[15]  A. Trujillo.  Medical care use and selection in a social health insurance with an equalization fund: evidence from Colombia. , 2003, Health economics.

[16]  R. Ellis,et al.  The impact of financing and quality changes on health care demand in Niger. , 2000, Health policy and planning.

[17]  Rainer Sauerborn,et al.  The feasibility of community-based health insurance in Burkina Faso. , 2004, Health policy.

[18]  D. Guilkey,et al.  Price elasticities of demand for curative health care with control for sample selectivity on endogenous illness: an analysis for Sri Lanka. , 1998, Health economics.

[19]  Jeremy M. Grimshaw,et al.  Sample size calculator for cluster randomized trials , 2004, Comput. Biol. Medicine.

[20]  B. Criel.  District-based health insurance in sub-Saharan Africa. Part I: from theory to practice , 1998 .

[21]  H. Waters.  Measuring the impact of health insurance with a correction for selection bias--a case study of Ecuador. , 1999, Health economics.

[22]  A. Mills,et al.  Equitable utilisation of Indian community based health insurance scheme among its rural membership: cluster randomised controlled trial , 2007, BMJ : British Medical Journal.

[23]  E. Foster,et al.  Propensity Score Matching: An Illustrative Analysis of Dose Response , 2003, Medical care.

[24]  D. Torgerson,et al.  Evidence for risk of bias in cluster randomised trials: review of recent trials published in three general medical journals , 2003, BMJ : British Medical Journal.

[25]  H. Becher,et al.  Mortality patterns, 1993–98, in a rural area of Burkina Faso, West Africa, based on the Nouna demographic surveillance system , 2002, Tropical medicine & international health : TM & IH.

[26]  J. Heckman.  Sample selection bias as a specification error , 1979 .

[27]  C. Hjortsberg.  Why do the sick not utilise health care? The case of Zambia. , 2003, Health economics.

[28]  Gary King,et al.  A Politically Robust Experimental Design for Public Policy Evaluation, With Application to the Mexican Universal Health Insurance Program , 2007, Journal of policy analysis and management : [the journal of the Association for Public Policy Analysis and Management].

[29]  G. Carrin,et al.  Health financing for poor people : resource mobilization and risk sharing , 2004 .

[30]  B. Criel,et al.  Les mutuelles de sante en Afrique Sub-Saharienne - etat des lieux et reflexions sur un agenda de recherche , 2004 .

[31]  A. M. Vera-Hernández,et al.  Duplicate coverage and demand for health care. The case of Catalonia. , 1999, Health economics.

[32]  Jonathan L. Blitstein,et al.  Design and analysis of group-randomized trials: a review of recent methodological developments. , 2004, American journal of public health.

[33]  M. Barreto.  Health research in developing countries , 2009, BMJ : British Medical Journal.

[34]  A. Mills,et al.  Measuring improved targeting of health interventions to the poor in the context of a community-randomised trial in rural India. , 2007, Contemporary clinical trials.

[35]  R. Sauerborn,et al.  The economic costs of illness for rural households in Burkina Faso. , 1995, Tropical medicine and parasitology : official organ of Deutsche Tropenmedizinische Gesellschaft and of Deutsche Gesellschaft fur Technische Zusammenarbeit.

[36]  R. Sauerborn,et al.  Perceptions of Risk, Vulnerability, and Disease Prevention in Rural Burkina Faso: Implications for Community-Based Health Care and Insurance , 2002 .

[37]  M. Ranson.  Reduction of catastrophic health care expenditures by a community-based health insurance scheme in Gujarat, India: current experiences and challenges. , 2002, Bulletin of the World Health Organization.

[38]  Donald Rubin,et al.  Estimating Causal Effects from Large Data Sets Using Propensity Scores , 1997, Annals of Internal Medicine.

[39]  A. Mills,et al.  CRTs — Cluster Randomized Trials or “Courting Real Troubles” , 2006, Canadian journal of public health.

[40]  R. Sauerborn,et al.  "To enrol or not to enrol?": A qualitative investigation of demand for health insurance in rural West Africa. , 2006, Social science & medicine.

[41]  D. Altman,et al.  CONSORT statement: extension to cluster randomised trials , 2004, BMJ : British Medical Journal.

[42]  R. Sauerborn,et al.  Understanding enrolment in community health insurance in sub-Saharan Africa: a population-based case-control study in rural Burkina Faso. , 2006, Bulletin of the World Health Organization.

[43]  M Soledad Cepeda,et al.  Comparison of logistic regression versus propensity score when the number of events is low and there are multiple confounders. , 2003, American journal of epidemiology.

[44]  G. Carrin,et al.  Rich-Poor Differences in Health Care Financing , 2007 .

[45]  Rainer Sauerborn,et al.  Willingness-to-pay for community-based insurance in Burkina Faso. , 2003, Health economics.

[46]  G. Maddala.  A survey of the literature on selectivity bias as it pertains to health care markets. , 1985, Advances in health economics and health services research.

[47]  J. Simpson,et al.  Accounting for cluster randomization: a review of primary prevention trials, 1990 through 1993. , 1995, American journal of public health.

[48]  A. Haines,et al.  Health financing to promote access in low income settings—how much do we know? , 2004, The Lancet.

[49]  R. Sauerborn,et al.  Informal risk-sharing arrangements (IRSAs) in rural Burkina Faso: lessons for the development of community-based insurance (CBI). , 2002, The International journal of health planning and management.

[50]  R. Sauerborn,et al.  The effect of community-based health insurance on the utilization of modern health care services: evidence from Burkina Faso. , 2009, Health policy.

[51]  B. Criel,et al.  District-based health insurance in sub-Saharan Africa. Part II: case-studies , 1998 .

[52]  Björn Ekman,et al.  Community-based health insurance in low-income countries: a systematic review of the evidence. , 2004, Health policy and planning.

[53]  H. Becher,et al.  Risk factors for childhood mortality in sub-Saharan Africa. A comparison of data from a Demographic and Health Survey and from a Demographic Surveillance System. , 2006, Acta tropica.

[54]  R. Sauerborn,et al.  Examining out‐of‐pocket expenditure on health care in Nouna, Burkina Faso: implications for health policy , 2002, Tropical medicine & international health : TM & IH.