Methods for exploring implementation variation and local context within a cluster randomised community intervention trial

Insignificant or modest findings in intervention trials may be attributable to poorly designed or theorised interventions, poorly implemented interventions, or inadequate evaluation methods. The pre-existing context may also account for the effects observed. A combination of qualitative and quantitative methods is outlined that will permit the determination of how context level factors might modify intervention effectiveness, within a cluster randomised community intervention trial to promote the health of mothers with new babies. The methods include written and oral narratives, key informant interviews, impact logs, and inter-organisational network analyses. Context level factors, which may affect intervention uptake, success, and sustainability are the density of inter-organisational ties within communities at the start of the intervention, the centrality of the primary care agencies expected to take a lead with the intervention, the extent of context-level adaptation of the intervention, and the amount of local resources contributed by the participating agencies. Investigation of how intervention effects are modified by context is a new methodological frontier in community intervention trial research.

[1]  Thomas W. Valente,et al.  Interorganizational relationships among HIV/AIDS service organizations in Baltimore: A newtwork analysis , 2001, Journal of Urban Health.

[2]  P. Hawe,et al.  Contested ground: how should qualitative evidence inform the conduct of a community intervention trial? , 2005, Journal of health services research & policy.

[3]  H Roberts,et al.  Putting public health evidence into practice: increasing the prevalence of working smoke alarms in disadvantaged inner city housing , 2004, Journal of Epidemiology and Community Health.

[4]  J. Gunn,et al.  PRISM (Program of Resources, Information and Support for Mothers) Protocol for a community-randomised trial [ISRCTN03464021] , 2003, BMC public health.

[5]  D. Druckman,et al.  Theory, research, and practice , 2003 .

[6]  J. Grimshaw,et al.  Research designs for studies evaluating the effectiveness of change and improvement strategies , 2003, Quality & safety in health care.

[7]  M. Frommer,et al.  Criteria for evaluating evidence on public health interventions , 2002, Journal of epidemiology and community health.

[8]  Pennie G. Foster-Fishman,et al.  Facilitating Interorganizational Collaboration: The Contributions of Interorganizational Alliances , 2001, American journal of community psychology.

[9]  N. Wolff,et al.  Randomised trials of socially complex interventions: promise or peril? , 2001, Journal of health services research & policy.

[10]  P. Sandercock,et al.  Framework for design and evaluation of complex interventions to improve health , 2000, BMJ : British Medical Journal.

[11]  P. Hawe Intervention for late life depression in residential care. How much trial and error should we tolerate in community trials? , 2000, BMJ.

[12]  A FRAMEWORK FOR DEVELOPMENT AND EVALUATION OF RCTs FOR COMPLEX INTERVENTIONS TO IMPROVE HEALTH , 2000 .

[13]  D. Mant,et al.  Development and evaluation of complex interventions in health services research: case study of the Southampton heart integrated care project (SHIP) , 1999 .

[14]  Don Nutbeam,et al.  Evaluating Health Promotion , 1999, BMJ.

[15]  S. A. Weiss THE TRIBULATIONS OF TRIALS , 1999 .

[16]  Joseph A. Durlak,et al.  Why Program Implementation is Important , 1998 .

[17]  J. Catford,et al.  Effects of the Heartbeat Wales programme over five years on behavioural risks for cardiovascular disease: quasi-experimental comparison of results from Wales and a matched reference area , 1998, BMJ.

[18]  M. Shediac-Rizkallah,et al.  Planning for the sustainability of community-based health programs: conceptual frameworks and future directions for research, practice and policy. , 1998, Health education research.

[19]  E. Trickett Toward a framework for defining and resolving ethical issues in the protection of communities involved in primary prevention projects. , 1998, Ethics & behavior.

[20]  W. Penney,et al.  Reflective inquiry in nursing practice or 'revealing images'. , 1997, Nursing inquiry.

[21]  D. Stokols Translating Social Ecological Theory into Guidelines for Community Health Promotion , 1996, American journal of health promotion : AJHP.

[22]  S. Fortmann,et al.  Community intervention trials: reflections on the Stanford Five-City Project Experience. , 1995, American journal of epidemiology.

[23]  M A Zimmerman,et al.  Evaluation of Health Education Programs: Current Assessment and Future Directions , 1995, Health education quarterly.

[24]  M. Susser The tribulations of trials--intervention in communities. , 1995, American journal of public health.

[25]  Stephen B. Fawcett,et al.  Work Group Evaluation Handbook: Evaluating and Supporting Community Initiatives for , 1995 .

[26]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994, Structural analysis in the social sciences.

[27]  Sue A. Stickel,et al.  Knowing in Action: A First-Year Counselor's Process of Reflection. , 1994 .

[28]  Penelope Hawe,et al.  Capturing the meaning of ‘community’ in community intervention evaluation: some contributions from community psychology , 1994 .

[29]  S. Fawcett,et al.  A methodology for monitoring and evaluating community health coalitions. , 1993, Health education research.

[30]  E H Wagner,et al.  Activating communities for health promotion: a process evaluation method. , 1993, American journal of public health.

[31]  R. Lefebvre,et al.  A community education monitoring system: methods from the Stanford Five-City Project, the Minnesota Heart Health Program and the Pawtucket Heart Health Program. , 1993, Health Education Research.

[32]  A Steckler,et al.  A Critique of Contemporary Community Health Promotion Approaches: Based on a Qualitative Review of Six Programs in Maine , 1993, American journal of health promotion : AJHP.

[33]  P. Doreian,et al.  Fixed list versus snowball selection of social networks , 1992 .

[34]  A Donner,et al.  Sample size requirements for stratified cluster randomization designs. , 1992, Statistics in medicine.

[35]  K. Glanz,et al.  Health behavior and health education : theory, research, and practice , 1991 .

[36]  Jane Hall,et al.  Evaluating health promotion : a health worker's guide , 1990 .

[37]  R F Heller,et al.  Reducing blood cholesterol levels in patients with peripheral vascular disease: dietitian or diet fact sheet? , 1989, The Medical journal of Australia.

[38]  C. Heinze Gaining Insight Through “Journaling” , 1987 .

[39]  Anselm L. Strauss,et al.  Qualitative Analysis For Social Scientists , 1987 .

[40]  D. Ruzicki Measurement and evaluation in health education and health promotion , 1986 .

[41]  R. J. Bogumil,et al.  The reflective practitioner: How professionals think in action , 1985, Proceedings of the IEEE.

[42]  D. C. Klein,et al.  Community Research: Methods, Paradigms, and Applications , 1985 .

[43]  Donald A. Sch The reflective practitioner: how professionals think in action , 1983 .

[44]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .