Fidelity and moderating factors in complex interventions: a case study of a continuum of care program for frail elderly people in health and social care

BackgroundPrior studies measuring fidelity of complex interventions have mainly evaluated adherence, and not taken factors affecting adherence into consideration. A need for studies that clarify the concept of fidelity and the function of factors moderating fidelity has been emphasized. The aim of the study was to systematically evaluate implementation fidelity and possible factors influencing fidelity of a complex care continuum intervention for frail elderly people.MethodsThe intervention was a systematization of the collaboration between a nurse with geriatric expertise situated at the emergency department, the hospital ward staff, and a multi-professional team with a case manager in the municipal care services for older people. Implementation was evaluated between September 2008 and May 2010 with observations of work practices, stakeholder interviews, and document analysis according to a modified version of The Conceptual Framework for Implementation Fidelity.ResultsA total of 16 of the 18 intervention components were to a great extent delivered as planned, while some new components were added to the model. No changes in the frequency or duration of the 18 components were observed, but the dose of the added components varied over time. Changes in fidelity were caused in a complex, interrelated fashion by all the moderating factors in the framework, i.e., context, staff and participant responsiveness, facilitation, recruitment, and complexity.DiscussionThe Conceptual Framework for Implementation Fidelity was empirically useful and included comprehensive measures of factors affecting fidelity. Future studies should focus on developing the framework with regard to how to investigate relationships between the moderating factors and fidelity over time.Trial registrationClinicalTrials.gov, NCT01260493.

[1]  Robert A Berenson,et al.  Lost in Transition: Challenges and Opportunities for Improving the Quality of Transitional Care , 2004, Annals of Internal Medicine.

[2]  S. Kripalani,et al.  Promoting effective transitions of care at hospital discharge: a review of key issues for hospitalists. , 2007, Journal of hospital medicine.

[3]  Henna Hasson,et al.  Systematic evaluation of implementation fidelity of complex interventions in health and social care , 2010, Implementation science : IS.

[4]  Deborah Bybee,et al.  Fidelity Criteria: Development, Measurement, and Validation , 2003 .

[5]  Karen A. Blase,et al.  Implementation Research: A Synthesis of the , 2005 .

[6]  J. Graham,et al.  Program integrity as a moderator of prevention program effectiveness: results for fifth-grade students in the adolescent alcohol prevention trial. , 1991, Journal of studies on alcohol.

[7]  J. McGrew,et al.  Concurrent and predictive validity of two scales to assess the fidelity of implementation of supported employment. , 2005, Psychiatric rehabilitation journal.

[8]  Mathea Falco,et al.  A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. , 2003, Health education research.

[9]  H. Hasson,et al.  Implementing a continuum of care model for older people—results from a Swedish case study , 2011, International journal of integrated care.

[10]  Continuum of care for frail elderly people: Design of a randomized controlled study of a multi-professional and multidimensional intervention targeting frail elderly people. Wilhelmsson, , 2011 .

[11]  R Kosterman,et al.  Changing teaching practices to promote achievement and bonding to school. , 1998, The American journal of orthopsychiatry.

[12]  D S Cordray,et al.  Evaluation methods for social intervention. , 2000, Annual review of psychology.

[13]  Faye S. Taxman,et al.  Improving process evaluations of correctional programs by using a comprehensive evaluation methodology. , 2003, Evaluation and program planning.

[14]  Andrew Booth,et al.  Implementation Science BioMed Central Debate A conceptual framework for implementation fidelity , 2007 .

[15]  R. Grol,et al.  Integrated care programmes for chronically ill patients: a review of systematic reviews. , 2005, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[16]  J. Graham,et al.  Diffusion of a school-based substance abuse prevention program: predictors of program implementation. , 1993, Preventive medicine.

[17]  Michelle P. Salyers,et al.  Measurement of Fidelity in Psychiatric Rehabilitation , 2000, Mental health services research.

[18]  R. Noonan,et al.  Adoption, Adaptation, and Fidelity of Implementation of Sexual Violence Prevention Programs , 2009, Health promotion practice.

[19]  I. Hallberg,et al.  Preventive home care of frail older people: a review of recent case management studies. , 2004, Journal of clinical nursing.

[20]  H. Hasson,et al.  Continuum of care for frail elderly people: Design of a randomized controlled study of a multi-professional and multidimensional intervention targeting frail elderly people , 2011 .

[21]  Neal Schmitt,et al.  The fidelity-adaptation debate: Implications for the implementation of public sector social programs , 1987 .

[22]  Anthony L. Hemmelgarn,et al.  The effects of organizational climate and interorganizational coordination on the quality and outcomes of children's service systems. , 1998, Child abuse & neglect.

[23]  Barbara Resnick,et al.  Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. , 2004, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[24]  D. Mant,et al.  Development and evaluation of complex interventions in health services research: case study of the Southampton heart integrated care project (SHIP) , 1999 .

[25]  Johannes Brug,et al.  Krachtvoer: process evaluation of a Dutch programme for lower vocational schools to promote healthful diet. , 2006, Health education research.

[26]  Thomas J. Cook,et al.  Avoiding type III error in program evaluation: Results from a field experiment , 1980 .

[27]  M. Petticrew,et al.  Developing and evaluating complex interventions: the new Medical Research Council guidance , 2008, BMJ : British Medical Journal.

[28]  Julie C. Lowery,et al.  Fidelity of implementation: development and testing of a measure , 2010, Implementation science : IS.

[29]  Andrew V. Dane,et al.  Program integrity in primary and early secondary prevention: are implementation effects out of control? , 1998, Clinical psychology review.

[30]  Matthias J. Naleppa,et al.  Treatment Fidelity in Social Work Intervention Research: A Review of Published Studies , 2010 .

[31]  Steven E. Stemler,et al.  An Overview of Content Analysis. , 2001 .

[32]  K. Hofman,et al.  Implementation Science , 2007, Science.

[33]  Karen A. Blase,et al.  Implementation research: A synthesis of the literature (No. 231). University of South Florida, Louis de la Parte Florida Mental Health Implementation Research Network. , 2012 .

[34]  K. Eklund,et al.  Outcomes of coordinated and integrated interventions targeting frail elderly people: a systematic review of randomised controlled trials. , 2009, Health & social care in the community.

[35]  Belinda Borrelli,et al.  The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials. , 2011, Journal of public health dentistry.

[36]  A. Kilbourne,et al.  Implementing evidence-based interventions in health care: application of the replicating effective programs framework , 2007, Implementation science : IS.

[37]  Mark W. Fraser,et al.  Intervention Research: Developing Social Programs , 2009 .

[38]  H. Strupp,et al.  Effects of training in time-limited dynamic psychotherapy: changes in therapist behavior. , 1993, Journal of consulting and clinical psychology.

[39]  William B. Cissell,et al.  Process Evaluation for Public Health Interventions and Research , 2004 .

[40]  B. Borrelli.  The Assessment, Monitoring, and Enhancement of Treatment Fidelity In Public Health Clinical Trials. , 2011, Journal of public health dentistry.

[41]  Anna-Karin Edberg,et al.  Hospital admissions among people 65+ related to multimorbidity, municipal and outpatient care. , 2008, Archives of gerontology and geriatrics.

[42]  R. Glasgow,et al.  Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. , 2003, American journal of public health.

[43]  Margareta Gällstedt,et al.  Working conditions in projects: perceptions of stress and motivation among project team members and project managers , 2003 .

[44]  Barbara Resnick,et al.  A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research. , 2005, Journal of consulting and clinical psychology.

[45]  D R Becker,et al.  Fidelity of supported employment programs and employment outcomes. , 2001, Psychiatric services.

[46]  T. Baranowski,et al.  Process Evaluations of the 5-a-Day Projects , 2000, Health education & behavior : the official publication of the Society for Public Health Education.

[47]  Felipe González Castro,et al.  The Cultural Adaptation of Prevention Interventions: Resolving Tensions Between Fidelity and Fit , 2004, Prevention Science.

[48]  D. Mant,et al.  Development and evaluation of complex interventions in health services research: case study of the Southampton heart integrated care project (SHIP). The SHIP Collaborative Group. , 1999, BMJ.

[49]  G. Robert,et al.  Diffusion of innovations in service organizations: systematic review and recommendations. , 2004, The Milbank quarterly.