Evaluating midwifery-led antenatal care: using a programme logic model to identify relevant outcomes.

BACKGROUND a range of initiatives has been introduced in Ireland and internationally in recent years to establish midwifery-led models of care, generally aimed at increasing the choices available for women for maternity care. A midwifery-led antenatal clinic was first established at the study site (a large urban maternity hospital in Dublin) and extended over recent years. This paper reports on the design of an evaluation of these midwives clinics, in particular the use of a programme logic model to select outcomes to be included in the evaluation. AIMS AND OBJECTIVES the programme logic model is used to identify the theory of a programme and is an integrative framework for the design and analysis of evaluations using qualitative and quantitative methods. Through an inclusive approach, the aim was to identify the most relevant outcomes to be included in the evaluation, by identifying and linking programme (midwifery-led antenatal clinic) outcomes to the goals, inputs and processes involved in the production of these outcomes. METHODS the process involved a literature review, a review of policy documents and previous reviews of the clinics, interviews with midwives, obstetricians and managers to identify possible outcomes, a focus group with midwives, obstetricians, managers and women who had attended the clinics to refine and prioritise outcomes, and a follow-up survey to refine and prioritise the outcomes identified and to identify sources of data on each outcome. FINDINGS seven categories of outcomes were identified: (1) choice, (2) relationship/interaction with caregiver, (3) experience of care, (4) preparation and education for childbirth and parenthood, (5) effectiveness of care, (6) organisational outcomes, and (7) programme viability. A range of sources of information was identified for each outcome, including existing documentation and data, chart audit, survey of women, and interviews and focus groups with midwives, obstetricians, managers and women. CONCLUSIONS the programme logic model provided an inclusive, systematic and transparent approach to identifying relevant outcomes to be included in the evaluation. The information obtained has been used since to design the evaluation project, which is currently being concluded.

[1]  J. Sandall,et al.  A qualitative exploration of the creation of calm in a continuity of carer model of maternity care in London. , 2009, Midwifery.

[2]  M. Renfrew,et al.  Continuity of carer: what matters to women? A review of the evidence. , 2000, Midwifery.

[3]  C. Hallinan.  Program logic: a framework for health program design and evaluation - the Pap nurse in general practice program. , 2010, Australian journal of primary health.

[4]  Clinical Excellence,et al.  Antenatal care : routine care for the healthy pregnant woman , 2008 .

[5]  M. A. Scheirer.  Is Sustainability Possible? A Review and Commentary on Empirical Studies of Program Sustainability , 2005 .

[6]  Declan Devane,et al.  Midwife-led versus other models of care for childbearing women. , 2008, The Cochrane database of systematic reviews.

[7]  M. Clarke,et al.  Evaluating maternity care: a core set of outcome measures. , 2007, Birth.

[8]  G. Piaggio,et al.  Patterns of routine antenatal care for low-risk pregnancy. , 2001, The Cochrane database of systematic reviews.

[9]  John A. McLaughlin,et al.  Logic models: a tool for telling your programs performance story , 1999 .

[10]  Svetlana Yampolskaya,et al.  Using Concept Mapping to Develop a Logic Model and Articulate a Program Theory: A Case Example , 2004 .

[11]  M. Redshaw.  Women as consumers of maternity care: measuring "satisfaction" or "dissatisfaction"? , 2008, Birth.

[12]  Leslie J. Cooksy,et al.  The Program Logic Model as an Integrative Framework for a Multimethod Evaluation , 2001 .

[13]  J. Kavanagh,et al.  The socioeconomic value of nursing and midwifery : a rapid systematic review of reviews. Interim policy briefing , 2009 .

[14]  Maura MacPhee,et al.  Developing a practice-academic partnership logic model. , 2009, Nursing outlook.

[15]  Ann Jones,et al.  Open systems evaluation and the logic model: Program planning and evaluation tools , 1995 .

[16]  M. Parchman,et al.  A Logic Model Framework for Evaluation and Planning in a Primary Care Practice-based Research Network (PBRN) , 2011, The Journal of the American Board of Family Medicine.

[17]  J. Macintosh,et al.  Development of a program logic model to measure the processes and outcomes of a nurse-managed community health clinic. , 2003, Journal of professional nursing : official journal of the American Association of Colleges of Nursing.

[18]  J. Bucher.  Using the Logic Model for Planning and Evaluation: Examples for New Users , 2010 .

[19]  E. Blix,et al.  Is the operative delivery rate in low-risk women dependent on the level of birth care? A randomised controlled trial , 2011, BJOG : an international journal of obstetrics and gynaecology.

[20]  E. Blix,et al.  Is the Operative Delivery Rate in Low-risk Women Dependent on the Level of Birth Care? A Randomized Controlled Trial , 2012 .

[21]  I. Hildingsson,et al.  Women's expectations on antenatal care as assessed in early pregnancy: number of visits, continuity of caregiver and general content , 2002, Acta obstetricia et gynecologica Scandinavica.

[22]  S. Brophy,et al.  Interventions for latent autoimmune diabetes (LADA) in adults. , 2011, The Cochrane database of systematic reviews.

[23]  U. Waldenström,et al.  A systematic review comparing continuity of midwifery care with standard maternity services , 1998, British journal of obstetrics and gynaecology.

[24]  T. Mccance,et al.  Identifying key performance indicators for nursing and midwifery care using a consensus approach. , 2012, Journal of clinical nursing.

[25]  Deborah L Wasserman,et al.  The growing up fast diversion program: An example of juvenile justice program development for outcome evaluation , 2000 .

[26]  P. van’t Veer,et al.  Evaluation design for a complex intervention program targeting loneliness in non-institutionalized elderly Dutch people , 2010, BMC public health.

[27]  R. Kaplan,et al.  The balanced scorecard--measures that drive performance. , 2015, Harvard business review.

[28]  Yvonne A. Unrau.  Using client exit interviews to illuminate outcomes in program logic models: a case example , 2001 .

[29]  Chris Cooper,et al.  Staffing in maternity units. Getting the right people in the right place at the right time , 2011 .

[30]  Jihad Makhoul,et al.  Developing a logic model for youth mental health: participatory research with a refugee community in Beirut. , 2011, Health policy and planning.

[31]  Program theory and logic model to address the co-occurrence of domestic violence and child maltreatment. , 2010, Evaluation and program planning.

[32]  Christine M O'Keefe,et al.  Application of logic models in a large scientific research program. , 2011, Evaluation and program planning.

[33]  Julie F Pallant,et al.  Women's satisfaction with antenatal care: comparing women in Sweden and Australia. , 2013, Women and birth : journal of the Australian College of Midwives.

[34]  Paul Martin,et al.  Erratum to “The mid Staffordshire NHS Foundation trust inquiry: The Robert Francis report” [Nurse Education Today (Issue 33/3) Page 181–182] , 2013 .

[35]  J. Chambers,et al.  Supporting breastfeeding mothers: qualitative synthesis. , 2008, Journal of advanced nursing.

[36]  N. Leap.  Woman-centred or women-centred care: does it matter? , 2009 .