Optimising the construction of outcome measures for impact evaluations of intimate partner violence (IPV) prevention interventions

Most impact evaluations of IPV prevention interventions use binary measures of any versus no physical and/or sexual IPV as their primary outcome measure, missing opportunities to capture nuance. In this study, we reanalysed secondary data from six randomised controlled trials conducted in low and middle-income countries- Bandebereho (Rwanda), Becoming One (Uganda), Indashyikirwa (Rwanda), MAISHA CRT01, MAISHA CRT02 (Tanzania), Stepping Stones Creating Futures (South Africa), and Unite for a Better Life (Ethiopia), to assess how different conceptualisations and coding of IPV variables can influence interpretations of the impact of an intervention. We compared standard outcome measures to new measures that reflect the severity and intensity of violence and whether interventions prevent new cases of IPV or reduce or stop ongoing violence. Results indicate that traditional binary indicators masked some of the more subtle intervention effects, and the use of the new indicators allowed for a better understanding of the impacts of the interventions. Conclusions on whether a program is perceived to work are highly influenced by the IPV outcomes investigators choose to report and how they are measured and coded. Lack of attention to outcome choice and measurement could lead to prematurely abandoning strategies useful for violence reduction or missing essential insights into how programs may or may not affect IPV. While these results must be interpreted cautiously, given differences in intervention types, the underlying prevalence of violence, sociodemographic factors, sample sizes and other contextual differences across the trial sites, they can help us move toward a new approach to reporting multiple outcomes that allow us to unpack the impact of an intervention by assessing intervention effect by the severity of violence and type of prevention, whether primary and secondary.

[1]  J. Annan,et al.  Religious leaders can motivate men to cede power and reduce intimate partner violence: Experimental evidence from Uganda , 2022, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Y. F. Cheong,et al.  Impact of Measurement Variability on Study Inference in Partner Violence Prevention Trials in Low- and Middle-Income Countries , 2022, Assessment.

[3]  Y. F. Cheong,et al.  Monitoring sustainable development goal 5.2: Cross-country cross-time invariance of measures for intimate partner violence , 2022, medRxiv.

[4]  R. Richmond,et al.  A Systematic Review of Interventions to Reduce Gender-Based Violence Among Women and Girls in Sub-Saharan Africa , 2022, Trauma, violence & abuse.

[5]  S. Lees,et al.  A cluster randomised controlled trial to evaluate the impact of a gender transformative intervention on intimate partner violence against women in newly formed neighbourhood groups in Tanzania , 2021, BMJ Global Health.

[6]  K. Dunkle,et al.  Effective prevention of intimate partner violence through couples training: a randomised controlled trial of Indashyikirwa in Rwanda , 2020, BMJ Global Health.

[7]  Vandana Sharma,et al.  Effectiveness of a culturally appropriate intervention to prevent intimate partner violence and HIV transmission among men, women, and couples in rural Ethiopia: Findings from a cluster-randomized controlled trial , 2020, PLoS medicine.

[8]  K. Dunkle,et al.  Exploring differential impacts of interventions to reduce and prevent intimate partner violence (IPV) on sub-groups of women and men: A case study using impact evaluations from Rwanda and South Africa , 2020, SSM - population health.

[9]  A. Dobson,et al.  Consistency and Inconsistency of Young Women’s Reporting of Intimate Partner Violence in a Population-Based Study , 2020, Violence against women.

[10]  R. Jewkes,et al.  Stepping Stones and Creating Futures Intervention to Prevent Intimate Partner Violence Among Young People: Cluster Randomized Controlled Trial. , 2019, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[11]  S. Lees,et al.  A social empowerment intervention to prevent intimate partner violence against women in a microfinance scheme in Tanzania: findings from the MAISHA cluster randomised controlled trial. , 2019, The Lancet. Global health.

[12]  Vandana Sharma,et al.  Gender-transformative Bandebereho couples’ intervention to promote male engagement in reproductive and maternal health and violence prevention in Rwanda: Findings from a randomized controlled trial , 2018, PloS one.

[13]  Annah K. Bender Ethics, Methods, and Measures in Intimate Partner Violence Research: The Current State of the Field , 2017, Violence against women.

[14]  Aogán Delaney,et al.  Intimate partner violence prevention: an evidence gap map , 2017 .

[15]  K. Lacey,et al.  Severe Physical Intimate Partner Violence and the Mental and Physical Health of U.S. Caribbean Black Women. , 2016, Journal of women's health.

[16]  K. Devries,et al.  The impact of SASA!, a community mobilisation intervention, on women's experiences of intimate partner violence: secondary findings from a cluster randomised trial in Kampala, Uganda , 2016, Journal of Epidemiology & Community Health.

[17]  J. Hardesty,et al.  Toward a Standard Approach to Operationalizing Coercive Control and Classifying Violence Types. , 2015, Journal of marriage and the family.

[18]  John H. Grych,et al.  Advancing the Measurement of Violence: Challenges and Opportunities , 2014 .

[19]  E. Aguglia,et al.  Detecting Domestic Violence: Italian Validation of Revised Conflict Tactics Scale (CTS-2) , 2014, Journal of Family Violence.

[20]  K. Chan Gender differences in self-reports of intimate partner violence: A review , 2011 .

[21]  T. P. Thornberry,et al.  Impact of adolescent exposure to intimate partner violence on substance use in early adulthood. , 2010, Journal of studies on alcohol and drugs.

[22]  Juncal Plazaola-Castaño,et al.  Methodological issues in the study of violence against women , 2007, Journal of Epidemiology & Community Health.

[23]  D. Follingstad Rethinking current approaches to psychological abuse: Conceptual and methodological issues , 2007 .

[24]  S. Hamby Measuring Gender Differences in Partner Violence: Implications from Research on Other Forms of Violent and Socially Undesirable Behavior , 2005 .

[25]  L. McNutt,et al.  Issues in Estimating the Prevalence of Intimate Partner Violence , 2003, Journal of interpersonal violence.

[26]  L. McNutt,et al.  Intimate partner violence prevalence estimation using telephone surveys: understanding the effect of nonresponse bias. , 2000, American journal of epidemiology.

[27]  D. Sugarman,et al.  The Revised Conflict Tactics Scales (CTS2) , 1996 .

[28]  M. Straus The Conflict Tactics Scales and Its Critics: An Evaluation and New Data on Validity and Reliability. , 1987 .

[29]  Murray A. Straus,et al.  Measuring intrafamily conflict and violence: The Conflict Tactics (CT) Scales. , 1979 .

[30]  R. Gonçalves,et al.  Severe and Less Severe Intimate Partner Violence: From Characterization to Prediction , 2016, Violence and Victims.

[31]  Nicole E. Allen,et al.  Construct validity of the Conflict Tactics Scales: a mixed-method investigation of women's intimate partner violence , 2014 .

[32]  S. Hamby Self-report measures that do not produce gender parity in intimate partner violence: A multi-study investigation. , 2014 .