Effect assessment in work environment interventions: A methodological reflection

This paper addresses a number of issues for work environment intervention (WEI) researchers in light of the mixed results reported in the literature. If researchers emphasise study quality over intervention quality, reviews that exclude case studies with high quality and multifactorial interventions may be vulnerable to ‘quality criteria selection bias’. Learning from ‘failed’ interventions is inhibited by both publication bias and reporting lengths that limit information on relevant contextual and implementation factors. The authors argue for the need to develop evaluation approaches consistent with the complexity of multifactorial WEIs that: a) are owned by and aimed at the whole organisation; and b) include intervention in early design stages where potential impact is highest. Context variety, complexity and instability in and around organisations suggest that attention might usefully shift from generalisable ‘proof of effectiveness’ to a more nuanced identification of intervention elements and the situations in which they are more likely to work as intended. Statement of Relevance: This paper considers ergonomics interventions from perspectives of what constitutes quality and ‘proof”. It points to limitations of traditional experimental intervention designs and argues that the complexity of organisational change, and the need for multifactorial interventions that reach deep into work processes for greater impact, should be recognised.