Process variables in organizational stress management intervention evaluation research: a systematic review.

OBJECTIVES This systematic review aimed to explore which process variables are used in stress management intervention (SMI) evaluation research. METHODS A systematic review was conducted using seven electronic databases. Studies were included if they reported on an SMI aimed at primary or secondary stress prevention, were directed at paid employees, and reported process data. Two independent researchers checked all records and selected the articles for inclusion. Nielsen and Randall's model for process evaluation was used to cluster the process variables. The three main clusters were context, intervention, and mental models. RESULTS In the 44 articles included, 47 process variables were found, clustered into three main categories: context (two variables), intervention (31 variables), and mental models (14 variables). Half of the articles contained no reference to process evaluation literature. The collection of process evaluation data mostly took place after the intervention and at the level of the employee. CONCLUSIONS The findings suggest that there is great heterogeneity in methods and process variables used in process evaluations of SMI. This, together with the lack of use of a standardized framework for evaluation, hinders the advancement of process evaluation theory development.

[1]  N. Swain,et al.  A communication skills intervention for community healthcare workers reduces perceived patient aggression: a pretest-postest study. , 2014, International journal of nursing studies.

[2]  Willem van Mechelen,et al.  Process Evaluation of a Worksite Social and Physical Environmental Intervention , 2013, Journal of occupational and environmental medicine.

[3]  B. Arnetz,et al.  Psychosocial stressors and well-being in health care workers. The impact of an intervention program. , 1998, Social science & medicine.

[4]  Kristy Sanderson,et al.  Process Evaluation in Occupational Stress Management Programs: A Systematic Review , 2007, American journal of health promotion : AJHP.

[5]  C. Brisson,et al.  Development and implementation of a participative intervention to improve the psychosocial work environment and mental health in an acute care hospital , 2006, Occupational and Environmental Medicine.

[6]  Per Øystein Saksvik,et al.  The Impact of Two Organizational Interventions on the Health of Service Sector Workers , 2005, International journal of health services : planning, administration, evaluation.

[7]  Nicola W Burton,et al.  Feasibility and effectiveness of psychosocial resilience training: A pilot study of the READY program , 2010, Psychology, health & medicine.

[8]  S. Reynolds,et al.  Session impact and outcome in stress management training , 1993 .

[9]  P. O. Saksvik,et al.  A process evaluation of individual and organizational occupational stress and health interventions , 2002 .

[10]  Paul A. Landsbergis,et al.  Evaluation of an occupational stress intervention in a public agency , 1995 .

[11]  S. Hornung,et al.  The effects of improving hospital physicians working conditions on patient care: a prospective, controlled intervention study , 2013, BMC Health Services Research.

[12]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement , 2009, BMJ.

[13]  Chantal Brisson,et al.  An organizational-level occupational health intervention: Employee perceptions of exposure to changes, and psychosocial outcomes , 2014 .

[14]  Susan D. Wiley,et al.  The effects of mindfulness-based stress reduction on nurse stress and burnout: a qualitative and quantitative study, part III. , 2005, Holistic nursing practice.

[15]  K. Nielsen,et al.  Organizational interventions: A research-based framework for the evaluation of both process and effects , 2013 .

[16]  S. Tvedt,et al.  The development of five scales to measure employees’ appraisals of organizational-level stress management interventions , 2009 .

[17]  Y. Yamazaki,et al.  Process evaluation of a web-based stress management program to promote psychological well-being in a sample of white-collar workers in Japan. , 2010, Industrial health.

[18]  H. Hasson,et al.  Managing Implementation: Roles of Line Managers, Senior Managers, and Human Resource Professionals in an Occupational Health Intervention , 2014, Journal of occupational and environmental medicine.

[19]  M. Petticrew,et al.  Reviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions , 2008, Journal of Epidemiology & Community Health.

[20]  N. Mellor,et al.  The “Management Standards” for stress in large organizations , 2013 .

[21]  Willem Van Mechelen,et al.  What is actually measured in process evaluations for worksite health promotion programs: a systematic review , 2013, BMC Public Health.

[22]  P. Van Bogaert,et al.  The Productive Ward Program™: A Longitudinal Multilevel Study of Nurse Perceived Practice Environment, Burnout, and Nurse-Reported Quality of Care and Job Outcomes , 2014, The Journal of nursing administration.

[23]  Maria Karanika-Murray,et al.  Process evaluation for organizational stress and well-being interventions: Implications for theory, method, and practice. , 2014 .

[24]  R. Blonk,et al.  The benefits of interventions for work-related stress. , 2001, American journal of public health.

[25]  C. Cooper,et al.  Autopsy of a failure, evaluating process and contextual issues in an organizational-level work stress intervention , 2010 .

[26]  D. Holman,et al.  A participative intervention to improve employee well-being in knowledge work jobs: A mixed-methods evaluation study , 2014 .

[27]  T. Cox,et al.  Participants' accounts of a stress management intervention , 2007 .

[28]  K. Nielsen,et al.  The importance of employee participation and perceptions of changes in procedures in a teamworking intervention , 2012, Work and stress.

[29]  V. Falck,et al.  A health promotion program for school personnel. , 1984, The Journal of school health.

[30]  M. West,et al.  Stress Management and Innovation Interventions at Work , 1996 .

[31]  Daantje Derks,et al.  Job crafting in schools for special education: A qualitative analysis [Job crafting in het speciaal onderwijs: Een kwalitatieve analyse] , 2013 .

[32]  Max Henderson,et al.  Long term sickness absence , 2005, BMJ : British Medical Journal.

[33]  S. Hornung,et al.  Reduction of Hospital Physicians' Workflow Interruptions: A Controlled Unit-Based Intervention Study , 2012 .

[34]  T. Kristensen Intervention studies in occupational epidemiology , 2005, Occupational and Environmental Medicine.

[35]  Katherine M. Richardson,et al.  Effects of occupational stress management intervention programs: a meta-analysis. , 2008, Journal of occupational health psychology.

[36]  B. Bauer,et al.  Feasibility and effectiveness of massage therapy for symptom relief in cardiac catheter laboratory staff: a pilot study. , 2012, Complementary therapies in clinical practice.

[37]  K. Nielsen,et al.  Participants' appraisals of process issues and the effects of stress management interventions , 2007 .

[38]  K. Nielsen,et al.  Opening the black box: Presenting a model for evaluating organizational-level interventions , 2013 .

[39]  Nadine Mellor,et al.  ‘Management Standards’ and work-related stress in Great Britain: Progress on their implementation , 2011 .

[40]  G. Ellison,et al.  Palliative care stress in a UK community hospital: evaluation of a stress-reduction programme. , 2004, International journal of palliative nursing.

[41]  B. Aust,et al.  When workplace interventions lead to negative effects: Learning from failures , 2010, Scandinavian journal of public health.

[42]  Laurence Alison,et al.  Critical incident stress debriefing and its effects on coping strategies and anger in a sample of Australian police officers involved in shooting incidents , 1999 .

[43]  A Holistic Approach to Supporting Staff in a Pediatric Hospital Setting , 2012 .

[44]  Christopher C. Rosen,et al.  Work Stress and Employee Health , 2013 .

[45]  J. House,et al.  Industrial relations, worksite stress reduction, and employee well-being: A participatory action research investigation. , 1993 .

[46]  G. Westlander,et al.  Means, Goals, and Outcomes of a Comprehensive Occupational Health Program for Telephone Operators , 1995, International journal of health services : planning, administration, evaluation.

[47]  K. Nielsen,et al.  Success or failure? Interpreting and understanding the impact of interventions in four similar worksites , 2006 .

[48]  A. Garde,et al.  Work-life balance among shift workers: results from an intervention study about self-rostering , 2014, International Archives of Occupational and Environmental Health.

[49]  J. Siegrist,et al.  Effects of organisational-level interventions at work on employees’ health: a systematic review , 2014, BMC Public Health.

[50]  Christine Ipsen,et al.  Organizational-level interventions in small and medium-sized enterprises: Enabling and inhibiting factors in the PoWRS program , 2015 .

[51]  T. Paulussen,et al.  Determinants of innovation within health care organizations: literature review and Delphi study. , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[52]  S. Hayes,et al.  A randomized trial of ACT bibliotherapy on the mental health of K-12 teachers and staff. , 2012, Behaviour research and therapy.

[53]  H. Biggs,et al.  Being on PAR: Outcomes of a Pilot Trial to Improve Mental Health and Wellbeing in the Workplace With the Promoting Adult Resilience (PAR) Program , 2008, Behaviour Change.

[54]  G. Bauer,et al.  Process and outcome evaluation of an organizational-level stress management intervention in Switzerland. , 2015, Health promotion international.

[55]  W. Grift,et al.  First year effects of induction arrangements on beginning teachers’ psychological processes , 2013 .

[56]  S. Reynolds,et al.  Session impact in Stress Management Training , 1993 .

[57]  B. Üstün,et al.  Turkish nurses' perspectives on a programme to reduce burnout. , 2009, International nursing review.

[58]  Andrew Steptoe,et al.  Stress and cardiovascular disease: an update on current knowledge. , 2013, Annual review of public health.