On Effect Assessment in Work Environment Interventions – A Literature Overview and Methodological Reflection

Despite many positive case studies our overview of the work environment intervention (WEI) research literature finds mixed results. There is support for the profitability of WEI investments such as training and personnel policies at the organisational level but less clear results for disorder reductions. The financial benefits of WEIs were greater for performance gains than for reduced sickness costs. Multifactor interventions are widely seen as key to successful intervention but are difficult to evaluate and unused in experimental studies. Review inclusion criteria excluding studies with good interventions but non-experimental evaluations, pose a quality criteria selection bias. Difficulties in proving WEI effectiveness may depend on views of what constitutes good scientific quality. WEI effects are clear in some cases but are difficult to show in others. Evaluation poses methodological challenges that contribute to the lack of clear evidence for WEI effectiveness. There is a need for more practical multifactor WEIs and non-experimental evaluation strategies suited to today’s complex systems. RELEVANCE: Ergonomists and managers should understand that the problems in 'proving' the effectiveness of ergonomics are related to perceptions of what constitutes proof. Progress in the practise of ergonomics should recognise the difficulty of organisational change, the weaknesses of experimental traditions, and the need for multifactor interventions that reach deep into the work process to maximise impact. Isolating effects is difficult but this does not mean no effects exist.

[1]  D. Anderson,et al.  Conceptual Framework, Critical Questions, and Practical Challenges in Conducting Research on the Financial Impact of Worksite Health Promotion , 2001, American journal of health promotion : AJHP.

[2]  S. Aldana Financial Impact of Health Promotion Programs: A Comprehensive Review of the Literature , 2001, American journal of health promotion : AJHP.

[3]  B. Gerhart,et al.  The Impact of Human Resource Management on Organizational Performance: Progress and Prospects , 1996 .

[4]  K. R. Pelletier,et al.  A Review and Analysis of the Clinical and Cost-Effectiveness Studies of Comprehensive Health Promotion and Disease Management Programs at the Worksite: 1995–1998 Update (IV) , 1999, American journal of health promotion : AJHP.

[5]  J. Winkel,et al.  Incidence of shoulder and neck pain in a working population: effect modification between mechanical and psychosocial exposures at work? Results from a one year follow up of the Malmö shoulder and neck study cohort , 2005, Journal of Epidemiology and Community Health.

[6]  Andrew C Laing,et al.  Methodological issues in evaluating workplace interventions to reduce work-related musculoskeletal disorders through mechanical exposure reduction. , 2003, Scandinavian journal of work, environment & health.

[7]  D M Kramer,et al.  HEALTH PROMOTION IN THE WORKPLACE: FRAMING THE CONCEPT; REVIEWING THE EVIDENCE , 2004, Occupational and Environmental Medicine.

[8]  Grant D. Huang,et al.  Job stress management and ergonomic intervention for work-related upper extremity symptoms. , 2004, Applied ergonomics.

[9]  Bjørn Gustavsen,et al.  Concept-Driven Development and the Organization of the Process of Change: An evaluation of the Swedish Working Life Fund , 1996 .

[10]  Ruud B.M. Huirne,et al.  Exposure to physical risk factors in Dutch agriculture: Effect on sick leave due to musculoskeletal disorders , 2005 .

[11]  T. Golaszewski,et al.  Shining Lights: Studies That Have Most Influenced the Understanding of Health Promotion's Financial Impact , 2001, American journal of health promotion : AJHP.

[12]  J Winkel,et al.  Ergonomic effects of a management-based rationalization in assembly work - a case study. , 1996, Applied ergonomics.

[13]  Mark A. Huselid The Impact of Human Resource Management Practices on Turnover, Productivity, and Corporate Financial Performance , 1995 .

[14]  Kent W. Peterson,et al.  The Effect of Disease Prevention and Health Promotion on Workplace Productivity: A Literature Review , 2001, American journal of health promotion : AJHP.

[15]  P M Bongers,et al.  Are neck flexion, neck rotation, and sitting at work risk factors for neck pain? Results of a prospective cohort study , 2001, Occupational and environmental medicine.

[16]  P M Bongers,et al.  High Quantitative Job Demands and Low Coworker Support As Risk Factors for Neck Pain: Results of a Prospective Cohort Study , 2001, Spine.

[17]  Casey Ichniowski,et al.  The Effects of Human Resource Management Practices on Productivity , 1995 .

[18]  Mari Hysing,et al.  Low back pain interventions at the workplace: a systematic literature review. , 2004, Occupational medicine.

[19]  J Malchaire,et al.  Review of the factors associated with musculoskeletal problems in epidemiological studies , 2001, International archives of occupational and environmental health.

[20]  W. Neumann,et al.  Effect assessment in work environment interventions: A methodological reflection , 2010, Ergonomics.

[21]  Peter Checkland,et al.  From Optimizing to Learning: A Development of Systems Thinking for the 1990s , 1985 .

[22]  H C W de Vet,et al.  Ergonomic and physiotherapeutic interventions for treating upper extremity work related disorders in adults. , 2004, The Cochrane database of systematic reviews.

[23]  Maria P Butler Corporate ergonomics programme at Scottish & Newcastle. , 2003, Applied ergonomics.

[24]  K. Dickersin,et al.  Publication Bias: The Problem That Won't Go Away , 1993, Annals of the New York Academy of Sciences.

[25]  W. Groot Productivity effects of enterprise-related training , 1999 .

[26]  Amitabh Chandra,et al.  The Labor Market Effects of Rising Health Insurance Premiums , 2005, Journal of Labor Economics.

[27]  B. Ramazzini,et al.  De Morbis Artificum Diatriba (5) , 1962 .

[28]  D. C. Alexander,et al.  STRATEGIES FOR COST JUSTIFYING ERGONOMIC IMPROVEMENTS , 1998 .

[29]  L. Cronbach Beyond the Two Disciplines of Scientific Psychology. , 1975 .

[30]  M. Patton Qualitative research & evaluation methods , 2002 .

[31]  P. Carayon,et al.  Theory and practice for the implementation of 'in-house', continuous improvement participatory ergonomic programs. , 1998, Applied ergonomics.

[32]  R. Veliyath Hypercompetition: Managing the Dynamics of Strategic Maneuvering , 1996 .

[33]  D. Beevis Ergonomics--costs and benefits revisited. , 2003, Applied ergonomics.

[34]  Daniel B. Fishman,et al.  The Case for Pragmatic Psychology , 2020 .

[35]  Michael F Polanyi,et al.  Paddling upstream: a contextual analysis of implementation of a workplace ergonomic policy at a large newspaper. , 2005, Applied ergonomics.

[36]  S. Hignett Intervention strategies to reduce musculoskeletal injuries associated with handling patients: a systematic review , 2003, Occupational and environmental medicine.

[37]  Wayne K. Hoy,et al.  A systems approach to quality in elementary schools: A theoretical and empirical analysis , 2004 .

[38]  Daniel Imbeau,et al.  The economic evaluation of an ergonomic investment for preventive purposes: A case study , 1997 .

[39]  Hal W Hendrick,et al.  Determining the cost-benefits of ergonomics projects and factors that lead to their success. , 2003, Applied ergonomics.

[40]  Gudela Grote,et al.  An international survey of the use and effectiveness of modern manufacturing practices , 2002 .

[41]  J Malchaire,et al.  Associations between hand-wrist musculoskeletal and sensorineural complaints and biomechanical and vibration work constraints. , 2001, The Annals of occupational hygiene.

[42]  Martin E. Smith Changing an organisation’s culture: correlates of success and failure , 2003 .

[43]  Lars Skyttner General Systems Theory: Ideas and Applications , 2001 .

[44]  Supriya Lahiri,et al.  Net-cost model for workplace interventions. , 2005, Journal of safety research.

[45]  Gary W. Loveman,et al.  Putting the Service-Profit Chain to Work , 1994 .

[46]  B. Bernard,et al.  Musculoskeletal disorders and workplace factors: a critical review of epidemiologic evidence for work-related musculoskeletal disorders of the neck, upper extremity, and low back , 1997 .

[47]  P M Bongers,et al.  Psychosocial work characteristics and psychological strain in relation to low-back pain. , 2001, Scandinavian journal of work, environment & health.

[48]  W. E. Hoogendoorn,et al.  Flexion and Rotation of the Trunk and Lifting at Work Are Risk Factors for Low Back Pain: Results of a Prospective Cohort Study , 2000, Spine.

[49]  B. L. Miles,et al.  Design for Manufacture and Assembly , 1998 .

[50]  W. E. Hoogendoorn,et al.  Systematic Review of Psychosocial Factors at Work and Private Life as Risk Factors for Back Pain , 2000, Spine.

[51]  van Fm Frans Eijnatten,et al.  A complexity perspective , 2002 .

[52]  E. Volinn Do workplace interventions prevent low-back disorders? If so, why?: a methodologic commentary. , 1999, Ergonomics.

[53]  Evert Vedung,et al.  Utvärdering i politik och förvaltning , 1991 .

[54]  Rabindra Nath Sen,et al.  Cost effectiveness of ergonomic redesign of electronic motherboard. , 2003, Applied ergonomics.

[55]  P. Tugwell,et al.  Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses? , 2000, The Lancet.

[56]  Patrick Neumann,et al.  Production Ergonomics: Identifying and Managing Risk in the Design of High Performance Work Systems , 2004 .

[57]  Andrew C Laing,et al.  Study of the effectiveness of a participatory ergonomics intervention in reducing worker pain severity through physical exposure pathways , 2005, Ergonomics.

[58]  Derek Bosworth,et al.  The dynamic performance of Australian enterprises , 2002 .

[59]  Ben-Tzion Karsh,et al.  The efficacy of workplace ergonomic interventions to control musculoskeletal disorders: A critical analysis of the peer-reviewed literature , 2001 .

[60]  Bente E. Moen,et al.  Effects of a training program to improve musculoskeletal health among industrial workers—effects of supervisors role in the intervention , 2002 .

[61]  P M Bongers,et al.  Physical risk factors for neck pain. , 2000, Scandinavian journal of work, environment & health.

[62]  A. Griffiths Organizational interventions: facing the limits of the natural science paradigm. , 1999, Scandinavian journal of work, environment & health.

[63]  B. Arnetz,et al.  Early Workplace Intervention for Employees With Musculoskeletal-Related Absenteeism: A Prospective Controlled Intervention Study , 2003, Journal of occupational and environmental medicine.

[64]  Ingrid Anderzén,et al.  The Impact of a Prospective Survey-Based Workplace Intervention Program on Employee Health, Biologic Stress Markers, and Organizational Productivity , 2005, Journal of occupational and environmental medicine.

[65]  R. H. Westgaard,et al.  Ergonomic intervention research for improved musculoskeletal health: A critical review , 1997 .

[66]  V. H. Hildebrandt,et al.  Psychosocial factors at work and musculoskeletal disease. , 1993, Scandinavian journal of work, environment & health.

[67]  William S. Marras,et al.  Validation of a Low-Back Disorder Risk Model in a Prospective Study of Ergonomic Interventions into Manual Materials Handling Jobs , 2000 .

[68]  Kerstin Ekberg An epidemiologic approach to disorders in the neck and shoulders , 1994 .

[69]  Emma Irvin,et al.  Effectiveness of participatory ergonomic interventions: a systematic review , 2005 .

[70]  Patrick G. Dempsey,et al.  Effectiveness of ergonomics interventions to prevent musculoskeletal disorders: Beware of what you ask , 2007 .

[71]  L. Fine,et al.  Elements Of Ergonomics Programs: A Primer Based On Workplace Evaluations Of Musculoskeletal Disorders , 1997 .

[72]  S. Ottosson Participation action research-: A key to improved knowledge of management , 2003 .

[73]  Mark A. Huselid,et al.  The Impact of Human Resource Management Practices on Perceptions of Organizational Performance , 1996 .

[74]  A Kilbom,et al.  Risk factors for neck and shoulder disorders: a nested case-control study covering a 24-year period. , 2000, American journal of industrial medicine.

[75]  Rhian Silvestro,et al.  Dispelling the modern myth - employee satisfaction and loyalty drive service profitability , 2002 .

[76]  Colin G. Drury,et al.  Human factors and quality: Integration and new directions , 2000 .

[77]  H. Hendrick Good Ergonomics Is Good Economics , 1996 .

[78]  Maurice Oxenburgh,et al.  Increasing Productivity and Profit through Health and Safety: The Financial Returns from a Safe Working Environment , 2004 .

[79]  Stephen J. Guastello,et al.  Do we really know how well our occupational accident prevention programs work , 1993 .

[80]  P. O'Connell,et al.  Does Training Generally Work? The Returns to in-Company Training , 1999, SSRN Electronic Journal.

[81]  Brian E. Becker,et al.  HIGH PERFORMANCE WORK SYSTEMS AND FIRM PERFORMANCE : A SYNTHESIS OF RESEARCH AND MANAGERIAL IMPLICATIONS , 1998 .

[82]  Bjørn Gustavsen,et al.  Beyond Theory: Changing organizations through participation , 1996 .

[83]  M. Patton Utilization-focused evaluation: The new century text , 1997 .

[84]  Paul Jansen,et al.  Human Resource Management and Performance , 2000 .

[85]  W Patrick Neumann,et al.  Arbetsmiljöarbete och effekter : En kunskapsöversikt , 2006 .

[86]  P. Buckle,et al.  The nature of work-related neck and upper limb musculoskeletal disorders. , 2002, Applied ergonomics.

[87]  P. Hom,et al.  A Meta-Analysis of Antecedents and Correlates of Employee Turnover: Update, Moderator Tests, and Research Implications for the Next Millennium , 2000 .

[88]  Peter Vink,et al.  Cases in stress prevention: the success of a participative and stepwise approach , 1998 .

[89]  Rik Op De Beeck,et al.  Research on Work-Related Low Back Disorders , 2001 .

[90]  Lars Skyttner General Systems Theory , 1996 .

[91]  H. Bradbury,et al.  Handbook of action research , 2006 .

[92]  John Van Reenen,et al.  Who gains when workers train? Training and corporate productivity in a panel of British industries , 2000 .

[93]  Carole Torgerson,et al.  PUBLICATION BIAS: THE ACHILLES’ HEEL OF SYSTEMATIC REVIEWS? , 2006 .

[94]  Anders H. Westlund,et al.  The interactions between quality, productivity and economic performance: The case of Swedish pharmacies , 2001 .

[95]  Svend Erik Mathiassen,et al.  Time--a key issue for musculoskeletal health and manufacturing. , 2007, Applied ergonomics.

[96]  M. Patton,et al.  Evaluation: A Systematic Approach , 1980 .

[97]  S. Snook,et al.  Comparison of Different Approaches for the Prevention of Low Back Pain , 1988 .

[98]  Kristina Kemmlert,et al.  Economic impact of ergonomic intervention—Four case studies , 1996, Journal of Occupational Rehabilitation.

[99]  B. Silverstein,et al.  Interventions to reduce work-related musculoskeletal disorders. , 2004, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[100]  S. Dockrell,et al.  Ergonomic intervention: its effect on working posture and musculoskeletal symptoms in female biomedical scientists. , 2000, British journal of biomedical science.

[101]  Charles-Henri d'Arcimoles,et al.  Human Resource Policies and Company Performance: A Quantitative Approach Using Longitudinal Data , 1997 .

[102]  Martin G. Helander,et al.  Cost effectiveness of ergonomics and quality improvements in electronics manufacturing , 1995 .

[103]  Helen Ockleton Evidence-based patient handling: Tasks, equipment and interventions , 2003 .

[104]  L Abrahamsson,et al.  Production economics analysis of investment initiated to improve working environment. , 2000, Applied ergonomics.

[105]  P. Buckle,et al.  The State of Scientific Knowledge Regarding Work Related Neck and Upper Limb Musculoskeletal Disorders , 2000 .

[106]  L M Bouter,et al.  A systematic review of controlled clinical trials on the prevention of back pain in industry. , 1997, Occupational and environmental medicine.

[107]  P. Pettersson,et al.  Leadership behaviours as predictors of cost and change effectiveness , 2002 .

[108]  Kenneth L. Bernhardt,et al.  A Longitudinal Analysis of Satisfaction and Profitability , 2000 .

[109]  Ulf Johanson The profitability of investments in work life‐oriented rehabilitation , 1997 .

[110]  Neville A Stanton,et al.  On the cost-effectiveness of ergonomics. , 2003, Applied ergonomics.

[111]  R W Norman,et al.  Biomechanical and psychosocial risk factors for low back pain at work. , 2001, American journal of public health.