Systematic evaluation of observational methods assessing biomechanical exposures at work.

OBJECTIVES This systematic review aimed to identify published observational methods assessing biomechanical exposures in occupational settings and evaluate them with reference to the needs of different users. METHODS We searched scientific databases and the internet for material from 1965 to September 2008. Methods were included if they were primarily based on the systematic observation of work, the observation target was the human body, and the method was clearly described in the literature. A systematic evaluation procedure was developed to assess concurrent and predictive validity, repeatability, and aspects related to utility. At least two evaluators independently carried out this evaluation. RESULTS We identified 30 eligible observational methods. Of these, 19 had been compared with some other method(s), varying from expert evaluation to data obtained from video recordings or through the use of technical instruments. Generally, the observations showed moderate to good agreement with the corresponding assessments made from video recordings; agreement was the best for large-scale body postures and work actions. Postures of wrist and hand as well as trunk rotation seemed to be more difficult to observe correctly. Intra- and inter-observer repeatability were reported for 7 and 17 methods, respectively, and were judged mostly to be good or moderate. CONCLUSIONS With training, observers can reach consistent results on clearly visible body postures and work activities. Many observational tools exist, but none evaluated in this study appeared to be generally superior. When selecting a method, users should define their needs and assess how results will influence decision-making.

[1]  P. Neumann,et al.  Assessment of physical work load in epidemiologic studies: common measurement metrics for exposure assessment. , 1997, Ergonomics.

[2]  Thomas R. Waters,et al.  Applications manual for the revised NIOSH lifting equation , 1994 .

[3]  J. Moore,et al.  Predictive validity of the strain index in manufacturing facilities. , 2002, Applied occupational and environmental hygiene.

[4]  W. M. Keyserling,et al.  Observational Analysis of the Hand and Wrist: A Pilot Study , 1991 .

[5]  P Spielholz,et al.  Quantifying repetitive hand activity for epidemiological research on musculoskeletal disorders – Part II: comparison of different methods of measuring force level and repetitiveness , 2006, Ergonomics.

[6]  Leslie Fountain,et al.  Examining RULA’s Postural Scoring System With Selected Physiological and Psychophysiological Measures , 2003, International journal of occupational safety and ergonomics : JOSE.

[7]  Donald Bloswick,et al.  Comparison of ergonomic risk assessment outputs from Rapid Upper Limb Assessment and the Strain Index for tasks in automotive assembly plants. , 2003, Work.

[8]  Monique Lortie,et al.  Impact of observers' experience and training on reliability of observations for a manual handling task , 2002, Ergonomics.

[9]  R Ketola,et al.  Interobserver repeatability and validity of an observation method to assess physical loads imposed on the upper extremities , 2001, Ergonomics.

[10]  P Holzmann ARBAN-A new method for analysis of ergonomic effort. , 1982, Applied ergonomics.

[11]  Alex Burdorf,et al.  An evaluation of methods assessing the physical demands of manual lifting in scaffolding. , 2005, Applied ergonomics.

[12]  Kristina Kemmlert PLIBEL—The Method Assigned for Identification of Ergonomic Hazards , 2004 .

[13]  W M Keyserling Analysis of manual lifting tasks: a qualitative alternative to the NIOSH work practices guide. , 1989, American Industrial Hygiene Association journal.

[14]  David Rempel,et al.  Measuring the physical demands of work in hospital settings: design and implementation of an ergonomics assessment. , 2006, Applied ergonomics.

[15]  Thomas J Armstrong,et al.  Carpal Tunnel Syndrome and Manual Work: A Longitudinal Study , 2007, Journal of occupational and environmental medicine.

[16]  S E Mathiassen,et al.  Assessment of physical work load in epidemiologic studies: concepts, issues and operational considerations. , 1994, Ergonomics.

[17]  P Kivi,et al.  Analysis and improvement of work postures in the building industry: application of the computerised OWAS method. , 1991, Applied ergonomics.

[18]  W M Keyserling Postural analysis of the trunk and shoulders in simulated real time. , 1986, Ergonomics.

[19]  Peter W Johnson,et al.  Comparing the results of five lifting analysis tools. , 2007, Applied ergonomics.

[20]  Svend Erik Mathiassen,et al.  Efficient one-day sampling of mechanical job exposure data--a study based on upper trapezius activity in cleaners and office workers. , 2003, AIHA journal : a journal for the science of occupational and environmental health and safety.

[21]  A J van der Beek,et al.  Working postures and activities of lorry drivers: a reliability study of on-site observation and recording on a pocket computer. , 1992, Applied ergonomics.

[22]  Nils Fallentin,et al.  Criteria for classification of posture in repetitive work by observation methods: A review , 1997 .

[23]  Svend Erik Mathiassen,et al.  Diversity and variation in biomechanical exposure: what is it, and why would we like to know? , 2006, Applied ergonomics.

[24]  Jack T Dennerlein,et al.  Validity of self-reported mechanical demands for occupational epidemiologic research of musculoskeletal disorders. , 2009, Scandinavian journal of work, environment & health.

[25]  W Karwowski,et al.  LUBA: an assessment technique for postural loading on the upper body based on joint motion discomfort and maximum holding time. , 2001, Applied ergonomics.

[26]  S S Ulin,et al.  Development and evaluation of an observational method for assessing repetition in hand tasks. , 1997, American Industrial Hygiene Association journal.

[27]  Alex Burdorf,et al.  Design of strategies to assess lumbar posture during work , 1996 .

[28]  E. Occhipinti OCRA: a concise index for the assessment of exposure to repetitive movements of the upper limbs. , 1998, Ergonomics.

[29]  S E Mathiassen,et al.  Precision of measurements of physical workload during standardised manual handling. Part II: Inclinometry of head, upper back, neck and upper arms. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[30]  Svend Erik Mathiassen,et al.  Variability in mechanical exposure within and between individuals performing a highly constrained industrial work task , 2003, Ergonomics.

[31]  A Kilbom,et al.  HARBO, a simple computer-aided observation method for recording work postures. , 1995, Scandinavian journal of work, environment & health.

[32]  I. Olkin,et al.  Meta-analysis of observational studies in epidemiology - A proposal for reporting , 2000 .

[33]  Roland Kadefors,et al.  Ergonomic evaluation of complex work: a participative approach employing video–computer interaction, exemplified in a study of order picking , 2000 .

[34]  Thomas J. Armstrong,et al.  Analysis of an Observational Rating Scale for Repetition, Posture, and Force in Selected Manufacturing Settings , 2006, Hum. Factors.

[35]  A Burdorf,et al.  Measurement of trunk bending during work by direct observation and continuous measurement. , 1992, Applied ergonomics.

[36]  K Teschke,et al.  Development and evaluation of an observational Back-Exposure Sampling Tool (Back-EST) for work-related back injury risk factors. , 2009, Applied ergonomics.

[37]  W S Marras,et al.  The effectiveness of commonly used lifting assessment methods to identify industrial jobs associated with elevated risk of low-back disorders. , 1999, Ergonomics.

[38]  Gavriel Salvendy,et al.  Handbook of Human Factors and Ergonomics , 2005 .

[39]  S. Pocock,et al.  Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration , 2007, Annals of Internal Medicine [serial online].

[40]  P Paul F M Kuijer,et al.  The evaluation of smaller plasterboards on productivity, work demands and workload in construction workers. , 2007, Applied ergonomics.

[41]  T. Waters,et al.  Evaluation of the revised NIOSH lifting equation. A cross-sectional epidemiologic study. , 1999, Spine.

[42]  N. Fallentin,et al.  Evaluation of Physical Workload Standards/Guidelines from a Nordic Perspective , 2000, Scandinavian journal of work, environment & health.

[43]  L Punnett,et al.  Validity of fixed-interval observations for postural assessment in construction work. , 2001, Applied ergonomics.

[44]  H M Toussaint,et al.  The validity of visual observation to assess posture in a laboratory-simulated, manual material handling task. , 1994, Ergonomics.

[45]  Dohyung Kee,et al.  Quantitative postural load assessment for whole body manual tasks based on perceived discomfort , 2005, Ergonomics.

[46]  Karel Brookhuis,et al.  Handbook of Human Factors and Ergonomics Methods , 2009 .

[47]  T. Armstrong,et al.  A Cross-Sectional Assessment of the ACGIH TLV for Hand Activity Level , 2005, Journal of Occupational Rehabilitation.

[48]  W Karwowski,et al.  Analysis of working postures in hammering tasks on building construction sites using the computerized OWAS method. , 1993, Applied ergonomics.

[49]  K. Kemmlert,et al.  A method assigned for the identification of ergonomic hazards - PLIBEL. , 1995, Applied ergonomics.

[50]  G. David Ergonomic methods for assessing exposure to risk factors for work-related musculoskeletal disorders. , 2005, Occupational medicine.

[51]  A. Garg,et al.  The Strain Index: a proposed method to analyze jobs for risk of distal upper extremity disorders. , 1995, American Industrial Hygiene Association journal.

[52]  A Garg,et al.  Revised NIOSH equation for the design and evaluation of manual lifting tasks. , 1993, Ergonomics.

[53]  W M Keyserling,et al.  A checklist for evaluating ergonomic risk factors associated with upper extremity cumulative trauma disorders. , 1993, Ergonomics.

[54]  G B Andersson,et al.  Comparison of five methods used to determine low back disorder risk in a manufacturing environment. , 1999, Spine.

[55]  J. Moore,et al.  The Strain Index , 2004 .

[56]  P G Dempsey,et al.  Influence of measurement accuracy on the application of the 1991 NIOSH equation. , 2001, Applied ergonomics.

[57]  W. Rohmert,et al.  The AET Method of Job Evaluation , 1999 .

[58]  Waldemar Karwowski,et al.  The occupational ergonomics handbook , 2006 .

[59]  T R Waters,et al.  Accuracy of measurements for the revised NIOSH lifting equation. National Institute for Occupational Safety and Health. , 1998, Applied ergonomics.

[60]  J Winkel,et al.  Direct measurements and systematic observations of physical workload among medical secretaries, furniture removers and male and female reference populations. , 1994, Applied ergonomics.

[61]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials , 2001, The Lancet.

[62]  Thomas R. Waters Revised NIOSH lifting equation , 2007 .

[63]  G Govaert,et al.  Postural load and back pain of workers in the manufacturing of prefabricated concrete elements. , 1991, Ergonomics.

[64]  Thomas J Armstrong,et al.  Incidence of Carpal Tunnel Syndrome Among Automobile Assembly Workers and Assessment of Risk Factors , 2005, Journal of occupational and environmental medicine.

[65]  P. Buckle,et al.  Current techniques for assessing physical exposure to work-related musculoskeletal risks, with emphasis on posture-based methods. , 1999, Ergonomics.

[66]  E. N. Corlett,et al.  Posture Targeting: A Technique for Recording Working Postures , 1979 .

[67]  Robert W. Norman,et al.  A posture and load sampling approach to determining low-back pain risk in occupational settings , 2001 .

[68]  Megan Strickfaden,et al.  Physical demands analysis of occupational tasks in neighborhood pubs. , 2005, Applied ergonomics.

[69]  E Occhipinti,et al.  New procedure for assessing sequential manual lifting jobs using the revised NIOSH lifting equation , 2007, Ergonomics.

[70]  T. Armstrong,et al.  Predictors of Persistent Elbow Tendonitis Among Auto Assembly Workers , 2005, Journal of Occupational Rehabilitation.

[71]  Svend Erik Mathiassen,et al.  Time--a key issue for musculoskeletal health and manufacturing. , 2007, Applied ergonomics.

[72]  Kurt Landau,et al.  Entwicklung und Anwendung eines Arbeitswissenschaftlichen Erhebungsverfahrens zur Tätigkeitsanalyse zum Anforderungsbereich Handlung (H-AET) , 1979 .

[73]  P M Bongers,et al.  Sources of variance in exposure to nonneutral trunk postures in varying work situations. , 1995, Scandinavian journal of work, environment & health.

[74]  Svend Erik Mathiassen,et al.  Arbete och Hälsa , 2005 .

[75]  Thomas J. Armstrong,et al.  A Longitudinal Study of Industrial and Clerical Workers: Incidence of Carpal Tunnel Syndrome and Assessment of Risk Factors , 2005, Journal of Occupational Rehabilitation.

[76]  J. T. Dennerlein,et al.  Ergonomics and human factors in endoscopic surgery: a comparison of manual vs telerobotic simulation systems , 2005, Surgical Endoscopy And Other Interventional Techniques.

[77]  T. Armstrong,et al.  Cross-sectional study of the relationship between repetitive work and the prevalence of upper limb musculoskeletal disorders. , 1999, American journal of industrial medicine.

[78]  I. Olkin,et al.  Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement , 1999, The Lancet.

[79]  Enrico Occhipinti,et al.  The Occupational Repetitive Action (OCRA) Methods: OCRA Index and OCRA Checklist , 2004 .

[80]  A Burdorf,et al.  Sources of variance in exposure to postural load on the back in occupational groups. , 1992, Scandinavian journal of work, environment & health.

[81]  Tzu-Hsien Lee Psychophysically determined asymmetrical lifting capabilities for different frequencies and containers. , 2005, Industrial health.

[82]  Donald S Bloswick,et al.  Job Level Risk Assessment Using Task Level Strain Index Scores: A Pilot Study , 2005, International journal of occupational safety and ergonomics : JOSE.

[83]  Peregrin Spielholz,et al.  Reliability and Validity Assessment of the Hand Activity Level Threshold Limit Value and Strain Index Using Expert Ratings of Mono-Task Jobs , 2008, Journal of occupational and environmental hygiene.

[84]  Waldemar Karwowski,et al.  A Comparison of Three Observational Techniques for Assessing Postural Loads in Industry , 2007, International journal of occupational safety and ergonomics : JOSE.

[85]  J. Moore,et al.  Validity of generic risk factors and the strain index for predicting nontraumatic distal upper extremity morbidity. , 2001, AIHAJ : a journal for the science of occupational and environmental health and safety.

[86]  Peter Buckle,et al.  The development of the Quick Exposure Check (QEC) for assessing exposure to risk factors for work-related musculoskeletal disorders. , 2008, Applied ergonomics.

[87]  Susan Elise Eppes,et al.  Washington State Ergonomics Tool: predictive validity in the waste industry , 2004 .

[88]  L Punnett,et al.  Evaluation of interrater reliability for posture observations in a field study. , 1999, Applied ergonomics.

[89]  Sue Hignett,et al.  Rapid Entire Body Assessment , 2004 .

[90]  S. V. N. Santhosh Kumar,et al.  Comparison of ergonomic risk assessments in a repetitive high-risk sawmill occupation: Saw-filer , 2007 .

[91]  Tohr Nilsson,et al.  Whole-body vibration exposure and non-neutral neck postures during occupational use of all-terrain vehicles. , 2005, The Annals of occupational hygiene.

[92]  S Hignett,et al.  Rapid entire body assessment (REBA). , 2000, Applied ergonomics.

[93]  Richard Wells,et al.  Mechanical exposure concepts using force as the agent. , 2004, Scandinavian journal of work, environment & health.

[94]  Victor Paquet,et al.  Reliable exposure assessment strategies for physical ergonomics stressors in construction and other non-routinized work , 2005, Ergonomics.

[95]  J. Moore,et al.  Test-retest repeatability of the Strain Index. , 2006, Applied ergonomics.

[96]  L Punnett,et al.  PATH: a work sampling-based approach to ergonomic job analysis for construction and other non-repetitive work. , 1996, Applied ergonomics.

[97]  T. Armstrong,et al.  Risk factors for visiting a medical department because of upper-extremity musculoskeletal disorders. , 2005, Scandinavian journal of work, environment & health.

[98]  Peter Buckle,et al.  Classroom posture and self-reported back and neck pain in schoolchildren. , 2004, Applied ergonomics.

[99]  Brian D Lowe,et al.  Accuracy and validity of observational estimates of wrist and forearm posture , 2004, Ergonomics.

[100]  Thomas J. Armstrong,et al.  A Longitudinal Study of Industrial and Clerical Workers: Predictors of Upper Extremity Tendonitis , 2005, Journal of Occupational Rehabilitation.

[101]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. , 2001, Journal of the American Podiatric Medical Association.

[102]  Berman Kayis,et al.  A Multilevel Approach to Manual Lifting in Manufacturing Industries. , 1996, International journal of occupational safety and ergonomics : JOSE.

[103]  A Burdorf,et al.  Group-based measurement strategies in exposure assessment explored by bootstrapping. , 2001, Scandinavian journal of work, environment & health.

[104]  S. Dockrell,et al.  An investigation of children's posture and discomfort during computer use , 2007, Ergonomics.

[105]  E P Takala,et al.  Validation of Portable Ergonomic Observation (PEO) method using optoelectronic and video recordings. , 1997, Applied ergonomics.

[106]  W Rohmert AET--a new job-analysis method. , 1985, Ergonomics.

[107]  Alison Coyle,et al.  Comparison of the Rapid Entire Body Assessment and the New Zealand Manual Handling 'Hazard Control Record', for assessment of manual handling hazards in the supermarket industry. , 2005, Work.

[108]  Donald S Bloswick,et al.  Evaluation and Quantification of Manual Materials Handling Risk Factors , 2003, International journal of occupational safety and ergonomics : JOSE.

[109]  Waldemar Karwowski,et al.  Fundamentals and Assessment Tools for Occupational Ergonomics , 2006 .

[110]  Thomas J. Armstrong,et al.  Predictors of Upper Extremity Discomfort: A Longitudinal Study of Industrial and Clerical Workers , 2005, Journal of Occupational Rehabilitation.

[111]  J P Bonde,et al.  Task based exposure assessment in ergonomic epidemiology: a study of upper arm elevation in the jobs of machinists, car mechanics, and house painters , 2004, Occupational and Environmental Medicine.

[112]  Cheng-Lung Lee,et al.  The Relationship between Low Back Discomfort Ratings and the NIOSH Lifting Index , 1998, Hum. Factors.

[113]  Monique Lortie,et al.  Observation Procedures Characterizing Occupational Physical Activities: Critical Review , 2000, International journal of occupational safety and ergonomics : JOSE.

[114]  W. Marras,et al.  The ACGIH TLV for Low Back Risk , 2006 .

[115]  T. Armstrong,et al.  A conceptual model for work-related neck and upper-limb musculoskeletal disorders. , 1993, Scandinavian journal of work, environment & health.

[116]  William E Daniell,et al.  Comparison of Ergonomist, Supervisor, and Worker Assessments of Work-Related Musculoskeletal Risk Factors , 2004, Journal of occupational and environmental hygiene.

[117]  D Colombini,et al.  An observational method for classifying exposure to repetitive movements of the upper limbs. , 1998, Ergonomics.

[118]  J. Moore,et al.  Predictive Validity of the Strain Index in Turkey Processing , 2001, Journal of occupational and environmental medicine.

[119]  Monique H. W. Frings-Dresen,et al.  The TRAC-system: An observation method for analysing work demands at the workplace , 1995 .

[120]  C G Drury,et al.  Postural discomfort and perceived exertion in standardized box-holding postures , 2001, Ergonomics.

[121]  E Occhipinti,et al.  Updating reference values and predictive models of the OCRA method in the risk assessment of work-related musculoskeletal disorders of the upper limbs , 2007, Ergonomics.

[122]  D. Streiner,et al.  Health Measurement Scales: A practical guide to thier development and use , 1989 .

[123]  R W Marklin,et al.  Four assessment tools of ergonomics interventions: case study at an electric utility's warehouse system. , 1999, American Industrial Hygiene Association journal.

[124]  J Winkel,et al.  Guidelines for occupational musculoskeletal load as a basis for intervention: a critical review. , 1996, Applied ergonomics.

[125]  C Fransson-Hall,et al.  A portable ergonomic observation method (PEO) for computerized on-line recording of postures and manual handling. , 1995, Applied ergonomics.

[126]  Patrick G Dempsey,et al.  A survey of tools and methods used by certified professional ergonomists. , 2005, Applied ergonomics.

[127]  O Karhu,et al.  Correcting working postures in industry: A practical method for analysis. , 1977, Applied ergonomics.

[128]  Å. Kilbom,et al.  Assessment of physical exposure in relation to work-related musculoskeletal disorders--what information can be obtained from systematic observations? , 1994, Scandinavian journal of work, environment & health.

[129]  L McAtamney,et al.  RULA: a survey method for the investigation of work-related upper limb disorders. , 1993, Applied ergonomics.

[130]  W Karwowski,et al.  Postural stress analysis in industry. , 1994, Applied ergonomics.

[131]  Inseok Lee,et al.  A postural workload evaluation system based on a macro‐postural classification , 2002 .

[132]  Thomas J. Armstrong,et al.  The ACGIH TLV w for Hand Activity Level , 2006 .

[133]  A J van der Beek,et al.  Assessment of mechanical exposure in ergonomic epidemiology. , 1998, Occupational and environmental medicine.

[134]  John-Paul Stephens,et al.  Inter-Rater Reliability of the Strain Index , 2004, Journal of occupational and environmental hygiene.

[135]  Jack P. Callaghan,et al.  Errors associated with bin boundaries in observation-based posture assessment methods , 2008 .

[136]  I de Bruijn,et al.  A simple method to evaluate the reliability of OWAS observations. , 1998, Applied ergonomics.

[137]  Miquel Porta,et al.  A Dictionary of Epidemiology , 2008 .