The inter-rater reliability of Strain Index and OCRA Checklist task assessments in cheese processing.

The purpose of this study was to characterize the inter-rater reliability of two physical exposure assessment methods of the upper extremity, the Strain Index (SI) and Occupational Repetitive Actions (OCRA) Checklist. These methods are commonly used in occupational health studies and by occupational health practitioners. Seven raters used the SI and OCRA Checklist to assess task-level physical exposures to the upper extremity of workers performing 21 cheese manufacturing tasks. Inter-rater reliability was characterized using a single-measure, agreement-based intraclass correlation coefficient (ICC). Inter-rater reliability of SI assessments was moderate to good (ICC = 0.59, 95% CI: 0.45-0.73), a similar finding to prior studies. Inter-rater reliability of OCRA Checklist assessments was excellent (ICC = 0.80, 95% CI: 0.70-0.89). Task complexity had a small, but non-significant, effect on inter-rater reliability SI and OCRA Checklist scores. Both the SI and OCRA Checklist assessments possess adequate inter-rater reliability for the purposes of occupational health research and practice. The OCRA Checklist inter-rater reliability scores were among the highest reported in the literature for semi-quantitative physical exposure assessment tools of the upper extremity. The OCRA Checklist however, required more training time and time to conduct the risk assessments compared to the SI.

[1]  A Burdorf,et al.  Accuracy of measurements for the revised NIOSH lifting equation. Applied Ergonomics 29(6) 433-438. , 1999, Applied ergonomics.

[2]  J. Kaufman,et al.  Comparison of self-report, video observation and direct measurement methods for upper extremity musculoskeletal disorder physical risk factors , 2001, Ergonomics.

[3]  E. Waclawski.  Health Measurement Scales—A Practical Guide to Their Development and Use , 2010 .

[4]  Daniela Colombini,et al.  Appunti di Metodo: Aggiornamento di procedure e di criteri di applicazione della Checklist OCRA / Updating of application procedures and criteria for OCRA Checklist , 2010 .

[5]  A. Garg,et al.  The Strain Index (SI) and Threshold Limit Value (TLV) for Hand Activity Level (HAL): risk of carpal tunnelsyndrome (CTS) in a prospective cohort , 2012, Ergonomics.

[6]  P Spielholz,et al.  Quantifying repetitive hand activity for epidemiological research on musculoskeletal disorders – Part II: comparison of different methods of measuring force level and repetitiveness , 2006, Ergonomics.

[7]  Xu Xu,et al.  The Validity and Interrater Reliability of Video-Based Posture Observation During Asymmetric Lifting Tasks , 2011, Hum. Factors.

[8]  Thomas J. Armstrong,et al.  Inter-Rater Reliability for Hand Activity Level (HAL) and Force Metrics , 2002 .

[9]  J. Moore,et al.  Test-retest repeatability of the Strain Index. , 2006, Applied ergonomics.

[10]  Peregrin Spielholz,et al.  Reliability and Validity Assessment of the Hand Activity Level Threshold Limit Value and Strain Index Using Expert Ratings of Mono-Task Jobs , 2008, Journal of occupational and environmental hygiene.

[11]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[12]  P. Buckle,et al.  Current techniques for assessing physical exposure to work-related musculoskeletal risks, with emphasis on posture-based methods. , 1999, Ergonomics.

[13]  Arun Garg,et al.  Job Analysis Techniques for Distal Upper Extremity Disorders , 2011 .

[14]  E Occhipinti,et al.  Updating reference values and predictive models of the OCRA method in the risk assessment of work-related musculoskeletal disorders of the upper limbs , 2007, Ergonomics.

[15]  G. Borg.  Psychophysical bases of perceived exertion. , 1982, Medicine and science in sports and exercise.

[16]  Daniel Imbeau,et al.  Comparing the results of eight methods used to evaluate risk factors associated with musculoskeletal disorders , 2012 .

[17]  Barbara Silverstein,et al.  Application of the Strain Index in multiple task jobs. , 2009, Applied ergonomics.

[18]  Thomas J Armstrong,et al.  Validation of the ACGIH TLV for hand activity level in the OCTOPUS cohort: a two-year longitudinal study of carpal tunnel syndrome. , 2013, Scandinavian journal of work, environment & health.

[19]  Barbara Silverstein,et al.  Interrater Reliability of Posture Observations , 2009, Hum. Factors.

[20]  Shrawan Kumar,et al.  Comparison of Ergonomic Risk Assessment Output in Four Sawmill Jobs , 2010, International journal of occupational safety and ergonomics : JOSE.

[21]  Svend Erik Mathiassen,et al.  Systematic evaluation of observational methods assessing biomechanical exposures at work. , 2010, Scandinavian journal of work, environment & health.

[22]  Sara Dockrell,et al.  An investigation of the reliability of Rapid Upper Limb Assessment (RULA) as a method of assessment of children's computing posture. , 2012, Applied ergonomics.

[23]  Enrico Occhipinti,et al.  Risk assessment and management of repetitive movements and exertions of upper limbs : job analysis, Ocra risk indices, prevention strategies, and design principles , 2002 .

[24]  Ann Marie Dale,et al.  Pooling job physical exposure data from multiple independent studies in a consortium study of carpal tunnel syndrome , 2013, Ergonomics.

[25]  A. Garg,et al.  The Strain Index: a proposed method to analyze jobs for risk of distal upper extremity disorders. , 1995, American Industrial Hygiene Association journal.

[26]  P Apostoli,et al.  [Comparative analysis of the use of 4 methods in the evaluation of the biomechanical risk to the upper limb]. , 2004, Giornale italiano di medicina del lavoro ed ergonomia.

[27]  G. David.  Ergonomic methods for assessing exposure to risk factors for work-related musculoskeletal disorders. , 2005, Occupational medicine.

[28]  Å. Kilbom,et al.  Assessment of physical exposure in relation to , 1994 .

[29]  John-Paul Stephens,et al.  Inter-Rater Reliability of the Strain Index , 2004, Journal of occupational and environmental hygiene.