Inter-assessor Agreement for TREXMO and Its Models Outside the Translation Framework.

Within the framework of Registration, Evaluation, Authorization, and restriction of CHemicals (REACH), occupational exposure models are often used to predict the levels of exposure at a workplace. Poor inter-assessor agreement with their use poses a concern that may lead to different and dangerous risk conclusions. TREXMO (v1, 2016), a web tool providing parameter translations between six exposure models under REACH, is expected to improve the inter-assessor agreement. In this study, 18 assessors performed exposure assessment for six exposure situations within and outside the framework of this translation tool. In more than half of the evaluated cases, the results showed better agreement between assessors selecting the exposure parameters within the framework of TREXMO than when manually coding. The most affected were the parameters related to activity (such as "handling types" of Stoffenmanager) and exposure control (such as local controls). Furthermore, the agreement between the estimates calculated by different assessors was also improved when performing the translations between the models. For Stoffenmanager, for example, the relative standard deviation of 70-121%, obtained for vapors without applying the translation system, was 29-94% with the translations from ART. These findings showed a potential of TREXMO to impact the inter-assessor agreement. Because the study was limited to 18 assessors and only six exposure situations were assessed, further investigations are suggested.

[1]  Wei Lu,et al.  Validity and reliability of exposure assessors' ratings of exposure intensity by type of occupational questionnaire and type of rater. , 2011, The Annals of occupational hygiene.

[2]  On avoiding paradoxes in assessing inter rater agreement , 2010 .

[3]  Lennart Andersson,et al.  Comparison and Evaluation of Multiple Users' Usage of the Exposure and Risk Tool: Stoffenmanager 5.1. , 2015, The Annals of occupational hygiene.

[4]  John W Cherrie,et al.  Validation of Lower Tier Exposure Tools Used for REACH: Comparison of Tools Estimates With Available Exposure Measurements , 2017, Annals of work exposures and health.

[5]  H. Kromhout,et al.  Cross-validation and refinement of the Stoffenmanager as a first tier exposure assessment tool for REACH , 2009, Occupational and Environmental Medicine.

[6]  Hans Kromhout,et al.  Reliability of the Advanced REACH Tool (ART). , 2014, The Annals of occupational hygiene.

[7]  Nenad Savic,et al.  Evaluation of Exposure Assessment Tools under REACH: Part I—Tier 1 Tools , 2018, Annals of work exposures and health.

[8]  David Vernez,et al.  Stoffenmanager® Algorithm Within Version 6 Differs from the Published Algorithm Within Old Versions and TREXMO , 2017, Annals of work exposures and health.

[9]  R A Riedmann,et al.  Sensitivity Analysis, Dominant Factors, and Robustness of the ECETOC TRA v3, Stoffenmanager 4.5, and ART 1.5 Occupational Exposure Models , 2015, Risk analysis : an official publication of the Society for Risk Analysis.

[10]  J. Fleiss Measuring nominal scale agreement among many raters. , 1971 .

[11]  T. Schneider,et al.  Validation of a New Method for Structured Subjective Assessment of Past Concentrations , 1999 .

[12]  H. Kromhout,et al.  Agreement between qualitative exposure estimates and quantitative exposure measurements. , 1987, American journal of industrial medicine.

[13]  Timothy F Chen,et al.  Interrater agreement and interrater reliability: key concepts, approaches, and applications. , 2013, Research in social & administrative pharmacy : RSAP.

[14]  Monica Locatelli,et al.  Accuracy Evaluation of Three Modelling Tools for Occupational Exposure Assessment , 2017, Annals of work exposures and health.

[15]  Martie Van Tongeren,et al.  Between-User Reliability of Tier 1 Exposure Assessment Tools Used Under REACH , 2017, Annals of work exposures and health.

[16]  Håkan Tinnerberg,et al.  O24-3 A study of the validity of two exposure assessment tools; stoffenmanager and the advanced reach tool , 2016, Occupational and Environmental Medicine.

[17]  Didier Buchs,et al.  TREXMO: A Translation Tool to Support the Use of Regulatory Occupational Exposure Models. , 2016, The Annals of occupational hygiene.

[18]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[19]  G A Henri Heussen,et al.  Stoffenmanager® Exposure Model Algorithms Within TREXMO and Stoffenmanager® Lead to Different Outcomes. , 2017, Annals of work exposures and health.

[20]  Nenad Savic,et al.  Evaluation of Exposure Assessment Tools under REACH: Part II—Higher Tier Tools , 2018, Annals of work exposures and health.

[21]  Nenad Savic,et al.  ART, Stoffenmanager, and TRA: A Systematic Comparison of Exposure Estimates Using the TREXMO Translation System , 2017, Annals of work exposures and health.