Academic Journal
Assessor burden, inter-rater agreement and user experience of the RoB-SPEO tool for assessing risk of bias in studies estimating prevalence of exposure to occupational risk factors: An analysis from the WHO/ILO Joint Estimates of the Work-related Burden of Disease and Injury
| العنوان: | Assessor burden, inter-rater agreement and user experience of the RoB-SPEO tool for assessing risk of bias in studies estimating prevalence of exposure to occupational risk factors: An analysis from the WHO/ILO Joint Estimates of the Work-related Burden of Disease and Injury |
|---|---|
| المؤلفون: | Momen, Natalie C., Streicher, Kai N., da Silva, Denise T. C., Descatha, Alexis, Frings-Dresen, Monique H. W., Gagliardi, Diana, Godderis, Lode, Loney, Tom, Mandrioli, Daniele, Modenese, Alberto, Morgan, Rebecca L., Pachito, Daniela, Scheepers, Paul T. J., Sgargi, Daria, Paulo, Marilia Silva, Schlunssen, Vivi, Sembajwe, Grace, Sorensen, Kathrine, Teixeira, Liliane R., Tenkate, Thomas, Pega, Frank |
| المساهمون: | WHO-TDR Suisse, Escola Nacional de Saude Publica Sergio Arouca / Sergio Arouca National School of Public Health Rio de Janeiro (ENSP), Fundação Oswaldo Cruz / Oswaldo Cruz Foundation (FIOCRUZ), Pasteur Network (Réseau International des Instituts Pasteur)-Pasteur Network (Réseau International des Instituts Pasteur), École des Hautes Études en Santé Publique EHESP (EHESP), Institut de recherche en santé, environnement et travail (Irset), Université d'Angers (UA)-Université de Rennes (UR)-École des Hautes Études en Santé Publique EHESP (EHESP)-Institut National de la Santé et de la Recherche Médicale (INSERM)-Structure Fédérative de Recherche en Biologie et Santé de Rennes (Biosit : Biologie - Santé - Innovation Technologique), Service de médecine physique et de réadaptation CHU Raymond-Poincaré, Assistance publique - Hôpitaux de Paris (AP-HP) (AP-HP)-Hôpital Raymond Poincaré AP-HP, Cohortes épidémiologiques en population (CONSTANCES), Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Institut National de la Santé et de la Recherche Médicale (INSERM)-Université Paris-Saclay-Université Paris Cité (UPCité), Vieillissement et Maladies chroniques : approches épidémiologique et de santé publique (VIMA), Université de Versailles Saint-Quentin-en-Yvelines (UVSQ)-Institut National de la Santé et de la Recherche Médicale (INSERM), Université de Rennes (UR), Amsterdam University Medical Centers (Amsterdam UMC), Istituto Nazionale per l’Assicurazione contro gli Infortuni sul Lavoro Italian Workers Compensation Authority (INAIL), Catholic University of Leuven = Katholieke Universiteit Leuven (KU Leuven), Mohammed Bin Rashid University of Medicine and Health Sciences (MBRU), Università degli Studi di Modena e Reggio Emilia = University of Modena and Reggio Emilia (UNIMORE), McMaster University Hamilton, Ontario, Fundacao Getulio Vargas Rio de Janeiro (FGV), Radboud University Medical Center Nijmegen, United Arab Emirates University (UAEU), Aarhus University Aarhus, City University of New York New York (CUNY), National Research Centre for the Working Environment (NRCWE), Ryerson University Toronto, World Health Organization from National Institute for Occupational Safety and Health of the Centres for Disease Control and Prevention of the United States of America 1E11OH0010676-02, 6NE11OH010461-02-01, 5NE11OH010461-03-00, German Federal Ministry of Health (BMG Germany) under the BMG-WHO Collaboration Programme 2020-2023 (WHO specified award) 70672, Spanish Agency for International Cooperation (AECID) 71208 |
| المصدر: | ISSN: 0160-4120 ; Environment International ; https://hal.science/hal-03511988 ; Environment International, 2022, 158, ⟨10.1016/j.envint.2021.107005⟩. |
| بيانات النشر: | CCSD Elsevier |
| سنة النشر: | 2022 |
| المجموعة: | Inserm: HAL (Institut national de la santé et de la recherche médicale) |
| مصطلحات موضوعية: | Bias, Systematic review methods, Prevalence, Occupational exposure, Occupational epidemiology, [SDV]Life Sciences [q-bio] |
| الوصف: | International audience ; Background: As part of the development of the World Health Organization (WHO)/International Labour Organization (ILO) Joint Estimates of the Work-related Burden of Disease and Injury, WHO and ILO carried out several systematic reviews to determine the prevalence of exposure to selected occupational risk factors. Risk of bias assessment for individual studies is a critical step of a systematic review. No tool existed for assessing the risk of bias in prevalence studies of exposure to occupational risk factors, so WHO and ILO developed and pilot tested the RoB-SPEO tool for this purpose. Here, we investigate the assessor burden, inter-rater agreement, and user experience of this new instrument, based on the abovementioned WHO/ILO systematic reviews. Methods: Twenty-seven individual experts applied RoB-SPEO to assess risk of bias. Four systematic reviews provided a total of 283 individual assessments, carried out for 137 studies. For each study, two or more assessors independently assessed risk of bias across the eight RoB-SPEO domains selecting one of RoB-SPEO's six ratings (i.e., "low", "probably low", "probably high", "high", "unclear" or "cannot be determined"). Assessors were asked to report time taken (i.e. indicator of assessor burden) to complete each assessment and describe their user experience. To gauge assessor burden, we calculated the median and inter-quartile range of times taken per individual risk of bias assessment. To assess inter-rater reliability, we calculated a raw measure of inter-rater agreement (P-i) for each RoB-SPEO domain, between P-i = 0.00, indicating no agreement and P-i = 1.00, indicating perfect agreement. As subgroup analyses, P-i was also disaggregated by systematic review, assessor experience with RoB-SPEO (<= 10 assessments versus > 10 assessments), and assessment time (tertiles: <= 25 min versus 26-66 min versus >= 67 min). To describe user experience, we synthesised the assessors' comments and recommendations. Results: Assessors reported a ... |
| نوع الوثيقة: | article in journal/newspaper |
| اللغة: | English |
| Relation: | info:eu-repo/semantics/altIdentifier/pmid/34991265; PUBMED: 34991265 |
| DOI: | 10.1016/j.envint.2021.107005 |
| الاتاحة: | https://hal.science/hal-03511988 https://hal.science/hal-03511988v1/document https://hal.science/hal-03511988v1/file/1-s2.0-S0160412021006309-main.pdf https://doi.org/10.1016/j.envint.2021.107005 |
| Rights: | http://creativecommons.org/licenses/by-nc-nd/ ; info:eu-repo/semantics/OpenAccess |
| رقم الانضمام: | edsbas.F7B7A1F0 |
| قاعدة البيانات: | BASE |
| DOI: | 10.1016/j.envint.2021.107005 |
|---|