School of Criminology, Simon Fraser University, Burnaby, BC, Canada.
Trauma Violence Abuse. 2023 Jul;24(3):1522-1542. doi: 10.1177/15248380211073839. Epub 2022 Mar 3.
While assessments of transparent reporting practices in meta-analyses are not uncommon in the field of health sciences interventions, they are limited in the social sciences and to our knowledge are non-existent in criminology. Modified PRISMA 2020 checklists were used to assess transparency and reproducibility of reporting for a sample of 33 meta-analyses of intervention/prevention evaluations published in scholarly journals between 2016 and 2021. Results indicate that the average rate of transparent reporting practices was 63%; adherence varied considerably across studies and subscales, with low rates of adherence for some core checklist items. Overwhelmingly, studies were not reproducible in their entirety; article word count was significantly correlated with reproducibility ( = 0.4028, < .03). These findings suggest that substantial changes to reporting practices are necessary to meet traditional meta-analytic claims of transparency and reproducibility. Study limitations include sample size, coding instruments, and coding subjectivity.
虽然健康科学干预领域的元分析透明报告实践评估并不罕见,但在社会科学领域却很少见,据我们所知,犯罪学领域尚未涉及。使用经过修改的 PRISMA 2020 清单评估了 2016 年至 2021 年间在学术期刊上发表的 33 项干预/预防评估元分析的报告透明度和可重复性。结果表明,透明报告实践的平均率为 63%;在研究和子量表之间,一致性差异很大,一些核心清单项目的一致性率较低。绝大多数情况下,研究在整体上不可重复;文章字数与可重复性显著相关( = 0.4028, <.03)。这些发现表明,需要对报告实践进行重大更改,以满足传统元分析对透明度和可重复性的要求。研究限制包括样本量、编码工具和编码主观性。