Department of Medical Informatics and Biostatistics, Faculty of Medicine, "Iuliu Hațieganu" University of Medicine and Pharmacy, 400349 Cluj-Napoca, Romania.
Department of Anatomy and Embryology, Faculty of Medicine, "Iuliu Hațieganu" University of Medicine and Pharmacy, 400006 Cluj-Napoca, Romania.
Medicina (Kaunas). 2019 Jul 15;55(7):372. doi: 10.3390/medicina55070372.
Informed decision-making requires the ability to identify and integrate high-quality scientific evidence in daily practice. We aimed to assess whether randomized controlled trials (RCTs) on endometriosis therapy follow methodological criteria corresponding to the RCTs' specific level in the hierarchy of evidence in such details to allow the reproduction and replication of the study. Using the keywords "therapy" and "endometriosis" and "efficacy" three bibliographic databases were searched for English written scientific articles published from 1 January 2008 to 3 March 2018. Only the randomized clinical trials (RCTs) were evaluated in terms of whether they provided the appropriate level of scientific evidence, equivalent to level 1, degree 1b in the hierarchy of evidence. A list of criteria to ensure study replication and reproduction, considering CONSORT guideline and MECIR standards, was developed and used to evaluate RCTs' methodological soundness, and scores were granted. Three types of bias, namely selection bias (random sequence generation and allocation concealment), detection bias (blinding of outcome assessment), and attrition bias (incomplete outcome data) were also evaluated. We found 387 articles on endometriosis therapy, of which 38 were RCTs: 30 double-blinded RCTs and 8 open-label RCTs. No article achieved the maximum score according to the evaluated methodological criteria. Even though 73.3% of the double-blinded RCTs had clear title, abstract, introduction, and objectives, only 13.3% provided precise information regarding experimental design and randomization, and also showed a low risk of bias. The blinding method was poorly reported in 43.3% of the double-blinded RCTs, while allocation concealment and random sequence generation were inadequate in 33.3% of them. None of the evaluated RCTs met all the methodological criteria, none had only a low risk of bias and provided sufficient details on methods and randomization to allow for the reproduction and replication of the study. Consequently, the appropriate level of scientific evidence (level 1, degree 1b) could not be granted. On endometriosis therapy, this study evaluated the quality of reporting in RCTs and not the quality of how the studies were performed.
知情决策需要有能力在日常实践中识别和整合高质量的科学证据。我们旨在评估子宫内膜异位症治疗的随机对照试验(RCT)是否遵循方法学标准,这些标准与 RCT 在证据层次结构中的特定级别相对应,以便能够复制和再现研究。使用“治疗”和“子宫内膜异位症”以及“疗效”这三个关键词,从 2008 年 1 月 1 日至 2018 年 3 月 3 日,检索了三个英文文献数据库中的科学文章。仅评估了随机临床试验(RCT),以确定它们是否提供了适当级别的科学证据,相当于证据层次结构中的 1 级,1b 级。制定了一份确保研究可复制和再现的标准清单,考虑了 CONSORT 指南和 MECIR 标准,并用于评估 RCT 的方法学合理性,并给予评分。还评估了三种类型的偏倚,即选择偏倚(随机序列生成和分配隐藏)、检测偏倚(结局评估的盲法)和失访偏倚(结局数据不完整)。我们发现了 387 篇关于子宫内膜异位症治疗的文章,其中 38 篇为 RCT:30 篇双盲 RCT 和 8 篇开放标签 RCT。没有一篇文章根据评估的方法学标准获得最高分。尽管 73.3%的双盲 RCT 有明确的标题、摘要、引言和目标,但只有 13.3%的 RCT 提供了关于实验设计和随机化的准确信息,并且也显示出较低的偏倚风险。43.3%的双盲 RCT 中,盲法报告不佳,而 33.3%的 RCT 中,分配隐藏和随机序列生成不足。没有一篇评估的 RCT 满足所有方法学标准,没有一篇 RCT 只有低偏倚风险,并且提供了足够的方法和随机化细节来允许研究的复制和再现。因此,无法给予适当级别的科学证据(1 级,1b 级)。在子宫内膜异位症治疗方面,本研究评估了 RCT 报告的质量,而不是研究执行的质量。