Suppr超能文献

评估试验质量没有捷径:一个案例研究。

No short-cut in assessing trial quality: a case study.

作者信息

Hirji Karim F

机构信息

Department of Epidemiology and Biostatistics, Muhimbili University of Health and Allied Sciences, P O Box 65015, Dar es Salaam, Tanzania.

出版信息

Trials. 2009 Jan 7;10:1. doi: 10.1186/1745-6215-10-1.

Abstract

BACKGROUND

Assessing the quality of included trials is a central part of a systematic review. Many check-list type of instruments for doing this exist. Using a trial of antibiotic treatment for acute otitis media, Burke et al., BMJ, 1991, as the case study, this paper illustrates some limitations of the check-list approach to trial quality assessment.

RESULTS

The general verdict from the check list type evaluations in nine relevant systematic reviews was that Burke et al. (1991) is a good quality trial. All relevant meta-analyses extensively used its data to formulate therapeutic evidence. My comprehensive evaluation, on the other hand, brought to the surface a series of serious problems in the design, conduct, analysis and report of this trial that were missed by the earlier evaluations.

CONCLUSION

A check-list or instrument based approach, if used as a short-cut, may at times rate deeply flawed trials as good quality trials. Check lists are crucial but they need to be augmented with an in-depth review, and where possible, a scrutiny of the protocol, trial records, and original data. The extent and severity of the problems I uncovered for this particular trial warrant an independent audit before it is included in a systematic review.

摘要

背景

评估纳入试验的质量是系统评价的核心部分。有许多用于此目的的清单式工具。以1991年发表于《英国医学杂志》的伯克等人关于急性中耳炎抗生素治疗的试验为例,本文阐述了清单法在试验质量评估方面的一些局限性。

结果

九项相关系统评价中清单式评估的总体结论是,伯克等人(1991年)的试验质量良好。所有相关的荟萃分析都广泛使用其数据来形成治疗证据。另一方面,我的综合评估揭示了该试验在设计、实施、分析和报告方面存在一系列严重问题,而早期评估并未发现这些问题。

结论

基于清单或工具的方法,如果用作捷径,有时可能会将存在严重缺陷的试验评为高质量试验。清单至关重要,但需要通过深入审查进行补充,并且在可能的情况下,对试验方案、试验记录和原始数据进行审查。就这一特定试验而言,我发现的问题的范围和严重性表明,在将其纳入系统评价之前需要进行独立审计。

相似文献

1
No short-cut in assessing trial quality: a case study.
Trials. 2009 Jan 7;10:1. doi: 10.1186/1745-6215-10-1.
3
Readers as research detectives.
Trials. 2009 Jan 7;10:2. doi: 10.1186/1745-6215-10-2.
5
The future of Cochrane Neonatal.
Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12.
8
A review of clinical trials regarding treatment of acute otitis media.
Clin Otolaryngol Allied Sci. 1992 Jun;17(3):251-7. doi: 10.1111/j.1365-2273.1992.tb01838.x.
9
Otitis media. A scholarly review of the evidence.
Minerva Pediatr. 2003 Oct;55(5):407-14.
10
Treatment for otitis media.
CMAJ. 2005 Aug 2;173(3):235; author reply 236. doi: 10.1503/cmaj.1050050.

引用本文的文献

1
Associations between the Global Diet Quality Score and risk of type 2 diabetes: Tehran lipid and glucose study.
PLoS One. 2025 Jan 15;20(1):e0313886. doi: 10.1371/journal.pone.0313886. eCollection 2025.
2
Towards replicability and sustainability in cancer research.
BJC Rep. 2024 Sep 4;2(1):65. doi: 10.1038/s44276-024-00090-6.
3
STARTER Checklist for Antimalarial Therapeutic Efficacy Reporting.
Am J Trop Med Hyg. 2022 Jun 13;107(1):1-3. doi: 10.4269/ajtmh.22-0224.
4
STARTER checklist for antimalarial therapeutic efficacy reporting.
Malar J. 2022 Jun 13;21(1):187. doi: 10.1186/s12936-022-04182-x.
5
Model structure for protocol adherence utilizing a manualized therapeutic massage intervention.
J Complement Integr Med. 2018 Oct 12;16(2):/j/jcim.2019.16.issue-2/jcim-2016-0118/jcim-2016-0118.xml. doi: 10.1515/jcim-2016-0118.
6
Difficulty in detecting discrepancies in a clinical trial report: 260-reader evaluation.
Int J Epidemiol. 2015 Jun;44(3):862-9. doi: 10.1093/ije/dyv114. Epub 2015 Jul 13.
7
Pre-referral rectal artesunate in severe malaria: flawed trial.
Trials. 2011 Aug 8;12:188. doi: 10.1186/1745-6215-12-188.
9
Readers as research detectives.
Trials. 2009 Jan 7;10:2. doi: 10.1186/1745-6215-10-2.

本文引用的文献

1
Systematic reviews: time to address clinical and policy relevance as well as methodological rigor.
Ann Intern Med. 2007 Aug 21;147(4):273-4. doi: 10.7326/0003-4819-147-4-200708210-00180. Epub 2007 Jul 16.
2
Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials.
Int J Epidemiol. 2007 Aug;36(4):847-57. doi: 10.1093/ije/dym087. Epub 2007 May 21.
3
Many reviews are systematic but some are more transparent and completely reported than others.
PLoS Med. 2007 Mar;4(3):e147. doi: 10.1371/journal.pmed.0040147.
4
Epidemiology and reporting characteristics of systematic reviews.
PLoS Med. 2007 Mar 27;4(3):e78. doi: 10.1371/journal.pmed.0040078.
5
What have we learnt from Vioxx?
BMJ. 2007 Jan 20;334(7585):120-3. doi: 10.1136/bmj.39024.487720.68.
6
Antibiotics for acute otitis media: a meta-analysis with individual patient data.
Lancet. 2006 Oct 21;368(9545):1429-35. doi: 10.1016/S0140-6736(06)69606-2.
7
External validity: the neglected dimension in evidence ranking.
J Eval Clin Pract. 2006 Aug;12(4):450-3. doi: 10.1111/j.1365-2753.2006.00730.x.
8
Factors that can affect the external validity of randomised controlled trials.
PLoS Clin Trials. 2006 May;1(1):e9. doi: 10.1371/journal.pctr.0010009.
10
Epidemiology and reporting of randomised trials published in PubMed journals.
Lancet. 2005;365(9465):1159-62. doi: 10.1016/S0140-6736(05)71879-1.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验