文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

通过国家综合癌症网络指南引用的肿瘤学系统评价与荟萃分析中的可重复研究实践评估

Evaluation of Reproducible Research Practices in Oncology Systematic Reviews With Meta-analyses Referenced by National Comprehensive Cancer Network Guidelines.

作者信息

Wayant Cole, Page Matthew J, Vassar Matt

机构信息

Department of Biomedical Sciences, Oklahoma State University Center for Health Sciences, Tulsa.

School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia.

出版信息

JAMA Oncol. 2019 Nov 1;5(11):1550-1555. doi: 10.1001/jamaoncol.2019.2564.


DOI:10.1001/jamaoncol.2019.2564
PMID:31486837
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC6735674/
Abstract

IMPORTANCE: Reproducible research practices are essential to biomedical research because these practices promote trustworthy evidence. In systematic reviews and meta-analyses, reproducible research practices ensure that summary effects used to guide patient care are stable and trustworthy. OBJECTIVE: To evaluate the reproducibility in theory of meta-analyses in oncology systematic reviews cited by the 49 National Comprehensive Cancer Network (NCCN) guidelines for the treatment of cancer by site and evaluate whether Cochrane reviews or systematic reviews that report adherence to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines use more reproducible research practices. DESIGN, SETTING, AND PARTICIPANTS: A cross-sectional investigation of all systematic reviews with at least 1 meta-analysis and at least 1 included randomized clinical trial (RCT) that are cited by NCCN guidelines for treatment of cancer by site. We scanned the reference list of all NCCN guidelines (n = 49) for potential systematic reviews and meta-analyses. All retrieved studies were screened, and data were extracted, independently and in duplicate. The analysis was carried out between May 6, 2018, and January 28, 2019. MAIN OUTCOMES AND MEASURES: The frequency of reproducible research practices, defined as (1) effect estimate and measure of precision (eg, hazard ratio with 95% confidence interval); (2) clear list of studies included for each analysis; and (3) for subgroup and sensitivity analyses, it must be clear which studies were included in each group or level. RESULTS: We identified 1124 potential systematic reviews, and 154 meta-analyses comprising 3696 meta-analytic effect size estimates were included. Only 2375 of the 3696 meta-analytic estimates (64.3%), including subgroup and sensitivity analyses, were reproducible in theory. Forest plots appear to improve the reproducibility of meta-analyses. All meta-analytic estimates were reproducible in theory in 100 systematic reviews (64.9%), and in 15 systematic reviews (9.7%), no meta-analytic estimates could potentially be reproduced. Data were said to be imputed in 29 meta-analyses, but none specified which data. Only 1 meta-analysis included a link to an online data set. CONCLUSIONS AND RELEVANCE: More reproducible research practices are needed in oncology meta-analyses, as suggested by those that are cited by the NCCN. Reporting meta-analyses in forest plots and requirements for full data sharing are recommended.

摘要

重要性:可重复的研究实践对生物医学研究至关重要,因为这些实践能促进产生可靠的证据。在系统评价和荟萃分析中,可重复的研究实践可确保用于指导患者护理的汇总效应稳定且可靠。 目的:评估按癌症部位分类的49项美国国立综合癌症网络(NCCN)癌症治疗指南所引用的肿瘤学系统评价中荟萃分析在理论上的可重复性,并评估遵循系统评价和荟萃分析优先报告项目(PRISMA)指南的Cochrane评价或系统评价是否采用了更多可重复的研究实践。 设计、设置和参与者:对所有至少有1项荟萃分析且至少有1项纳入的随机临床试验(RCT)的系统评价进行横断面调查,这些系统评价被NCCN按癌症部位分类的治疗指南所引用。我们扫描了所有NCCN指南(n = 49)的参考文献列表,以查找潜在的系统评价和荟萃分析。对所有检索到的研究进行筛选,并独立且一式两份地提取数据。分析于2018年5月6日至2019年1月28日进行。 主要结局和指标:可重复研究实践的频率,定义为:(1)效应估计值和精确性测量指标(如95%置信区间的风险比);(2)每次分析纳入研究的清晰列表;(3)对于亚组分析和敏感性分析,必须明确每组或每个水平纳入了哪些研究。 结果:我们识别出1124项潜在的系统评价,纳入了154项荟萃分析,其中包含3,696个荟萃分析效应量估计值。在3,696个荟萃分析估计值(包括亚组分析和敏感性分析)中,理论上只有2,375个(64.3%)是可重复的。森林图似乎能提高荟萃分析的可重复性。在100项系统评价(64.9%)中,所有荟萃分析估计值在理论上都是可重复的,而在15项系统评价(9.7%)中,没有任何荟萃分析估计值可能被重复。在29项荟萃分析中提到数据是估算的,但均未指明是哪些数据。只有1项荟萃分析包含指向在线数据集的链接。 结论和相关性:如NCCN所引用的那些研究所示,肿瘤学荟萃分析需要更多可重复的研究实践。建议采用森林图报告荟萃分析并要求完全共享数据。

相似文献

[1]
Evaluation of Reproducible Research Practices in Oncology Systematic Reviews With Meta-analyses Referenced by National Comprehensive Cancer Network Guidelines.

JAMA Oncol. 2019-11-1

[2]
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.

Cochrane Database Syst Rev. 2022-2-1

[3]
The future of Cochrane Neonatal.

Early Hum Dev. 2020-11

[4]
Bias due to selective inclusion and reporting of outcomes and analyses in systematic reviews of randomised trials of healthcare interventions.

Cochrane Database Syst Rev. 2014-10-1

[5]
Reproducible research practices are underused in systematic reviews of biomedical interventions.

J Clin Epidemiol. 2017-11-4

[6]

2018-3

[7]
Risk of Bias and Quality of Reporting in Colon and Rectal Cancer Systematic Reviews Cited by National Comprehensive Cancer Network Guidelines.

J Gen Intern Med. 2020-8

[8]
Beyond the black stump: rapid reviews of health research issues affecting regional, rural and remote Australia.

Med J Aust. 2020-12

[9]
Effect of reporting bias on meta-analyses of drug trials: reanalysis of meta-analyses.

BMJ. 2012-1-3

[10]
Response to letter to the editor from Dr Rahman Shiri: The challenging topic of suicide across occupational groups.

Scand J Work Environ Health. 2017-12-8

引用本文的文献

[1]
Transparency, quality, and statistical consistency of meta-analytic systematic reviews in clinical child and adolescent psychology (2022-2024): study protocol for a meta-review.

Front Psychol. 2025-7-28

[2]
Systematic reviewers' perspectives on replication of systematic reviews: A survey.

Cochrane Evid Synth Methods. 2023-4-10

[3]
Systematic reviewers' perspectives on sharing review data, analytic code, and other materials: A survey.

Cochrane Evid Synth Methods. 2023-4-10

[4]
Advances in the field of developing biomarkers for re-irradiation: a how-to guide to small, powerful data sets and artificial intelligence.

Expert Rev Precis Med Drug Dev. 2024

[5]
[The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsDeclaración PRISMA 2020: una guía actualizada para la publicación de revisiones sistemáticas].

Rev Panam Salud Publica. 2022-12-30

[6]
Sex, Racial, and Ethnic Representation in COVID-19 Clinical Trials: A Systematic Review and Meta-analysis.

JAMA Intern Med. 2023-1-1

[7]
Changing patterns in reporting and sharing of review data in systematic reviews with meta-analysis of the effects of interventions: cross sectional meta-research study.

BMJ. 2022-11-22

[8]
How often do cancer researchers make their data and code available and what factors are associated with sharing?

BMC Med. 2022-11-9

[9]
The REPRISE project: protocol for an evaluation of REProducibility and Replicability In Syntheses of Evidence.

Syst Rev. 2021-4-16

[10]
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews.

BMJ. 2021-3-29

本文引用的文献

[1]
A manifesto for reproducible science.

Nat Hum Behav. 2017-1-10

[2]
Methodological and reporting quality of systematic reviews referenced in the clinical practice guideline for pediatric high-blood pressure.

J Hypertens. 2019-3

[3]
Evaluations of the uptake and impact of the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) Statement and extensions: a scoping review.

Syst Rev. 2017-12-19

[4]
Reproducible research practices are underused in systematic reviews of biomedical interventions.

J Clin Epidemiol. 2017-11-4

[5]
Methodological quality of systematic reviews referenced in clinical practice guidelines for the treatment of opioid use disorder.

PLoS One. 2017-8-3

[6]
Variable methodological quality and use found in systematic reviews referenced in STEMI clinical practice guidelines.

Am J Emerg Med. 2017-12

[7]
Quality of reporting in oncology studies: A systematic analysis of literature reviews and prospects.

Crit Rev Oncol Hematol. 2017-2-24

[8]
Methodological quality, completeness of reporting and use of systematic reviews as evidence in clinical practice guidelines for paediatric overweight and obesity.

Clin Obes. 2017-2

[9]
Making sense of replications.

Elife. 2017-1-19

[10]
Rayyan-a web and mobile app for systematic reviews.

Syst Rev. 2016-12-5

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索