文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

社会科学中与透明度和可重复性相关的研究实践的实证评估(2014 - 2017年)

An empirical assessment of transparency and reproducibility-related research practices in the social sciences (2014-2017).

作者信息

Hardwicke Tom E, Wallach Joshua D, Kidwell Mallory C, Bendixen Theiss, Crüwell Sophia, Ioannidis John P A

机构信息

Meta-Research Innovation Center Berlin (METRIC-B), QUEST Center for Transforming Biomedical Research, Berlin Institute of Health, Charité - Universitätsmedizin Berlin, Anna-Louisa-Karsch-Str.2, 10178 Berlin, Germany.

Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA.

出版信息

R Soc Open Sci. 2020 Feb 19;7(2):190806. doi: 10.1098/rsos.190806. eCollection 2020 Feb.


DOI:10.1098/rsos.190806
PMID:32257301
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC7062098/
Abstract

Serious concerns about research quality have catalysed a number of reform initiatives intended to improve transparency and reproducibility and thus facilitate self-correction, increase efficiency and enhance research credibility. Meta-research has evaluated the merits of some individual initiatives; however, this may not capture broader trends reflecting the cumulative contribution of these efforts. In this study, we manually examined a random sample of 250 articles in order to estimate the prevalence of a range of transparency and reproducibility-related indicators in the social sciences literature published between 2014 and 2017. Few articles indicated availability of materials (16/151, 11% [95% confidence interval, 7% to 16%]), protocols (0/156, 0% [0% to 1%]), raw data (11/156, 7% [2% to 13%]) or analysis scripts (2/156, 1% [0% to 3%]), and no studies were pre-registered (0/156, 0% [0% to 1%]). Some articles explicitly disclosed funding sources (or lack of; 74/236, 31% [25% to 37%]) and some declared no conflicts of interest (36/236, 15% [11% to 20%]). Replication studies were rare (2/156, 1% [0% to 3%]). Few studies were included in evidence synthesis via systematic review (17/151, 11% [7% to 16%]) or meta-analysis (2/151, 1% [0% to 3%]). Less than half the articles were publicly available (101/250, 40% [34% to 47%]). Minimal adoption of transparency and reproducibility-related research practices could be undermining the credibility and efficiency of social science research. The present study establishes a baseline that can be revisited in the future to assess progress.

摘要

对研究质量的严重担忧催生了一系列旨在提高透明度和可重复性、从而促进自我修正、提高效率并增强研究可信度的改革举措。元研究评估了一些个别举措的优点;然而,这可能无法捕捉到反映这些努力累积贡献的更广泛趋势。在本研究中,我们手动检查了250篇文章的随机样本,以估计2014年至2017年发表的社会科学文献中一系列与透明度和可重复性相关指标的流行情况。很少有文章表明材料(16/151,11%[95%置信区间,7%至16%])、方案(0/156,0%[0%至1%])、原始数据(11/156,7%[2%至13%])或分析脚本(2/156,1%[0%至3%])可用,且没有研究进行预注册(0/156,0%[0%至1%])。一些文章明确披露了资金来源(或缺乏资金来源;74/236,31%[25%至37%]),一些声明没有利益冲突(36/236,15%[11%至20%])。复制研究很少见(2/156,1%[0%至3%])。很少有研究通过系统评价(17/151,11%[7%至16%])或元分析(2/151,1%[0%至3%])纳入证据综合。不到一半的文章是公开可用的(101/250,40%[34%至47%])。对与透明度和可重复性相关的研究实践的最低限度采用可能正在损害社会科学研究的可信度和效率。本研究建立了一个基线,未来可以重新审视以评估进展情况。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e713/7062098/0aebc5a14373/rsos190806-g1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e713/7062098/0aebc5a14373/rsos190806-g1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e713/7062098/0aebc5a14373/rsos190806-g1.jpg

相似文献

[1]
An empirical assessment of transparency and reproducibility-related research practices in the social sciences (2014-2017).

R Soc Open Sci. 2020-2-19

[2]
Estimating the Prevalence of Transparency and Reproducibility-Related Research Practices in Psychology (2014-2017).

Perspect Psychol Sci. 2022-1

[3]
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.

Cochrane Database Syst Rev. 2022-2-1

[4]
Reproducible research practices, transparency, and open access data in the biomedical literature, 2015-2017.

PLoS Biol. 2018-11-20

[5]
Transparent and Reproducible Research Practices in the Surgical Literature.

J Surg Res. 2022-6

[6]
Reproducible Research Practices and Transparency across the Biomedical Literature.

PLoS Biol. 2016-1-4

[7]
Beyond the black stump: rapid reviews of health research issues affecting regional, rural and remote Australia.

Med J Aust. 2020-12

[8]
Evaluation of reproducible and transparent research practices in pulmonology.

Pulmonology. 2021

[9]
Reproducible research practices and transparency in reproductive endocrinology and infertility articles.

Fertil Steril. 2020-12

[10]
Assessing Open Science practices in physical activity behaviour change intervention evaluations.

BMJ Open Sport Exerc Med. 2022-5-23

引用本文的文献

[1]
Risk of bias and low reproducibility in meta-analytic evidence from fast-tracked publications during the coronavirus disease 2019 pandemic.

PNAS Nexus. 2025-7-29

[2]
A sharing practices review of the visual search and eye movements literature reveals recommendations for our field and others.

Behav Res Methods. 2025-7-25

[3]
Standardizing Survey Data Collection to Enhance Reproducibility: Development and Comparative Evaluation of the ReproSchema Ecosystem.

J Med Internet Res. 2025-7-11

[4]
Transparency in epidemiological analyses of cohort data a case study of the Norwegian mother, father, and child cohort study (MoBa).

BMC Med Res Methodol. 2025-7-1

[5]
Examining the availability/findability of stimuli employed in social media and body image research.

PLoS One. 2025-5-22

[6]
Transparency, Reproducibility, and Accessibility of Clinical and Experimental Studies in Allergy (TRACES): Study design and protocol.

J Allergy Clin Immunol Glob. 2025-3-6

[7]
How Transparent and Reproducible Are Studies That Use Animal Models of Opioid Addiction?

Addict Biol. 2025-4

[8]
A worldwide itinerary of research ethics in science for a better social responsibility and justice: a bibliometric analysis and review.

Front Res Metr Anal. 2025-2-11

[9]
A systematic review of pre-registration in autism research journals.

Autism. 2025-6

[10]
Biomedical researchers' perspectives on the reproducibility of research.

PLoS Biol. 2024-11

本文引用的文献

[1]
A manifesto for reproducible science.

Nat Hum Behav. 2017-1-10

[2]
Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015.

Nat Hum Behav. 2018-8-27

[3]
Push button replication: Is impact evaluation evidence for international development verifiable?

PLoS One. 2018-12-21

[4]
Reproducible research practices, transparency, and open access data in the biomedical literature, 2015-2017.

PLoS Biol. 2018-11-20

[5]
Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal .

R Soc Open Sci. 2018-8-15

[6]
Populating the Data Ark: An attempt to retrieve, preserve, and liberate data from the most highly-cited psychology and psychiatry articles.

PLoS One. 2018-8-2

[7]
The preregistration revolution.

Proc Natl Acad Sci U S A. 2018-3-13

[8]
The state of OA: a large-scale analysis of the prevalence and impact of Open Access articles.

PeerJ. 2018-2-13

[9]
Increasing Transparency Through a Multiverse Analysis.

Perspect Psychol Sci. 2016-9

[10]
The Virtuous Cycle of a Data Ecosystem.

PLoS Comput Biol. 2016-8-4

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索