Department of Economics, Bocconi University, 20136 Milan, Italy.
Bocconi Institute for Data Science and Analytics, Bocconi University, 20136 Milan, Italy.
Proc Natl Acad Sci U S A. 2020 Jun 16;117(24):13386-13392. doi: 10.1073/pnas.1919906117. Epub 2020 Jun 2.
Clinical research should conform to high standards of ethical and scientific integrity, given that human lives are at stake. However, economic incentives can generate conflicts of interest for investigators, who may be inclined to withhold unfavorable results or even tamper with data in order to achieve desired outcomes. To shed light on the integrity of clinical trial results, this paper systematically analyzes the distribution of values of primary outcomes for phase II and phase III drug trials reported to the ClinicalTrials.gov registry. First, we detect no bunching of results just above the classical 5% threshold for statistical significance. Second, a density-discontinuity test reveals an upward jump at the 5% threshold for phase III results by small industry sponsors. Third, we document a larger fraction of significant results in phase III compared to phase II. Linking trials across phases, we find that early favorable results increase the likelihood of continuing into the next phase. Once we take into account this selective continuation, we can explain almost completely the excess of significant results in phase III for trials conducted by large industry sponsors. For small industry sponsors, instead, part of the excess remains unexplained.
临床研究应符合高标准的伦理和科学诚信,因为人命关天。然而,经济激励可能会给研究者带来利益冲突,他们可能倾向于隐瞒不利结果,甚至篡改数据,以达到预期的结果。为了阐明临床试验结果的完整性,本文系统地分析了向 ClinicalTrials.gov 注册中心报告的 II 期和 III 期药物试验主要结局值的分布情况。首先,我们没有发现结果正好高于经典的 5%统计显著性阈值的聚集。其次,密度不连续检验显示,小工业赞助商的 III 期结果在 5%的阈值处有向上的跳跃。第三,我们记录到 III 期的显著结果比例高于 II 期。通过将各阶段的试验联系起来,我们发现早期有利的结果增加了进入下一阶段的可能性。一旦我们考虑到这种选择性延续,我们就可以解释为什么由大型工业赞助商进行的 III 期试验中显著结果过多。对于小型工业赞助商,部分超额结果仍然无法解释。