From the Advanced Technologies and Surgery Branch (N.D.), the Office of Biostatistics Research (C.O.W., P.S.), and the Office of the Director (M.L.), Division of Cardiovascular Sciences of the National Heart, Lung, and Blood Institute (NHLBI), Bethesda, MD.
Circ Res. 2014 Feb 14;114(4):600-6. doi: 10.1161/CIRCRESAHA.114.302656. Epub 2014 Jan 9.
RATIONALE: Funding decisions for cardiovascular R01 grant applications at the National Heart, Lung, and Blood Institute (NHLBI) largely hinge on percentile rankings. It is not known whether this approach enables the highest impact science. OBJECTIVE: Our aim was to conduct an observational analysis of percentile rankings and bibliometric outcomes for a contemporary set of funded NHLBI cardiovascular R01 grants. METHODS AND RESULTS: We identified 1492 investigator-initiated de novo R01 grant applications that were funded between 2001 and 2008 and followed their progress for linked publications and citations to those publications. Our coprimary end points were citations received per million dollars of funding, citations obtained <2 years of publication, and 2-year citations for each grant's maximally cited paper. In 7654 grant-years of funding that generated $3004 million of total National Institutes of Health awards, the portfolio yielded 16 793 publications that appeared between 2001 and 2012 (median per grant, 8; 25th and 75th percentiles, 4 and 14; range, 0-123), which received 2 224 255 citations (median per grant, 1048; 25th and 75th percentiles, 492 and 1932; range, 0-16 295). We found no association between percentile rankings and citation metrics; the absence of association persisted even after accounting for calendar time, grant duration, number of grants acknowledged per paper, number of authors per paper, early investigator status, human versus nonhuman focus, and institutional funding. An exploratory machine learning analysis suggested that grants with the best percentile rankings did yield more maximally cited papers. CONCLUSIONS: In a large cohort of NHLBI-funded cardiovascular R01 grants, we were unable to find a monotonic association between better percentile ranking and higher scientific impact as assessed by citation metrics.
背景:美国国立心肺血液研究所(NHLBI)的心血管 R01 拨款申请的资金决策在很大程度上取决于百分位排名。目前尚不清楚这种方法是否能产生最具影响力的科学成果。
目的:我们旨在对一组当代获得 NHLBI 心血管 R01 拨款的资助的百分位排名和文献计量学结果进行观察性分析。
方法和结果:我们确定了 1492 项由调查员发起的、2001 年至 2008 年间获得资助的全新 R01 拨款申请,并对其相关出版物和对这些出版物的引用进行了后续跟踪。我们的主要终点是每百万美元资助获得的引用数、发表后 2 年内获得的引用数,以及每项拨款的最高引用论文的 2 年引用数。在 7654 个资助年中,共产生了 30.04 亿美元的美国国立卫生研究院拨款,该拨款组合产生了 16793 篇发表于 2001 年至 2012 年的出版物(每篇拨款的中位数为 8,25%和 75%分位数为 4 和 14,范围为 0-123),共获得 2224255 次引用(每篇拨款的中位数为 1048,25%和 75%分位数为 492 和 1932,范围为 0-16295)。我们没有发现百分位排名与引文指标之间存在关联;即使在考虑了日历时间、拨款期限、每篇论文的认可拨款数、每篇论文的作者数、早期调查员身份、人类与非人类重点以及机构资助等因素后,这种关联仍然存在。一项探索性机器学习分析表明,排名最好的拨款确实产生了更多的最高引用论文。
结论:在 NHLBI 资助的大型心血管 R01 拨款队列中,我们未能发现更好的百分位排名与引文指标评估的更高科学影响力之间存在单调关联。
J Gen Intern Med. 2022-1
World Neurosurg. 2013-11-13
Clin Orthop Relat Res. 2023-7-1
Int J Environ Res Public Health. 2021-12-13
J Thorac Cardiovasc Surg. 2022-3
J Thorac Cardiovasc Surg. 2021-12
Appl Netw Sci. 2016
PLoS One. 2013-6-19
Science. 2013-5-17
Science. 2012-10-12
Circ Res. 2012-9-14
Nature. 2011-9-28
J Public Econ. 2011-10-1
FASEB J. 2011-11