Reed Darcy A, Cook David A, Beckman Thomas J, Levine Rachel B, Kern David E, Wright Scott M
Division of Primary Care Internal Medicine, Mayo Clinic College of Medicine, Rochester, Minnesota 55901, USA.
JAMA. 2007 Sep 5;298(9):1002-9. doi: 10.1001/jama.298.9.1002.
Methodological shortcomings in medical education research are often attributed to insufficient funding, yet an association between funding and study quality has not been established.
To develop and evaluate an instrument for measuring the quality of education research studies and to assess the relationship between funding and study quality.
DESIGN, SETTING, AND PARTICIPANTS: Internal consistency, interrater and intrarater reliability, and criterion validity were determined for a 10-item medical education research study quality instrument (MERSQI). This was applied to 210 medical education research studies published in 13 peer-reviewed journals between September 1, 2002, and December 31, 2003. The amount of funding obtained per study and the publication record of the first author were determined by survey.
Study quality as measured by the MERSQI (potential maximum total score, 18; maximum domain score, 3), amount of funding per study, and previous publications by the first author.
The mean MERSQI score was 9.95 (SD, 2.34; range, 5-16). Mean domain scores were highest for data analysis (2.58) and lowest for validity (0.69). Intraclass correlation coefficient ranges for interrater and intrarater reliability were 0.72 to 0.98 and 0.78 to 0.998, respectively. Total MERSQI scores were associated with expert quality ratings (Spearman rho, 0.73; 95% confidence interval [CI], 0.56-0.84; P < .001), 3-year citation rate (0.8 increase in score per 10 citations; 95% CI, 0.03-1.30; P = .003), and journal impact factor (1.0 increase in score per 6-unit increase in impact factor; 95% CI, 0.34-1.56; P = .003). In multivariate analysis, MERSQI scores were independently associated with study funding of $20 000 or more (0.95 increase in score; 95% CI, 0.22-1.86; P = .045) and previous medical education publications by the first author (1.07 increase in score per 20 publications; 95% CI, 0.15-2.23; P = .047).
The quality of published medical education research is associated with study funding.
医学教育研究中的方法学缺陷常被归因于资金不足,但资金与研究质量之间的关联尚未确立。
开发并评估一种用于衡量教育研究质量的工具,并评估资金与研究质量之间的关系。
设计、场所和参与者:对一个包含10个条目的医学教育研究质量工具(MERSQI)进行内部一致性、评分者间和评分者内信度以及效标效度测定。将其应用于2002年9月1日至2003年12月31日期间发表在13种同行评审期刊上的210项医学教育研究。通过调查确定每项研究获得的资金数额以及第一作者的发表记录。
用MERSQI衡量的研究质量(潜在最大总分18分;最大领域得分3分)、每项研究的资金数额以及第一作者之前的发表情况。
MERSQI的平均得分为9.95(标准差2.34;范围5 - 16)。数据分析领域的平均得分最高(2.58),效度领域的平均得分最低(0.69)。评分者间和评分者内信度的组内相关系数范围分别为0.72至0.98和0.78至0.998。MERSQI总分与专家质量评级相关(斯皮尔曼等级相关系数,0.73;95%置信区间[CI],0.56 - 0.84;P <.001)、3年引用率(每10次引用得分增加0.8;95% CI,0.03 - 1.30;P =.003)以及期刊影响因子(影响因子每增加6个单位得分增加1.0;95% CI,0.34 - 1.56;P =.003)。在多变量分析中,MERSQI得分与20000美元或更多的研究资金独立相关(得分增加0.95;95% CI,0.22 - 1.86;P =.045)以及第一作者之前的医学教育发表情况(每20篇发表得分增加1.07;95% CI,0.15 - 2.23;P =.047)。
已发表的医学教育研究质量与研究资金相关。