研究报告的标准化方法评估 (SHARP)：新工具的开发。
Standardized methodological assessment of research presentations (SHARP): development of a new instrument.
机构信息
Department of Surgery, McMaster University, 39 Charlton Ave. E., Hamilton, ON L8N IY3, Canada; Deparmtent of Clinical Epidemiology and Biostatistics, McMaster University, 39 Charlton Ave. E., Hamilton, ON L8N IY3, Canada.
Department of Surgery, McMaster University, 39 Charlton Ave. E., Hamilton, ON L8N IY3, Canada.
出版信息
Am J Surg. 2014 Jun;207(6):964-73. doi: 10.1016/j.amjsurg.2013.08.053. Epub 2014 Jan 4.
BACKGROUND
There are currently no validated guidelines to assess the quality of the content and the delivery style of scientific podium surgical presentations. We have developed a simple, short, and reliable instrument to objectively assess the overall quality of scientific podium presentations.
METHODS
A simple and efficient rating instrument was developed to assess the scientific content and presentation style/skills of the surgical residents' presentations from 1996 to 2013. Absolute and consistency agreement for the different sections of the instrument was determined and assessed overtime, by stage of the project and study design. Intraclass correlation coefficients with 95% confidence intervals were calculated and reported using a mixed-effects model.
RESULTS
Inter-rater reliability for both absolute and consistency agreement was substantial for total score and for each of the 3 sections of the instrument. The absolute agreement for the overall rating of the presentations was .87 (.63 to .98) and .78 (.50 to .95), and the consistency agreement was .90 (.70 to .99) and .87 (.67 to .97) for the 2012 and 2013 institutional research presentations, respectively. Rater agreement for evaluating project stage and different study designs varied from .70 to .81 and was consistent over the years. The consistency agreement in rating of the presentation was .77 for both faculty and resident raters.
CONCLUSIONS
Standardized methodological assessment of research presentations (SHARP) instrument rates the scientific quality of the research and style of the delivered presentation. It is highly reliable in scoring the quality of the all study designs regardless of their stage. We recommend that researchers focus on presenting the key concepts and significant elements of their evidence using visually simple slides in a professionally engaging manner for effective delivery of their research and better communication with the audience.
背景
目前尚无评估科学讲台手术演示内容质量和演示风格的验证指南。我们开发了一种简单、简短且可靠的工具，用于客观评估科学讲台演示的整体质量。
方法
我们开发了一种简单有效的评分工具，用于评估 1996 年至 2013 年外科住院医师演示的科学内容和演示风格/技能。通过项目阶段和研究设计，确定和评估了该工具不同部分的绝对和一致性一致性。使用混合效应模型计算并报告了具有 95%置信区间的组内相关系数。
结果
对于总分和工具的 3 个部分中的每个部分，两者的评分者间可靠性均为中等。演示的整体评分的绝对一致性为.87（.63 至.98）和.78（.50 至.95），一致性为.90（.70 至.99）和.87（.67 至.97）对于 2012 年和 2013 年的机构研究演讲。评估项目阶段和不同研究设计的评分者间一致性从.70 到.81 不等，且多年来一直保持一致。演示评分的一致性在教师和住院医师评分者中均为.77。
结论
研究演示的标准化方法评估 (SHARP) 工具对研究的科学性和演示的风格进行评分。它在评分所有研究设计的质量方面具有很高的可靠性，而不论其阶段如何。我们建议研究人员专注于以视觉上简单的幻灯片呈现其证据的关键概念和重要元素，并以专业吸引人的方式进行演示，以有效地传达他们的研究内容，并与听众进行更好的沟通。
Zotero 插件