Willett Lisa L, Paranjape Anuradha, Estrada Carlos
Department of Medicine, University of Alabama at Birmingham, BDB 339, 1530 3rd Avenue South, Birmingham, AL 35294-0012, USA.
J Gen Intern Med. 2009 Mar;24(3):393-7. doi: 10.1007/s11606-008-0860-1. Epub 2008 Dec 17.
Residents demonstrate scholarly activity by presenting posters at academic meetings. Although recommendations from national organizations are available, evidence identifying which components are most important is not.
To develop and test an evaluation tool to measure the quality of case report posters and identify the specific components most in need of improvement.
Faculty evaluators reviewed case report posters and provided on-site feedback to presenters at poster sessions of four annual academic general internal medicine meetings. A newly developed ten-item evaluation form measured poster quality for specific components of content, discussion, and format (5-point Likert scale, 1 = lowest, 5 = highest).
MAIN OUTCOME MEASURE(S): Evaluation tool performance, including Cronbach alpha and inter-rater reliability, overall poster scores, differences across meetings and evaluators and specific components of the posters most in need of improvement.
Forty-five evaluators from 20 medical institutions reviewed 347 posters. Cronbach's alpha of the evaluation form was 0.84 and inter-rater reliability, Spearman's rho 0.49 (p < 0.001). The median score was 4.1 (Q1 -Q3, 3.7-4.6)(Q1 = 25th, Q3 = 75th percentile). The national meeting median score was higher than the regional meetings (4.4 vs, 4.0, P < 0.001). We found no difference in faculty scores. The following areas were identified as most needing improvement: clearly state learning objectives, tie conclusions to learning objectives, and use appropriate amount of words.
Our evaluation tool provides empirical data to guide trainees as they prepare posters for presentation which may improve poster quality and enhance their scholarly productivity.
住院医师通过在学术会议上展示海报来展现学术活动。尽管有国家组织的相关建议，但确定哪些组成部分最为重要的证据却并不存在。
开发并测试一种评估工具，以衡量病例报告海报的质量，并确定最需要改进的具体组成部分。
教员评估人员审查病例报告海报，并在四次年度学术普通内科会议的海报展示环节为展示者提供现场反馈。一份新开发的包含十个条目的评估表针对内容、讨论和格式的具体组成部分来衡量海报质量（5分制李克特量表，1 = 最低，5 = 最高）。
评估工具的性能，包括克朗巴哈系数和评分者间信度、海报总体得分、不同会议和评估者之间的差异以及海报最需要改进的具体组成部分。
来自20个医疗机构的45名评估人员审查了347张海报。评估表的克朗巴哈系数为0.84，评分者间信度，斯皮尔曼等级相关系数为0.49（p < 0.001）。中位数得分为4.1（第一四分位数 - 第三四分位数，3.7 - 4.6）（第一四分位数 = 第25百分位数，第三四分位数 = 第75百分位数）。全国性会议的中位数得分高于地区性会议（4.4对4.0，P < 0.001）。我们发现教员评分没有差异。以下方面被确定为最需要改进的：明确陈述学习目标；将结论与学习目标联系起来；使用适量的文字。
我们的评估工具提供了实证数据，可在住院医师准备展示海报时为其提供指导，这可能会提高海报质量并提升他们的学术产出。
