P.A. Poniatowski is former vice president, Test Development, American Board of Internal Medicine, Philadelphia, Pennsylvania. J.W. Dugosh is vice president, Test Development, American Board of Internal Medicine, Philadelphia, Pennsylvania. R.A. Baranowski is director, Test Development Operations, American Board of Internal Medicine, Philadelphia, Pennsylvania. G. Arnold is former senior statistician, Research and Innovations, American Board of Internal Medicine, Philadelphia, Pennsylvania. R.S. Lipner is senior vice president, Assessment and Research, American Board of Internal Medicine, Philadelphia, Pennsylvania. G.W. Dec Jr is chief emeritus, Cardiology Division, Massachusetts General Hospital, Boston, Massachusetts, and Roman W. DeSanctis Professor of Medicine, Harvard Medical School, Boston, Massachusetts. M.M. Green is senior associate dean for Medical Education, Northwestern University Feinberg School of Medicine, Chicago, Illinois.
Acad Med. 2019 Sep;94(9):1369-1375. doi: 10.1097/ACM.0000000000002727.
As part of the American Board of Internal Medicine's (ABIM's) continuing effort to update its Maintenance of Certification (MOC) program, a content validity tool was used to conduct structured reviews of MOC exam blueprints (i.e., test specification tables) by the physician community. Results from the Cardiovascular Disease MOC blueprint review are presented to illustrate the process ABIM conducted for several internal medicine disciplines.
Ratings of topic frequency and importance were collected from cardiologists in 2016 using a three-point scale (low, medium, high). The web-based survey instrument presented 188 blueprint topic descriptions, each combined with five patient-related tasks (e.g., diagnosis, treatment). Descriptive statistics and chi-square analysis were employed.
Responses from 441 review participants were analyzed. Frequency and importance ratings were aggregated as a composite statistic representing clinical relevance, and exam assembly criteria were modified to select questions, or items, addressing clinically relevant content only. Specifically, ≥ 88% of exam items now address high-importance topics, including ≤ 15% on topics that are also low frequency; and ≤ 12% of exam items now address medium-importance topics, including ≤ 3% on topics that are also low frequency. The updated blueprint has been published for test takers and provides enhanced information on content that would and would not be tested in subsequent examinations. It is linked to more detailed feedback that examinees receive on items answered incorrectly.
The blueprint review garnered valuable feedback from the physician community and provided new evidence for the content validity of the Cardiovascular Disease MOC exam.
作为美国内科医师学会（ABIM）不断更新其维持认证（MOC）计划的一部分，使用内容有效性工具对 MOC 考试蓝图（即测试规范表）进行了由医生社区进行的结构化审查。呈现心血管疾病 MOC 蓝图审查的结果，以说明 ABIM 为几个内科专业进行的过程。
2016 年，使用 3 分制（低、中、高）收集了心脏病专家对主题频率和重要性的评分。基于网络的调查工具提出了 188 个蓝图主题描述，每个描述都与五个与患者相关的任务（例如，诊断、治疗）相结合。使用描述性统计和卡方分析。
分析了来自 441 名审查参与者的回复。频率和重要性评分被汇总为代表临床相关性的综合统计数据，并且考试组装标准被修改为仅选择涉及临床相关内容的问题或项目。具体而言，现在≥88％的考试项目都涉及高重要性主题，其中≤15％的主题频率也较低；现在≤12％的考试项目都涉及中等重要性主题，其中≤3％的主题频率也较低。更新后的蓝图已发布给考生，并提供了有关在后续考试中将要测试和不会测试的内容的增强信息。它与考生在回答错误的项目上收到的更详细的反馈相关联。
蓝图审查从医生社区获得了有价值的反馈，并为心血管疾病 MOC 考试的内容有效性提供了新的证据。
