Cheney Mark A, Dimeola Michael A, Nagy Christopher J
Resident Physician, Department of Radiology, San Antonio Uniformed Services Health Education Consortium.
Staff Physician, Department of Anesthesiology, San Antonio Uniformed Services Health Education Consortium.
J Educ Perioper Med. 2014 Jan 1;16(1):E067. eCollection 2014 Jan-Jun.
We sought to determine the relationship between residents' Anesthesia Knowledge Test 6 (AKT-6) scores and their first-time success/failure on the American Board of Anesthesiology written licensing examination. Reliable early identification of residents at risk for failing the ABA exam would be an invaluable screening tool for program leadership and facilitate timely remediation for struggling residents.
Program directors were invited to submit anonymous data regarding their residents' performance on the AKT-6 and their subsequent first-time success/failure on the American Board of Anesthesiology written licensing examination.
Eight residency programs responded with AKT6 percentile scores and ABA part 1 first-time pass/fail status from 306 residents spanning 2004-2011. Of these, 292 also included AKT6% correct scores. AKT-6 performance was significantly better for trainees who went on to pass the ABA exam on their first attempt compared to those who failed. Trainees who scored at or below the 4(th) percentile (or answered ≤42% of questions correctly) failed the ABA exam while all those scoring above the 84(th) percentile (or answered >68% of questions correctly) passed. A Mantel-Haenszel common odds ratio estimate revealed significantly increased odds of failure below the thresholds of AKT-6 scores ≤ 36(th) percentile (≤56% correct).
Observations from this work help to validate educators' use of AKT-6 exam performance as a marker for likelihood of success/failure on the ABA written licensing exam. Our analysis, based on data from eight training programs, yielded definitive cut points for ABA exam failure and passing. ROC analysis of our data supports a recommendation for educators to intervene with trainees scoring at or below the 36(th) percentile or 56% correct on AKT-6 testing. Our results likely require confirmation in a larger subset of anesthesiology residency programs.
我们试图确定住院医师麻醉知识测试6（AKT - 6）成绩与他们在美国麻醉学委员会书面执照考试中的首次成功/失败之间的关系。可靠地早期识别有美国麻醉学委员会考试失败风险的住院医师，对于项目负责人而言将是一个非常有价值的筛选工具，并有助于为 struggling residents及时提供补救措施。
邀请项目主任提交关于其住院医师在AKT - 6考试中的表现以及他们随后在美国麻醉学委员会书面执照考试中的首次成功/失败的匿名数据。
八个住院医师培训项目提供了2004年至2011年期间306名住院医师的AKT6百分位分数和美国麻醉学委员会第一部分首次通过/未通过状态。其中，292份数据还包括AKT6%正确分数。与未通过的学员相比，首次通过美国麻醉学委员会考试的学员在AKT - 6考试中的表现明显更好。得分处于或低于第4百分位（或正确回答问题≤42%）的学员未通过美国麻醉学委员会考试，而所有得分高于第84百分位（或正确回答问题>68%）的学员都通过了考试。Mantel - Haenszel共同优势比估计显示，在AKT - 6分数≤第36百分位（≤56%正确）的阈值以下，失败的几率显著增加。
这项工作的观察结果有助于验证教育工作者将AKT - 6考试成绩作为美国麻醉学委员会书面执照考试成功/失败可能性的指标的使用。我们基于八个培训项目的数据进行的分析得出了美国麻醉学委员会考试失败和通过的明确切点。对我们数据的ROC分析支持教育工作者对在AKT - 6测试中得分处于或低于第36百分位或正确回答56%的学员进行干预的建议。我们的结果可能需要在更大的麻醉学住院医师培训项目子集中得到证实。
