From the Department of Pathology, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, Massachusetts (Haspel).
The Centre for Tumour Biology, Barts Cancer Institute, Queen Mary University of London, Charterhouse Square, London, United Kingdom (Jones).
Arch Pathol Lab Med. 2021 Apr 1;145(4):453-456. doi: 10.5858/arpa.2020-0038-OA.
CONTEXT.—: There is a clear need to educate health professionals in genomic medicine. Pathologists, given their critical role in cancer diagnostics, must understand core concepts in genomic oncology. Although high-quality evaluation is a cornerstone of medical education, to our knowledge a rigorously validated genomic oncology assessment tool has not been published.
OBJECTIVE.—: To develop and validate a genomic oncology exam.
DESIGN.—: A previously developed exam was updated and validated using 3 approaches: pretesting/posttesting in relation to a live genomic pathology workshop; comparison of scores of individuals at a priori defined knowledge levels; and use of Rasch analysis. This last approach is used in high-stakes testing, such as licensing exams. The exam included both knowledge-based as well as skills-based questions related to the use of online genomics tools.
RESULTS.—: There was a significant difference in exam scores preworkshop and postworkshop (37.5% to 75%; P < .001). Individuals at a priori defined beginner, intermediate, and expert levels scored 35%, 58%, and 89%, respectively (P < .001). Rasch analysis demonstrated excellent fit and reliability and led to further exam refinement with the removal of 2 questions deemed unnecessary for assessment.
CONCLUSIONS.—: A rigorously validated exam has now been created to assess pathologist genomic oncology knowledge and skills. The exam can be used to assess both individual learners as well as educational interventions. The exam may also be applicable to other specialties involved in genomic-based cancer care.
在基因组医学领域,对卫生专业人员进行教育是非常有必要的。由于病理学家在癌症诊断方面发挥着至关重要的作用,因此他们必须理解肿瘤基因组学的核心概念。尽管高质量的评估是医学教育的基石,但据我们所知,尚未发布经过严格验证的肿瘤基因组学评估工具。
开发和验证肿瘤基因组学考试。
使用 3 种方法对之前开发的考试进行了更新和验证:与现场基因组病理学研讨会相关的预测试/后测试;比较具有既定知识水平的个体的分数;以及使用 Rasch 分析。这种方法最后用于具有高风险的考试,例如执照考试。考试包括与使用在线基因组学工具相关的基于知识和技能的问题。
在研讨会前和研讨会后,考试成绩有显著差异(从 37.5%到 75%;P<0.001)。预先定义的初学者、中级和专家水平的个体分别得分 35%、58%和 89%(P<0.001)。Rasch 分析显示出极好的拟合度和可靠性,并通过删除 2 个被认为对评估不必要的问题进一步改进了考试。
现在已经创建了一个严格验证的考试来评估病理学家的肿瘤基因组学知识和技能。该考试可用于评估个体学习者以及教育干预措施。该考试也可能适用于涉及基于基因组的癌症护理的其他专业。