DeBiasio Celina, Pageau Paul, Shefrin Allan, Woo Michael Y, Cheung Warren J
Division of Dermatology, Ottawa Hospital and University of Ottawa, Ottawa, ON, Canada.
Department of Emergency Medicine, University of Ottawa, Ottawa Hospital, 1053 Carling Avenue Ottawa, Ottawa, ON, Canada.
Ultrasound J. 2023 Jun 11;15(1):30. doi: 10.1186/s13089-023-00325-6.
Point-of-Care-Ultrasound (POCUS) curricula have rapidly expanded in undergraduate medical education (UME). However, the assessments used in UME remain variable without national standards. This scoping review characterizes and categorizes current assessment methods using Miller's pyramid for skills, performance, and competence of POCUS in UME. A structured protocol was developed using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR). A literature search of MEDLINE was performed from January 1, 2010, to June 15, 2021. Two independent reviewers screened all titles and abstracts for articles that met inclusion criteria. The authors included all POCUS UME publications in which POCUS-related knowledge, skills, or competence were taught and objectively assessed. Articles were excluded if there were no assessment methods used, if they exclusively used self-assessment of learned skills, were duplicate articles, or were summaries of other literature. Full text analysis and data extraction of included articles were performed by two independent reviewers. A consensus-based approach was used to categorize data and a thematic analysis was performed.
A total of 643 articles were retrieved and 157 articles met inclusion criteria for full review. Most articles (n = 132; 84%) used technical skill assessments including objective structured clinical examinations (n = 27; 17%), and/or other technical skill-based formats including image acquisition (n = 107; 68%). Retention was assessed in n = 98 (62%) studies. One or more levels of Miller's pyramid were included in 72 (46%) articles. A total of four articles (2.5%) assessed for students' integration of the skill into medical decision making and daily practice.
Our findings demonstrate a lack of clinical assessment in UME POCUS that focus on integration of skills in daily clinical practice of medical students corresponding to the highest level of Miller's Pyramid. There exists opportunities to develop and integrate assessment that evaluate higher level competencies of POCUS skills of medical students. A mixture of assessment methods that correspond to multiple levels of Miller's pyramid should be used to best assess POCUS competence in UME.
床旁超声(POCUS)课程在本科医学教育(UME)中迅速扩展。然而,UME中使用的评估方法仍然各不相同,缺乏国家标准。本范围综述使用米勒金字塔对UME中POCUS的技能、表现和能力的当前评估方法进行了特征描述和分类。使用系统评价和Meta分析扩展的首选报告项目(PRISMA-ScR)制定了结构化方案。对2010年1月1日至2021年6月15日期间的MEDLINE进行了文献检索。两名独立评审员筛选了所有标题和摘要,以查找符合纳入标准的文章。作者纳入了所有POCUS UME出版物,其中教授并客观评估了与POCUS相关的知识、技能或能力。如果未使用评估方法、仅使用所学技能的自我评估、为重复文章或为其他文献的摘要,则排除这些文章。两名独立评审员对纳入文章进行了全文分析和数据提取。采用基于共识的方法对数据进行分类,并进行了主题分析。
共检索到643篇文章,157篇文章符合全面审查的纳入标准。大多数文章(n = 132;84%)使用技术技能评估,包括客观结构化临床考试(n = 27;17%),和/或其他基于技术技能的形式,包括图像采集(n = 107;68%)。在n = 98(62%)项研究中评估了保留情况。72篇(46%)文章纳入了米勒金字塔的一个或多个层次。共有4篇文章(2.5%)评估了学生将技能整合到医疗决策和日常实践中的情况。
我们的研究结果表明,UME POCUS缺乏临床评估,即缺乏对应于米勒金字塔最高水平的、关注医学生在日常临床实践中技能整合的评估。存在开发和整合评估方法的机会,以评估医学生POCUS技能的更高水平能力。应使用对应于米勒金字塔多个层次的多种评估方法组合,以最佳评估UME中的POCUS能力。