Reifenstahl Erik, Cervero Ronald M, Soh Michael
Fort Bragg DENTAC, Advanced Education in General Dentistry 2-Year, Bldg. B6837 Normandy Drive, Fort Bragg, NC 28310, United States.
Department of Health Professions Education, F. Edward Hebert School of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814, United States.
Mil Med. 2025 Jul 1;190(Supplement_1):51-57. doi: 10.1093/milmed/usaf204.
In this project, we developed a clinical assessment tool (CAT) for use in an Advanced Education in General Dentistry (AEGD) 2-year Program. The tool was designed in a practical and accessible way to help provide formative assessment data with the goal of helping residents self-regulate their learning.
Assessments were recorded using a tailored Google Form and compiled using Google Sheets, allowing for immediate use, access, and review. The structure of the tool was centered around 2 domains-clinical procedures and core skills-with an additional section for narrative comments. Feedback from direct observation relied on both quantitative and qualitative items based on observations from the mentor/instructor as well as the resident. The mentor's and learner's assessments were paired after being completed for comparison review by both parties. Narrative comments were also reviewed for content and quality. Feedback from the residents was gathered periodically via quarterly evaluation meetings and surveys regarding how they use the CAT and its perceived usefulness.
The first iteration of the CAT went live in August 2023. Data from August 2023 to March 2024 is included in this study. We collected 301 assessments, 175 from the PGY-1 group and 126 from the PGY-2 group. Although we had 100% participation, we found a wide variation in the rate of usage among the residents. Augmented by mentor feedback, our findings, particularly from the narrative comments, point to ongoing yet preliminary monitoring and reflection of clinical performance-key elements of the self-regulated learning cycle. Initial review of CAT feedback showed an overall favorable response to the CAT and included several suggested improvements such as systematic reminders to use the CAT.
This project demonstrated an integrated and accessible method for collecting and disseminating feedback from clinical observation of dental residents. Residents participated in regular self-assessment and, in combination with regular mentor feedback, were provided with timely and relevant feedback regarding their performance of clinical procedures. This is an important step in promoting self-regulated learning and preparing learners for lifelong learning. A second version of the CAT, building on suggested improvements and feedback, will continue in Fall 2024.
在本项目中,我们开发了一种临床评估工具(CAT),用于为期两年的普通牙科高级教育(AEGD)项目。该工具的设计实用且易于使用,旨在帮助提供形成性评估数据,以帮助住院医师自我调节学习。
使用定制的谷歌表单记录评估,并使用谷歌表格进行汇总,以便立即使用、访问和审查。该工具的结构围绕两个领域——临床操作和核心技能——以及一个用于叙述性评论的附加部分。直接观察的反馈基于导师/教师以及住院医师的观察,包括定量和定性项目。导师和学习者的评估在完成后配对,供双方进行比较审查。还对叙述性评论的内容和质量进行了审查。通过季度评估会议和关于他们如何使用CAT及其感知有用性的调查,定期收集住院医师的反馈。
CAT的第一个版本于2023年8月上线。本研究纳入了2023年8月至2024年3月的数据。我们收集了301份评估,其中175份来自PGY - 1组,126份来自PGY - 2组。尽管参与率为100%,但我们发现住院医师之间的使用率差异很大。在导师反馈的补充下,我们的发现,特别是来自叙述性评论的发现,指出了对临床绩效的持续但初步的监测和反思——这是自我调节学习周期的关键要素。对CAT反馈的初步审查显示,对CAT总体反应良好,并包括一些建议的改进,如使用CAT的系统提醒。
本项目展示了一种综合且易于使用的方法,用于收集和传播来自牙科住院医师临床观察的反馈。住院医师参与定期自我评估,并结合定期的导师反馈,获得关于其临床操作表现的及时和相关反馈。这是促进自我调节学习并使学习者为终身学习做好准备的重要一步。基于建议的改进和反馈,CAT的第二个版本将于2024年秋季继续使用。