is Director for Educational Development, Department of Internal Medicine, University of Iowa Hospitals and Clinics, Iowa City, Iowa, USA.
is Lead Application Developer, Health Care Information Systems, University of Iowa Hospitals and Clinics, Iowa City, Iowa, USA; and.
J Grad Med Educ. 2024 Apr;16(2):221-226. doi: 10.4300/JGME-D-23-00378.1. Epub 2024 Apr 15.
An easy-to-use application to facilitate direct observation and allow for 2-way feedback between residents and faculty is needed. To develop a mobile-based application (app) with the goals of (1) providing just-in-time feedback to residents; (2) improving timeliness of feedback by faculty; and (3) allowing residents to comment on the value of faculty feedback. Fifty-one of 69 (74%) internal medicine (IM) residents and 20 of 25 (80%) IM core faculty participated in the study from July 1, 2020, to December 31, 2021. An iOS app was designed by authors with expertise in medical education and application development to capture entrustable professional activities (EPAs)-based feedback (eg, informed consent) based on direct observation of residents' skills in the workplace. App utilization and narrative feedback characteristics of faculty comments were examined by exporting the data from the database server. The end user satisfaction was examined using a survey instrument. Eighty-seven percent of assessments (117 of 134) initiated were fully completed by residents and faculty. Faculty narrative comments were noted in 97% (114 of 117) of completed assessments and 64% (75 of 117) of residents' feedback to the faculty contained narrative comments. Eighty-three percent (97 of 117) of comments were behaviorally specific and 71% (83 of 117) contained an actionable item. Eighty-six percent (18 of 21) of residents and 90% (9 of 10) of core faculty stated that this application promoted an educational interaction between them. This app facilitates the efficient completion of EPA-based formative assessments and captures bidirectional feedback in the workplace setting.
需要开发一个易于使用的应用程序，以促进居民和教师之间的直接观察和双向反馈。本研究旨在开发一个基于移动设备的应用程序，以实现以下三个目标：（1）为居民提供及时反馈；（2）提高教师反馈的及时性；（3）允许居民对教师反馈的价值发表意见。2020 年 7 月 1 日至 2021 年 12 月 31 日，69 名内科住院医师中有 51 名（74%）和 25 名内科核心教师中有 20 名（80%）参与了这项研究。作者具有医学教育和应用程序开发方面的专业知识，设计了一个 iOS 应用程序，用于根据居民在工作场所技能的直接观察，捕捉基于可委托专业活动（EPA）的反馈（例如，知情同意）。通过从数据库服务器导出数据，检查了教师评论的应用程序使用情况和叙述反馈特征。使用问卷调查工具检查了最终用户的满意度。87%（117/134）启动的评估由居民和教师完全完成。在完成的评估中，97%（114/117）记录了教师的叙述性评论，在居民对教师的反馈中，64%（75/117）包含叙述性评论。83%（117/117）的评论是具体行为的，71%（117/117）包含可操作的项目。86%（18/21）的居民和 90%（9/10）的核心教师表示，该应用程序促进了他们之间的教育互动。该应用程序促进了基于 EPA 的形成性评估的高效完成，并在工作场所环境中捕获了双向反馈。
