Department of Medicine, Division of Physical Medicine & Rehabilitation, University of Ottawa, Ottawa, Canada.
Department of Innovation in Medical Education, University of Ottawa, Ottawa, Canada.
BMC Med Educ. 2024 May 2;24(1):487. doi: 10.1186/s12909-024-05476-1.
Workplace-based assessment (WBA) used in post-graduate medical education relies on physician supervisors' feedback. However, in a training environment where supervisors are unavailable to assess certain aspects of a resident's performance, nurses are well-positioned to do so. The Ottawa Resident Observation Form for Nurses (O-RON) was developed to capture nurses' assessment of trainee performance and results have demonstrated strong evidence for validity in Orthopedic Surgery. However, different clinical settings may impact a tool's performance. This project studied the use of the O-RON in three different specialties at the University of Ottawa.
O-RON forms were distributed on Internal Medicine, General Surgery, and Obstetrical wards at the University of Ottawa over nine months. Validity evidence related to quantitative data was collected. Exit interviews with nurse managers were performed and content was thematically analyzed.
179 O-RONs were completed on 30 residents. With four forms per resident, the ORON's reliability was 0.82. Global judgement response and frequency of concerns was correlated (r = 0.627, P < 0.001).
Consistent with the original study, the findings demonstrated strong evidence for validity. However, the number of forms collected was less than expected. Exit interviews identified factors impacting form completion, which included clinical workloads and interprofessional dynamics.
在研究生医学教育中使用的基于工作场所的评估（WBA）依赖于医师主管的反馈。然而，在培训环境中，主管无法评估居民表现的某些方面，护士则可以很好地胜任这项工作。渥太华护士观察住院医师表格（O-RON）是为了捕捉护士对学员表现的评估而开发的，其在骨科手术方面的有效性已得到强有力的证据支持。然而，不同的临床环境可能会影响工具的性能。本项目研究了在渥太华大学的三个不同专业中使用 O-RON 的情况。
在渥太华大学的内科、普通外科和产科病房中，在九个月的时间里分发了 O-RON 表格。收集了与定量数据相关的有效性证据。对护士经理进行了离职访谈，并对内容进行了主题分析。
共完成了 30 名住院医师的 179 份 O-RON 表格。每位住院医师有四份表格，O-RON 的可靠性为 0.82。总体判断反应和关注频率呈相关关系（r=0.627，P<0.001）。
与原始研究一致，研究结果为有效性提供了强有力的证据。然而，收集的表格数量低于预期。离职访谈确定了影响表格完成的因素，包括临床工作量和跨专业动态。
