School of Health and Rehabilitation Sciences, The University of Queensland, St. Lucia, Qld, Australia.
School of Dentistry, The University of Queensland, St. Lucia, Qld, Australia.
J Interprof Care. 2023 Mar-Apr;37(2):223-231. doi: 10.1080/13561820.2022.2052270. Epub 2022 Apr 11.
This paper explores the development and evaluation of the video Observation Tool for Interprofessional Skills (VOTIS). We describe the development of an authentic interprofessional assessment tool that incorporates video reflection and allows formative and summative assessment of individual learners' interprofessional skills within an authentic interprofessional context. We then investigate its validity and reliability. The VOTIS was developed using a modified Delphi technique. The tool was piloted with 61 students and 11 clinical educators who completed the VOTIS following team meetings where students interacted about their interprofessional clinical work. The following were calculated: internal consistency; students' proficiency levels; inter-rater reliability between students and clinical educators; and inter-rater reliability between clinical educators and an independent rater. Results indicate that the VOTIS has acceptable internal consistency and moderate reliability and has value in evaluating students' interprofessional skills. Study outcomes highlight the need for more explicit wording of tool content and instructions and further clinical educator training to increase the utility and reliability of the VOTIS as a learning and assessment tool.
本文探讨了视频观察工具(VOTIS)在跨专业技能评估中的开发和评估。我们描述了一种真实的跨专业评估工具的开发,该工具结合了视频反思,并允许对个体学习者在真实的跨专业背景下的跨专业技能进行形成性和总结性评估。然后,我们调查了它的有效性和可靠性。VOTIS 使用经过修改的 Delphi 技术开发。该工具在 61 名学生和 11 名临床教育者中进行了试点,他们在学生就其跨专业临床工作进行互动的团队会议后完成了 VOTIS。以下是计算结果:内部一致性;学生的熟练水平;学生和临床教育者之间的评分者间可靠性;以及临床教育者和独立评分者之间的评分者间可靠性。结果表明,VOTIS 具有可接受的内部一致性和中等可靠性,并且在评估学生的跨专业技能方面具有价值。研究结果强调需要更明确的工具内容和说明,并进一步对临床教育者进行培训,以提高 VOTIS 作为学习和评估工具的实用性和可靠性。