Grüter Alexander A J, Toorenvliet Boudewijn R, Tanis Pieter J, Tuynman Jurriaan B
Department of Surgery, Amsterdam UMC location Vrije Universiteit Amsterdam, the Netherlands; Treatment and Quality of Life, Cancer Center Amsterdam, the Netherlands.
Department of Surgery, Ikazia Hospital, Rotterdam, the Netherlands.
Surgery. 2025 Feb;178:108951. doi: 10.1016/j.surg.2024.11.002. Epub 2024 Nov 30.
Recently, a competency assessment tool has been developed within the RIGHT project, a national quality improvement program for minimally invasive right hemicolectomy in patients with colon cancer. This study aimed to evaluate whether trained medical students can reliably evaluate minimally invasive right hemicolectomy videos using a competency assessment tool.
Nine expert colorectal surgeons, 13 trained medical students, and 17 untrained medical students assessed the surgical quality of 6 full-length minimally invasive right hemicolectomy videos with the competency assessment tool. The expert surgeons were trained using the competency assessment tool by the RIGHT project leaders, who were also involved in the development and validation of the competency assessment tool. Training for medical students included anatomy, step-by-step procedure explanation, and competency assessment tool review with 2 supervised video assessments. The untrained students were taught only anatomy and minimally invasive right hemicolectomy steps. The intraclass correlation coefficient was calculated to determine inter-rater reliability, and analysis of variance with the Bonferroni correction for multiple testing was used to assess potential differences between the groups per video.
The trained students demonstrated an overall excellent inter-rater reliability (intraclass correlation coefficient score of 0.885). When their scores were combined with those of the expert surgeons, a high inter-rater reliability was also demonstrated (intraclass correlation coefficient score of 0.945). Trained students consistently aligned with surgeons' mean total scores, also accurately identifying lower quality surgeries. Untrained students assigned statistically significantly higher scores to the 3 lower quality surgeries as compared with expert surgeons and trained students.
Among trained students, excellent inter-rater reliability and concordance with expert colorectal surgeons was found. The study highlights the potential to engage trained medical students for objective minimally invasive right hemicolectomy video assessment.
最近,在“直肠癌微创根治术质量改进全国性项目(RIGHT项目)”中开发了一种能力评估工具。本研究旨在评估经过培训的医学生能否使用该能力评估工具可靠地评估微创右半结肠切除术视频。
9名结直肠外科专家、13名经过培训的医学生和17名未经培训的医学生使用该能力评估工具对6段完整的微创右半结肠切除术视频的手术质量进行评估。结直肠外科专家由RIGHT项目负责人使用该能力评估工具进行培训,这些负责人也参与了该能力评估工具的开发和验证。医学生的培训内容包括解剖学、逐步手术过程讲解以及通过2次有监督的视频评估进行能力评估工具复习。未受过培训的学生仅学习了解剖学和微创右半结肠切除术步骤。计算组内相关系数以确定评分者间的可靠性,并使用经Bonferroni校正的方差分析进行多重检验,以评估每个视频组之间的潜在差异。
经过培训的学生表现出总体上极佳的评分者间可靠性(组内相关系数得分为0.885)。当他们的分数与结直肠外科专家的分数相结合时,也显示出较高的评分者间可靠性(组内相关系数得分为0.945)。经过培训的学生始终与外科医生的平均总分一致,也能准确识别质量较低的手术。与结直肠外科专家和经过培训的学生相比,未经培训的学生对3个质量较低的手术给出的分数在统计学上显著更高。
在经过培训的学生中,发现了极佳的评分者间可靠性以及与结直肠外科专家的一致性。该研究突出了让经过培训的医学生参与客观的微创右半结肠切除术视频评估的潜力。