Division of Gastroenterology, Department of Internal Medicine, Kosin University College of Medicine, Busan 602-702, South Korea.
World J Gastroenterol. 2017 Sep 14;23(34):6281-6286. doi: 10.3748/wjg.v23.i34.6281.
To determine the inter-observer variability for colon polyp morphology and to identify whether education can improve agreement among observers.
For purposes of the tests, we recorded colonoscopy video clips that included scenes visualizing the polyps. A total of 15 endoscopists and 15 nurses participated in the study. Participants watched 60 video clips of the polyp morphology scenes and then estimated polyp morphology (pre-test). After education for 20 min, participants performed a second test in which the order of 60 video clips was changed (post-test). To determine if the effectiveness of education was sustained, four months later, a third, follow-up test was performed with the same participants.
The overall Fleiss' kappa value of the inter-observer agreement was 0.510 in the pre-test, 0.618 in the post-test, and 0.580 in the follow-up test. The overall diagnostic accuracy of the estimation for polyp morphology in the pre-, post-, and follow-up tests was 0.662, 0.797, and 0.761, respectively. After education, the inter-observer agreement and diagnostic accuracy of all participants improved. However, after four months, the inter-observer agreement and diagnostic accuracy of expert groups were markedly decreased, and those of beginner and nurse groups remained similar to pre-test levels.
The education program used in this study can improve inter-observer agreement and diagnostic accuracy in assessing the morphology of colon polyps; it is especially effective when first learning endoscopy.
确定结肠息肉形态的观察者间变异性,并确定教育是否可以提高观察者之间的一致性。
为了进行测试,我们记录了包括息肉可视化场景的结肠镜检查视频片段。共有 15 名内镜医生和 15 名护士参与了这项研究。参与者观看了 60 个息肉形态场景的视频片段,然后估计息肉形态(预测试)。在接受 20 分钟的教育后,参与者进行了第二次测试,其中 60 个视频片段的顺序发生了变化(后测试)。为了确定教育的效果是否持续,四个月后,相同的参与者进行了第三次、随访测试。
预测试中观察者间一致性的总体 Fleiss'kappa 值为 0.510,后测试为 0.618,随访测试为 0.580。预测试、后测试和随访测试中,估计息肉形态的总体诊断准确性分别为 0.662、0.797 和 0.761。经过教育,所有参与者的观察者间一致性和诊断准确性都有所提高。然而,四个月后,专家组的观察者间一致性和诊断准确性明显下降,而初学者和护士组的则与预测试水平相似。
本研究中使用的教育计划可以提高评估结肠息肉形态的观察者间一致性和诊断准确性;尤其是在初次学习内镜时效果更为显著。