Department of Health Sciences, Faculty of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-ku, Fukuoka-shi, Fukuoka, 812-8582, Japan.
Department of Radiological Technology, Hyogo Medical University Hospital, Kobe, Japan.
Int J Comput Assist Radiol Surg. 2023 Aug;18(8):1459-1467. doi: 10.1007/s11548-022-02816-8. Epub 2022 Dec 30.
Although a novel deep learning software was proposed using post-processed images obtained by the fusion between X-ray images of normal post-operative radiography and surgical sponge, the association of the retained surgical item detectability with human visual evaluation has not been sufficiently examined. In this study, we investigated the association of retained surgical item detectability between deep learning and human subjective evaluation.
A deep learning model was constructed from 2987 training images and 1298 validation images, which were obtained from post-processing of the image fusion between X-ray images of normal post-operative radiography and surgical sponge. Then, another 800 images were used, i.e., 400 with and 400 without surgical sponge. The detection characteristics of retained sponges between the model and a general observer with 10-year clinical experience were analyzed using the receiver operator characteristics.
The following values from the deep learning model and observer were, respectively, derived: Cutoff values of probability were 0.37 and 0.45; areas under the curves were 0.87 and 0.76; sensitivity values were 85% and 61%; and specificity values were 73% and 92%.
For the detection of surgical sponges, we concluded that the deep learning model has higher sensitivity, while the human observer has higher specificity. These characteristics indicate that the deep learning system that is complementary to humans could support the clinical workflow in operation rooms for prevention of retained surgical items.
尽管提出了一种新的深度学习软件,该软件使用正常术后射线照相和手术海绵的 X 射线图像融合后的后处理图像,但保留手术物品的可检测性与人类视觉评估之间的关联尚未得到充分检查。在这项研究中,我们调查了深度学习和人类主观评估之间保留手术物品可检测性的关联。
从正常术后射线照相和手术海绵的图像融合后的后处理图像中获取 2987 个训练图像和 1298 个验证图像,构建了深度学习模型。然后,使用另外 800 个图像,即 400 个有手术海绵和 400 个没有手术海绵的图像。使用受试者工作特征分析模型和具有 10 年临床经验的普通观察者之间保留海绵的检测特征。
从深度学习模型和观察者分别得出以下值:概率的截断值分别为 0.37 和 0.45;曲线下面积分别为 0.87 和 0.76;灵敏度值分别为 85%和 61%;特异性值分别为 73%和 92%。
对于手术海绵的检测,我们得出结论,深度学习模型具有更高的灵敏度,而人类观察者具有更高的特异性。这些特征表明,深度学习系统可以补充人类,支持手术室中预防遗留手术物品的临床工作流程。