School of Computer Science and Technology, Xi'an University of Posts and Telecommunications, GuoDu, Xi'an, 710121, Shaanxi, China.
School of Software, Northwestern Polytechnical University, Xi'an, 710072, China.
Int J Comput Assist Radiol Surg. 2024 Nov;19(11):2215-2225. doi: 10.1007/s11548-024-03115-0. Epub 2024 Apr 13.
Accurately locating and analysing surgical instruments in laparoscopic surgical videos can assist doctors in postoperative quality assessment. This can provide patients with more scientific and rational solutions for healing surgical complications. Therefore, we propose an end-to-end algorithm for the detection of surgical instruments.
Dual-Branched Head (DBH) and Overall Intersection over Union Loss (OIoU Loss) are introduced to solve the problem of inaccurate surgical instrument detection, both in terms of localization and classification. An effective method (DBHYOLO) for the detection for laparoscopic surgery in complex scenarios is proposed. This study manually annotates a new laparoscopic gastric cancer resection surgical instrument location dataset LGIL, which provides a better validation platform for surgical instrument detection methods.
The proposed method's performance was tested using the m2cai16-tool-locations, LGIL, and Onyeogulu datasets. The mean Average Precision (mAP) values obtained were 96.8%, 95.6%, and 98.4%, respectively, which were higher than the other classical models compared. The improved model is more effective than the benchmark network in distinguishing between surgical instrument classes with high similarity and avoiding too many missed detection cases.
In this paper, the problem of inaccurate detection of surgical instruments is addressed from two different perspectives: classification and localization. And the experimental results on three representative datasets verify the performance of DBH-YOLO. It is shown that this method has a good generalization capability.
准确地定位和分析腹腔镜手术视频中的手术器械,可以帮助医生进行术后质量评估。这可以为患者提供更科学、更合理的治疗手术并发症的解决方案。因此,我们提出了一种用于手术器械检测的端到端算法。
引入双分支头(DBH)和整体交并比损失(OIoU Loss),以解决手术器械检测在定位和分类方面不准确的问题。提出了一种用于复杂场景下腹腔镜手术的有效检测方法(DBHYOLO)。本研究手动注释了一个新的腹腔镜胃癌切除手术器械定位数据集 LGIL,为手术器械检测方法提供了更好的验证平台。
使用 m2cai16-tool-locations、LGIL 和 Onyeogulu 数据集测试了所提出方法的性能。分别获得的平均精度(mAP)值为 96.8%、95.6%和 98.4%,均高于其他经典模型。改进后的模型在区分具有高度相似性的手术器械类别和避免过多漏检方面比基准网络更有效。
本文从分类和定位两个不同的角度解决了手术器械检测不准确的问题。并在三个具有代表性的数据集上的实验结果验证了 DBH-YOLO 的性能。结果表明,该方法具有良好的泛化能力。