• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于卷积神经网络的微创手术视频中纱布检测与分割。

Gauze Detection and Segmentation in Minimally Invasive Surgery Video Using Convolutional Neural Networks.

机构信息

Instituto de las Tecnologías Avanzadas de la Producción (ITAP), Universidad de Valladolid, Paseo del Cauce 59, 47011 Valladolid, Spain.

Escuela Técnica Superior de Ingenieros Industriales, Universidad Politécnica de Madrid, Calle de José Gutiérrez Abascal, 2, 28006 Madrid, Spain.

出版信息

Sensors (Basel). 2022 Jul 11;22(14):5180. doi: 10.3390/s22145180.

DOI:10.3390/s22145180
PMID:35890857
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9319965/
Abstract

Medical instruments detection in laparoscopic video has been carried out to increase the autonomy of surgical robots, evaluate skills or index recordings. However, it has not been extended to surgical gauzes. Gauzes can provide valuable information to numerous tasks in the operating room, but the lack of an annotated dataset has hampered its research. In this article, we present a segmentation dataset with 4003 hand-labelled frames from laparoscopic video. To prove the dataset potential, we analyzed several baselines: detection using YOLOv3, coarse segmentation, and segmentation with a U-Net. Our results show that YOLOv3 can be executed in real time but provides a modest recall. Coarse segmentation presents satisfactory results but lacks inference speed. Finally, the U-Net baseline achieves a good speed-quality compromise running above 30 FPS while obtaining an IoU of 0.85. The accuracy reached by U-Net and its execution speed demonstrate that precise and real-time gauze segmentation can be achieved, training convolutional neural networks on the proposed dataset.

摘要

已经进行了腹腔镜视频中的医疗器械检测,以提高手术机器人的自主性、评估技能或索引记录。然而,它尚未扩展到手术纱布。纱布可以为手术室中的众多任务提供有价值的信息,但缺乏标注数据集阻碍了其研究。在本文中,我们提出了一个包含 4003 个腹腔镜视频手标记帧的分割数据集。为了证明数据集的潜力,我们分析了几个基线:使用 YOLOv3 进行检测、粗分割和使用 U-Net 进行分割。我们的结果表明,YOLOv3 可以实时执行,但召回率不高。粗分割的结果令人满意,但缺乏推理速度。最后,U-Net 基线在 30 FPS 以上运行时能够实现良好的速度-质量折衷,同时获得 0.85 的 IoU。U-Net 的准确性和执行速度表明,可以在提出的数据集上训练卷积神经网络,从而实现精确和实时的纱布分割。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/7bfd0c743cb7/sensors-22-05180-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/b078c48f5ff8/sensors-22-05180-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/ba2cd7a56abd/sensors-22-05180-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/7c92d11d963e/sensors-22-05180-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/13a543b2ce23/sensors-22-05180-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/cf3469d0b15e/sensors-22-05180-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/351cbae731f8/sensors-22-05180-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/fd5c340f1422/sensors-22-05180-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/7bfd0c743cb7/sensors-22-05180-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/b078c48f5ff8/sensors-22-05180-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/ba2cd7a56abd/sensors-22-05180-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/7c92d11d963e/sensors-22-05180-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/13a543b2ce23/sensors-22-05180-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/cf3469d0b15e/sensors-22-05180-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/351cbae731f8/sensors-22-05180-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/fd5c340f1422/sensors-22-05180-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ae10/9319965/7bfd0c743cb7/sensors-22-05180-g008.jpg

相似文献

1
Gauze Detection and Segmentation in Minimally Invasive Surgery Video Using Convolutional Neural Networks.基于卷积神经网络的微创手术视频中纱布检测与分割。
Sensors (Basel). 2022 Jul 11;22(14):5180. doi: 10.3390/s22145180.
2
Automatic gauze tracking in laparoscopic surgery using image texture analysis.利用图像纹理分析实现腹腔镜手术中的自动纱布跟踪。
Comput Methods Programs Biomed. 2020 Jul;190:105378. doi: 10.1016/j.cmpb.2020.105378. Epub 2020 Feb 4.
3
Detection, segmentation, and 3D pose estimation of surgical tools using convolutional neural networks and algebraic geometry.使用卷积神经网络和代数几何进行手术工具的检测、分割和三维姿态估计。
Med Image Anal. 2021 May;70:101994. doi: 10.1016/j.media.2021.101994. Epub 2021 Feb 7.
4
A novel adaptive cubic quasi-Newton optimizer for deep learning based medical image analysis tasks, validated on detection of COVID-19 and segmentation for COVID-19 lung infection, liver tumor, and optic disc/cup.一种用于深度学习的新型自适应三次拟牛顿优化器,在 COVID-19 检测和 COVID-19 肺部感染、肝脏肿瘤以及视盘/杯分割等医学图像分析任务中得到验证。
Med Phys. 2023 Mar;50(3):1528-1538. doi: 10.1002/mp.15969. Epub 2022 Oct 6.
5
Convolutional neural network for automated mass segmentation in mammography.卷积神经网络在乳腺 X 线摄影中用于自动肿块分割。
BMC Bioinformatics. 2020 Dec 9;21(Suppl 1):192. doi: 10.1186/s12859-020-3521-y.
6
CAM-Wnet: An effective solution for accurate pulmonary embolism segmentation.CAM-Wnet:一种用于准确肺栓塞分割的有效解决方案。
Med Phys. 2022 Aug;49(8):5294-5303. doi: 10.1002/mp.15719. Epub 2022 Jun 21.
7
CheXLocNet: Automatic localization of pneumothorax in chest radiographs using deep convolutional neural networks.CheXLocNet:使用深度卷积神经网络自动定位胸部 X 光片中的气胸。
PLoS One. 2020 Nov 9;15(11):e0242013. doi: 10.1371/journal.pone.0242013. eCollection 2020.
8
Catheter segmentation in X-ray fluoroscopy using synthetic data and transfer learning with light U-nets.基于合成数据和轻量级 U 型网络的迁移学习在 X 射线透视下的导管分割
Comput Methods Programs Biomed. 2020 Aug;192:105420. doi: 10.1016/j.cmpb.2020.105420. Epub 2020 Feb 29.
9
A Lightweight Convolutional Neural Network Based on Dynamic Level-Set Loss Function for Spine MR Image Segmentation.基于动态水平集损失函数的轻量化卷积神经网络在脊柱磁共振图像分割中的应用。
J Magn Reson Imaging. 2024 Apr;59(4):1438-1453. doi: 10.1002/jmri.28877. Epub 2023 Jun 29.
10
Accuracy of automated segmentation and volumetry of acute intracerebral hemorrhage following minimally invasive surgery using a patch-based convolutional neural network in a small dataset.基于小块卷积神经网络的微创手术后急性脑出血自动分割与体积测量在小数据集中的准确性
Neuroradiology. 2024 Apr;66(4):601-608. doi: 10.1007/s00234-024-03311-4. Epub 2024 Feb 17.

引用本文的文献

1
Intraoperative detection of parathyroid glands using artificial intelligence: optimizing medical image training with data augmentation methods.术中使用人工智能检测甲状旁腺:使用数据增强方法优化医学图像训练。
Surg Endosc. 2024 Oct;38(10):5732-5745. doi: 10.1007/s00464-024-11115-z. Epub 2024 Aug 13.
2
Real-Time Tool Localization for Laparoscopic Surgery Using Convolutional Neural Network.基于卷积神经网络的腹腔镜手术实时工具定位
Sensors (Basel). 2024 Jun 27;24(13):4191. doi: 10.3390/s24134191.
3
Minimization of occurrence of retained surgical items using machine learning and deep learning techniques: a review.

本文引用的文献

1
A deep learning framework for real-time 3D model registration in robot-assisted laparoscopic surgery.机器人辅助腹腔镜手术中实时 3D 模型配准的深度学习框架。
Int J Med Robot. 2022 Jun;18(3):e2387. doi: 10.1002/rcs.2387. Epub 2022 Mar 13.
2
Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations.广义骰子重叠作为高度不平衡分割的深度学习损失函数
Deep Learn Med Image Anal Multimodal Learn Clin Decis Support (2017). 2017;2017:240-248. doi: 10.1007/978-3-319-67558-9_28. Epub 2017 Sep 9.
3
Automatic gauze tracking in laparoscopic surgery using image texture analysis.
使用机器学习和深度学习技术减少手术遗留物品的发生:综述
BioData Min. 2024 Jun 18;17(1):17. doi: 10.1186/s13040-024-00367-z.
4
Interactive 3D Force/Torque Parameter Acquisition and Correlation Identification during Primary Trocar Insertion in Laparoscopic Abdominal Surgery: 5 Cases.腹腔镜腹部手术中主套管插入过程中的交互 3D 力/扭矩参数采集和相关识别:5 例。
Sensors (Basel). 2022 Nov 19;22(22):8970. doi: 10.3390/s22228970.
利用图像纹理分析实现腹腔镜手术中的自动纱布跟踪。
Comput Methods Programs Biomed. 2020 Jul;190:105378. doi: 10.1016/j.cmpb.2020.105378. Epub 2020 Feb 4.
4
SurgAI: deep learning for computerized laparoscopic image understanding in gynaecology.SurgAI:妇科腹腔镜图像计算机理解的深度学习。
Surg Endosc. 2020 Dec;34(12):5377-5383. doi: 10.1007/s00464-019-07330-8. Epub 2020 Jan 29.
5
Multi-task recurrent convolutional network with correlation loss for surgical video analysis.基于相关损失的多任务递归卷积网络在手术视频分析中的应用。
Med Image Anal. 2020 Jan;59:101572. doi: 10.1016/j.media.2019.101572. Epub 2019 Oct 10.
6
Accurate and interpretable evaluation of surgical skills from kinematic data using fully convolutional neural networks.使用全卷积神经网络从运动学数据中准确且可解释地评估手术技能。
Int J Comput Assist Radiol Surg. 2019 Sep;14(9):1611-1617. doi: 10.1007/s11548-019-02039-4. Epub 2019 Jul 30.
7
Video-based surgical skill assessment using 3D convolutional neural networks.基于视频的三维卷积神经网络手术技能评估。
Int J Comput Assist Radiol Surg. 2019 Jul;14(7):1217-1225. doi: 10.1007/s11548-019-01995-1. Epub 2019 May 18.
8
Segmenting and classifying activities in robot-assisted surgery with recurrent neural networks.使用递归神经网络对机器人辅助手术中的活动进行分割和分类。
Int J Comput Assist Radiol Surg. 2019 Nov;14(11):2005-2020. doi: 10.1007/s11548-019-01953-x. Epub 2019 Apr 29.
9
Objective assessment of intraoperative technical skill in capsulorhexis using videos of cataract surgery.使用白内障手术视频对晶状体囊外切除术的术中技术技能进行客观评估。
Int J Comput Assist Radiol Surg. 2019 Jun;14(6):1097-1105. doi: 10.1007/s11548-019-01956-8. Epub 2019 Apr 11.
10
A guide to deep learning in healthcare.深度学习在医疗保健中的应用指南。
Nat Med. 2019 Jan;25(1):24-29. doi: 10.1038/s41591-018-0316-z. Epub 2019 Jan 7.