• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

使用基于去噪的自监督学习对用于视网膜光学相干断层扫描(OCT)的3D图像分割模型进行预训练。

Pretraining of 3D image segmentation models for retinal OCT using denoising-based self-supervised learning.

作者信息

Rivail Antoine, Araújo Teresa, Schmidt-Erfurth Ursula, Bogunović Hrvoje

机构信息

Christian Doppler Lab for Artificial Intelligence in Retina, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, Austria.

Laboratory for Ophthalmic Image Analysis, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, Austria.

出版信息

Biomed Opt Express. 2024 Aug 2;15(9):5025-5040. doi: 10.1364/BOE.524603. eCollection 2024 Sep 1.

DOI:10.1364/BOE.524603
PMID:39296384
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11407261/
Abstract

Deep learning algorithms have allowed the automation of segmentation for many biomarkers in retinal OCTs, enabling comprehensive clinical research and precise patient monitoring. These segmentation algorithms predominantly rely on supervised training and specialised segmentation networks, such as U-Nets. However, they require segmentation annotations, which are challenging to collect and require specialized expertise. In this paper, we explore leveraging 3D self-supervised learning based on image restoration techniques, that allow to pretrain 3D networks with the aim of improving segmentation performance. We test two methods, based on image restoration and denoising. After pretraining on a large 3D OCT dataset, we evaluate our weights by fine-tuning them on two challenging fluid segmentation datasets utilising different amount of training data. The chosen methods are easy to set up while providing large improvements for fluid segmentation, enabling the reduction of the amount of required annotation or an increase in the performance. Overall, the best results were obtained for denoising-based SSL methods, with higher results on both fluid segmentation datasets as well as faster pretraining durations.

摘要

深度学习算法已实现了视网膜光学相干断层扫描(OCT)中许多生物标志物分割的自动化,从而能够进行全面的临床研究和精确的患者监测。这些分割算法主要依赖于监督训练和专门的分割网络,如U-Net。然而,它们需要分割注释,而这些注释收集起来具有挑战性,并且需要专业知识。在本文中,我们探索利用基于图像恢复技术的3D自监督学习,其目的是通过预训练3D网络来提高分割性能。我们测试了基于图像恢复和去噪的两种方法。在一个大型3D OCT数据集上进行预训练后,我们通过在两个具有挑战性的液体分割数据集上使用不同数量的训练数据对权重进行微调来评估我们的权重。所选方法易于设置,同时在液体分割方面有很大改进,能够减少所需注释的数量或提高性能。总体而言,基于去噪的自监督学习方法取得了最佳结果,在两个液体分割数据集上都有更高的结果,并且预训练持续时间更短。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/3cf2e3bf2ea6/boe-15-9-5025-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/69183580832b/boe-15-9-5025-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/89a16215f633/boe-15-9-5025-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/09672c9f3e73/boe-15-9-5025-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/4df3bc34ab7e/boe-15-9-5025-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/2c0ad69db6dc/boe-15-9-5025-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/22f33f7cdf80/boe-15-9-5025-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/774eebf473a1/boe-15-9-5025-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/53137464d21b/boe-15-9-5025-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/3cf2e3bf2ea6/boe-15-9-5025-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/69183580832b/boe-15-9-5025-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/89a16215f633/boe-15-9-5025-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/09672c9f3e73/boe-15-9-5025-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/4df3bc34ab7e/boe-15-9-5025-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/2c0ad69db6dc/boe-15-9-5025-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/22f33f7cdf80/boe-15-9-5025-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/774eebf473a1/boe-15-9-5025-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/53137464d21b/boe-15-9-5025-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11407261/3cf2e3bf2ea6/boe-15-9-5025-g009.jpg

相似文献

1
Pretraining of 3D image segmentation models for retinal OCT using denoising-based self-supervised learning.使用基于去噪的自监督学习对用于视网膜光学相干断层扫描(OCT)的3D图像分割模型进行预训练。
Biomed Opt Express. 2024 Aug 2;15(9):5025-5040. doi: 10.1364/BOE.524603. eCollection 2024 Sep 1.
2
Improving Data-Efficiency and Robustness of Medical Imaging Segmentation Using Inpainting-Based Self-Supervised Learning.使用基于图像修复的自监督学习提高医学图像分割的数据效率和鲁棒性
Bioengineering (Basel). 2023 Feb 4;10(2):207. doi: 10.3390/bioengineering10020207.
3
Self-supervised-RCNN for medical image segmentation with limited data annotation.用于医学图像分割的具有有限数据标注的自监督区域卷积神经网络
Comput Med Imaging Graph. 2023 Oct;109:102297. doi: 10.1016/j.compmedimag.2023.102297. Epub 2023 Sep 9.
4
Simultaneous alignment and surface regression using hybrid 2D-3D networks for 3D coherent layer segmentation of retinal OCT images with full and sparse annotations.使用混合 2D-3D 网络进行同时配准和曲面回归,实现全标注和稀疏标注的视网膜 OCT 图像三维相干层分割。
Med Image Anal. 2024 Jan;91:103019. doi: 10.1016/j.media.2023.103019. Epub 2023 Nov 4.
5
Semi-supervised abdominal multi-organ segmentation by object-redrawing.通过对象重绘实现半监督腹部多器官分割
Med Phys. 2024 Nov;51(11):8334-8347. doi: 10.1002/mp.17364. Epub 2024 Aug 21.
6
TSSK-Net: Weakly supervised biomarker localization and segmentation with image-level annotation in retinal OCT images.TSSK-Net:基于图像级标注的视网膜 OCT 图像弱监督生物标志物定位与分割。
Comput Biol Med. 2023 Feb;153:106467. doi: 10.1016/j.compbiomed.2022.106467. Epub 2022 Dec 21.
7
A modality-collaborative convolution and transformer hybrid network for unpaired multi-modal medical image segmentation with limited annotations.一种用于具有有限标注的未配对多模态医学图像分割的模态协作卷积与Transformer混合网络。
Med Phys. 2023 Sep;50(9):5460-5478. doi: 10.1002/mp.16338. Epub 2023 Mar 15.
8
Local contrastive loss with pseudo-label based self-training for semi-supervised medical image segmentation.基于伪标签自训练的局部对比损失的半监督医学图像分割。
Med Image Anal. 2023 Jul;87:102792. doi: 10.1016/j.media.2023.102792. Epub 2023 Mar 11.
9
Self-training adversarial learning for cross-domain retinal OCT fluid segmentation.用于跨域视网膜光学相干断层扫描液体分割的自训练对抗学习
Comput Biol Med. 2023 Mar;155:106650. doi: 10.1016/j.compbiomed.2023.106650. Epub 2023 Feb 10.
10
Enhancing diagnostic deep learning via self-supervised pretraining on large-scale, unlabeled non-medical images.通过在大规模无标签非医学图像上进行自监督预训练来增强诊断深度学习。
Eur Radiol Exp. 2024 Feb 8;8(1):10. doi: 10.1186/s41747-023-00411-3.

引用本文的文献

1
ISOSNet: a unified framework for cone photoreceptor detection and inner segment and outer segment length measurement from AO-OCT B-scans.ISOSNet:一种用于从自适应光学光学相干断层扫描(AO-OCT)B扫描中检测视锥光感受器以及测量内节和外节长度的统一框架。
Biomed Opt Express. 2025 Jul 17;16(8):3237-3254. doi: 10.1364/BOE.563128. eCollection 2025 Aug 1.

本文引用的文献

1
A foundation model for generalizable disease detection from retinal images.基于视网膜图像的通用疾病检测的基础模型。
Nature. 2023 Oct;622(7981):156-163. doi: 10.1038/s41586-023-06555-x. Epub 2023 Sep 13.
2
Performance of retinal fluid monitoring in OCT imaging by automated deep learning versus human expert grading in neovascular AMD.自动化深度学习与人类专家分级在新生血管性 AMD 的 OCT 成像中对视网膜液监测的性能比较。
Eye (Lond). 2023 Dec;37(18):3793-3800. doi: 10.1038/s41433-023-02615-8. Epub 2023 Jun 13.
3
Segmentation of Bruch's Membrane in Retinal OCT With AMD Using Anatomical Priors and Uncertainty Quantification.
利用解剖学先验知识和不确定性量化对患有年龄相关性黄斑变性(AMD)的视网膜光学相干断层扫描(OCT)中的布鲁赫膜进行分割
IEEE J Biomed Health Inform. 2023 Jan;27(1):41-52. doi: 10.1109/JBHI.2022.3217962. Epub 2023 Jan 4.
4
Self-supervised learning in medicine and healthcare.医学和医疗保健中的自我监督学习。
Nat Biomed Eng. 2022 Dec;6(12):1346-1352. doi: 10.1038/s41551-022-00914-1. Epub 2022 Aug 11.
5
Self-Supervised Learning for Few-Shot Medical Image Segmentation.基于自监督学习的少样本医学图像分割。
IEEE Trans Med Imaging. 2022 Jul;41(7):1837-1848. doi: 10.1109/TMI.2022.3150682. Epub 2022 Jun 30.
6
AI-based monitoring of retinal fluid in disease activity and under therapy.基于人工智能的视网膜液在疾病活动期及治疗过程中的监测
Prog Retin Eye Res. 2022 Jan;86:100972. doi: 10.1016/j.preteyeres.2021.100972. Epub 2021 Jun 22.
7
Fluid as a critical biomarker in neovascular age-related macular degeneration management: literature review and consensus recommendations.液体作为与年龄相关的新生血管性黄斑变性管理中的一个关键生物标志物:文献回顾和共识建议。
Eye (Lond). 2021 Aug;35(8):2119-2135. doi: 10.1038/s41433-021-01487-0. Epub 2021 Apr 1.
8
Models Genesis.模型起源。
Med Image Anal. 2021 Jan;67:101840. doi: 10.1016/j.media.2020.101840. Epub 2020 Oct 13.
9
Self-supervised learning for medical image analysis using image context restoration.基于图像上下文恢复的医学图像分析的自监督学习。
Med Image Anal. 2019 Dec;58:101539. doi: 10.1016/j.media.2019.101539. Epub 2019 Jul 26.
10
Hyper-reflective foci segmentation in SD-OCT retinal images with diabetic retinopathy using deep convolutional neural networks.基于深度卷积神经网络的糖尿病视网膜病变 SD-OCT 视网膜图像高反射病灶分割
Med Phys. 2019 Oct;46(10):4502-4519. doi: 10.1002/mp.13728. Epub 2019 Aug 22.