Rivail Antoine, Araújo Teresa, Schmidt-Erfurth Ursula, Bogunović Hrvoje
Christian Doppler Lab for Artificial Intelligence in Retina, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, Austria.
Laboratory for Ophthalmic Image Analysis, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, Austria.
Biomed Opt Express. 2024 Aug 2;15(9):5025-5040. doi: 10.1364/BOE.524603. eCollection 2024 Sep 1.
Deep learning algorithms have allowed the automation of segmentation for many biomarkers in retinal OCTs, enabling comprehensive clinical research and precise patient monitoring. These segmentation algorithms predominantly rely on supervised training and specialised segmentation networks, such as U-Nets. However, they require segmentation annotations, which are challenging to collect and require specialized expertise. In this paper, we explore leveraging 3D self-supervised learning based on image restoration techniques, that allow to pretrain 3D networks with the aim of improving segmentation performance. We test two methods, based on image restoration and denoising. After pretraining on a large 3D OCT dataset, we evaluate our weights by fine-tuning them on two challenging fluid segmentation datasets utilising different amount of training data. The chosen methods are easy to set up while providing large improvements for fluid segmentation, enabling the reduction of the amount of required annotation or an increase in the performance. Overall, the best results were obtained for denoising-based SSL methods, with higher results on both fluid segmentation datasets as well as faster pretraining durations.
深度学习算法已实现了视网膜光学相干断层扫描(OCT)中许多生物标志物分割的自动化,从而能够进行全面的临床研究和精确的患者监测。这些分割算法主要依赖于监督训练和专门的分割网络,如U-Net。然而,它们需要分割注释,而这些注释收集起来具有挑战性,并且需要专业知识。在本文中,我们探索利用基于图像恢复技术的3D自监督学习,其目的是通过预训练3D网络来提高分割性能。我们测试了基于图像恢复和去噪的两种方法。在一个大型3D OCT数据集上进行预训练后,我们通过在两个具有挑战性的液体分割数据集上使用不同数量的训练数据对权重进行微调来评估我们的权重。所选方法易于设置,同时在液体分割方面有很大改进,能够减少所需注释的数量或提高性能。总体而言,基于去噪的自监督学习方法取得了最佳结果,在两个液体分割数据集上都有更高的结果,并且预训练持续时间更短。