Romo-Bucheli David, Seeböck Philipp, Orlando José Ignacio, Gerendas Bianca S, Waldstein Sebastian M, Schmidt-Erfurth Ursula, Bogunović Hrvoje
Christian Doppler Laboratory for Ophthalmic Image Analysis (OPTIMA), Department of Ophthalmology, Medical University of Vienna, Spitalgasse 23, 1090 Vienna, Austria.
Contributed equally.
Biomed Opt Express. 2019 Dec 20;11(1):346-363. doi: 10.1364/BOE.379978. eCollection 2020 Jan 1.
Diagnosis and treatment in ophthalmology depend on modern retinal imaging by optical coherence tomography (OCT). The recent staggering results of machine learning in medical imaging have inspired the development of automated segmentation methods to identify and quantify pathological features in OCT scans. These models need to be sensitive to image features defining patterns of interest, while remaining robust to differences in imaging protocols. A dominant factor for such image differences is the type of OCT acquisition device. In this paper, we analyze the ability of recently developed unsupervised unpaired image translations based on cycle consistency losses (cycleGANs) to deal with image variability across different OCT devices (Spectralis and Cirrus). This evaluation was performed on two clinically relevant segmentation tasks in retinal OCT imaging: fluid and photoreceptor layer segmentation. Additionally, a visual Turing test designed to assess the quality of the learned translation models was carried out by a group of 18 participants with different background expertise. Results show that the learned translation models improve the generalization ability of segmentation models to other OCT-vendors/domains not seen during training. Moreover, relationships between model hyper-parameters and the realism as well as the morphological consistency of the generated images could be identified.
眼科的诊断和治疗依赖于光学相干断层扫描(OCT)的现代视网膜成像技术。机器学习在医学成像领域最近取得的惊人成果激发了自动分割方法的发展,以识别和量化OCT扫描中的病理特征。这些模型需要对定义感兴趣模式的图像特征敏感,同时对成像协议的差异保持稳健性。造成这种图像差异的一个主要因素是OCT采集设备的类型。在本文中,我们分析了基于循环一致性损失(cycleGANs)的最新无监督非配对图像转换方法处理不同OCT设备(Spectralis和Cirrus)之间图像差异的能力。该评估针对视网膜OCT成像中的两项临床相关分割任务进行:液体和光感受器层分割。此外,一组18名具有不同背景专业知识的参与者进行了旨在评估所学转换模型质量的视觉图灵测试。结果表明,所学转换模型提高了分割模型对训练期间未见过的其他OCT供应商/领域的泛化能力。此外,可以确定模型超参数与生成图像的真实性以及形态一致性之间的关系。