Cai Binke, Ma Liyan, Sun Yan
School of Computer Engineering and Science, Shanghai University, Shanghai, China.
Front Neurosci. 2023 Jun 26;17:1209132. doi: 10.3389/fnins.2023.1209132. eCollection 2023.
Unsupervised domain adaptation (UDA) aims to adapt a model learned from the source domain to the target domain. Thus, the model can obtain transferable knowledge even in target domain that does not have ground truth in this way. In medical image segmentation scenarios, there exist diverse data distributions caused by intensity in homogeneities and shape variabilities. But multi source data may not be freely accessible, especially medical images with patient identity information.
To tackle this issue, we propose a new multi-source and source-free (MSSF) application scenario and a novel domain adaptation framework where in the training stage, we only get access to the well-trained source domain segmentation models without source data. First, we propose a new dual consistency constraint which uses domain-intra and domain-inter consistency to filter those predictions agreed by each individual domain expert and all domain experts. It can serve as a high-quality pseudo label generation method and produce correct supervised signals for target domain supervised learning. Next, we design a progressive entropy loss minimization method to minimize the class-inter distance of features, which is beneficial to enhance domain-intra and domain-inter consistency in turn.
Extensive experiments are performed for retinal vessel segmentation under MSSF condition and our approach produces impressive performance. The sensitivity metric of our approach is highest and it surpasses other methods with a large margin.
It is the first attempt to conduct researches on the retinal vessel segmentation task under multi-source and source-free scenarios. In medical applications, such adaptation method can avoid the privacy issue. Furthermore, how to balance the high sensitivity and high accuracy need to be further considered.
无监督域适应(UDA)旨在使从源域学习的模型适应目标域。通过这种方式,即使在没有真实标签的目标域中,该模型也能获得可迁移的知识。在医学图像分割场景中,由于强度不均匀性和形状变异性会导致多种数据分布。但多源数据可能无法自由获取,尤其是包含患者身份信息的医学图像。
为解决此问题,我们提出了一种新的多源无源(MSSF)应用场景和一个新颖的域适应框架,在训练阶段,我们仅能访问经过良好训练的源域分割模型而无需源数据。首先,我们提出了一种新的双重一致性约束,它利用域内和域间一致性来筛选出每个领域专家以及所有领域专家都认可的预测结果。它可以作为一种高质量的伪标签生成方法,并为目标域监督学习产生正确的监督信号。接下来,我们设计了一种渐进熵损失最小化方法来最小化特征的类间距离,这反过来有利于增强域内和域间的一致性。
在MSSF条件下对视网膜血管分割进行了广泛的实验,我们的方法取得了令人印象深刻的性能。我们方法的灵敏度指标最高,并且以较大优势超过了其他方法。
这是首次在多源无源场景下对视网膜血管分割任务进行研究。在医学应用中,这种适应方法可以避免隐私问题。此外,如何平衡高灵敏度和高精度还需要进一步考虑。