Li Xibao, Ouyang Xi, Zhang Jiadong, Ding Zhongxiang, Zhang Yuyao, Xue Zhong, Shi Feng, Shen Dinggang
IEEE Trans Med Imaging. 2024 Dec;43(12):4483-4495. doi: 10.1109/TMI.2024.3424884. Epub 2024 Dec 2.
Medical image analysis poses significant challenges due to limited availability of clinical data, which is crucial for training accurate models. This limitation is further compounded by the specialized and labor-intensive nature of the data annotation process. For example, despite the popularity of computed tomography angiography (CTA) in diagnosing atherosclerosis with an abundance of annotated datasets, magnetic resonance (MR) images stand out with better visualization for soft plaque and vessel wall characterization. However, the higher cost and limited accessibility of MR, as well as time-consuming nature of manual labeling, contribute to fewer annotated datasets. To address these issues, we formulate a multi-modal transfer learning network, named MT-Net, designed to learn from unpaired CTA and sparsely-annotated MR data. Additionally, we harness the Segment Anything Model (SAM) to synthesize additional MR annotations, enriching the training process. Specifically, our method first segments vessel lumen regions followed by precise characterization of carotid artery vessel walls, thereby ensuring both segmentation accuracy and clinical relevance. Validation of our method involved rigorous experimentation on publicly available datasets from COSMOS and CARE-II challenge, demonstrating its superior performance compared to existing state-of-the-art techniques.
由于临床数据的可用性有限,医学图像分析面临重大挑战,而临床数据对于训练准确的模型至关重要。数据标注过程的专业性和劳动密集性进一步加剧了这一限制。例如,尽管计算机断层血管造影(CTA)在诊断动脉粥样硬化方面很受欢迎,有大量标注数据集,但磁共振(MR)图像在软斑块和血管壁特征的可视化方面表现出色。然而,MR的成本较高、可及性有限以及手动标注耗时,导致标注数据集较少。为了解决这些问题,我们制定了一个多模态迁移学习网络,名为MT-Net,旨在从未配对的CTA和稀疏标注的MR数据中学习。此外,我们利用分割一切模型(SAM)来合成额外的MR标注,丰富训练过程。具体来说,我们的方法首先分割血管腔区域,然后精确表征颈动脉血管壁,从而确保分割准确性和临床相关性。我们的方法经过在COSMOS和CARE-II挑战的公开可用数据集上的严格实验验证,证明了其与现有最先进技术相比的卓越性能。