School of Integrated Circuits and Electronics, Beijing Institute of Technology, Beijing, China.
Department of Radiology, Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University, Beijing, China.
Neuroimage. 2024 Oct 1;299:120812. doi: 10.1016/j.neuroimage.2024.120812. Epub 2024 Aug 27.
Brain magnetic resonance imaging (MRI) is widely used in clinical practice for disease diagnosis. However, MRI scans acquired at different sites can have different appearances due to the difference in the hardware, pulse sequence, and imaging parameter. It is important to reduce or eliminate such cross-site variations with brain MRI harmonization so that downstream image processing and analysis is performed consistently. Previous works on the harmonization problem require the data acquired from the sites of interest for model training. But in real-world scenarios there can be test data from a new site of interest after the model is trained, and training data from the new site is unavailable when the model is trained. In this case, previous methods cannot optimally handle the test data from the new unseen site. To address the problem, in this work we explore domain generalization for brain MRI harmonization and propose Site Mix (SiMix). We assume that images of travelling subjects are acquired at a few existing sites for model training. To allow the training data to better represent the test data from unseen sites, we first propose to mix the training images belonging to different sites stochastically, which substantially increases the diversity of the training data while preserving the authenticity of the mixed training images. Second, at test time, when a test image from an unseen site is given, we propose a multiview strategy that perturbs the test image with preserved authenticity and ensembles the harmonization results of the perturbed images for improved harmonization quality. To validate SiMix, we performed experiments on the publicly available SRPBS dataset and MUSHAC dataset that comprised brain MRI acquired at nine and two different sites, respectively. The results indicate that SiMix improves brain MRI harmonization for unseen sites, and it is also beneficial to the harmonization of existing sites.
脑磁共振成像(MRI)广泛应用于临床疾病诊断。然而,由于硬件、脉冲序列和成像参数的不同,不同部位采集的 MRI 扫描图像可能会有所不同。通过脑 MRI 匀场,可以减少或消除这种跨部位差异,从而实现一致的下游图像处理和分析。之前的匀场问题研究工作需要从感兴趣的部位获取数据进行模型训练。但是在实际场景中,模型训练后可能会有来自新的感兴趣部位的测试数据,而在模型训练时无法获得来自新部位的训练数据。在这种情况下,之前的方法无法最优地处理来自新的未见部位的测试数据。为了解决这个问题,我们在这项工作中探索了脑 MRI 匀场的领域泛化,并提出了 Site Mix(SiMix)。我们假设,对移动受试者的图像是在几个现有的部位采集的,用于模型训练。为了使训练数据更好地代表未见部位的测试数据,我们首先提出随机混合来自不同部位的训练图像,这大大增加了训练数据的多样性,同时保持了混合训练图像的真实性。其次,在测试时,当给出来自未见部位的测试图像时,我们提出了一种多视图策略,用保持真实性的方式对测试图像进行干扰,并对干扰后的图像的匀场结果进行集成,以提高匀场质量。为了验证 SiMix,我们在公开可用的 SRPBS 数据集和 MUSHAC 数据集上进行了实验,这两个数据集分别包含在九个和两个不同部位采集的脑 MRI。结果表明,SiMix 提高了对未见部位的脑 MRI 匀场效果,同时也有利于对现有部位的匀场。