Department of Computing, Imperial College London, United Kingdom.
Department of Surgery and Cancer, Imperial College London, United Kingdom.
Med Image Anal. 2024 Oct;97:103260. doi: 10.1016/j.media.2024.103260. Epub 2024 Jun 29.
Robustness of deep learning segmentation models is crucial for their safe incorporation into clinical practice. However, these models can falter when faced with distributional changes. This challenge is evident in magnetic resonance imaging (MRI) scans due to the diverse acquisition protocols across various domains, leading to differences in image characteristics such as textural appearances. We posit that the restricted anatomical differences between subjects could be harnessed to refine the latent space into a set of shape components. The learned set then aims to encompass the relevant anatomical shape variation found within the patient population. We explore this by utilising multiple MRI sequences to learn texture invariant and shape equivariant features which are used to construct a shape dictionary using vector quantisation. We investigate shape equivariance to a number of different types of groups. We hypothesise and prove that the greater the group order, i.e., the denser the constraint, the better becomes the model robustness. We achieve shape equivariance either with a contrastive based approach or by imposing equivariant constraints on the convolutional kernels. The resulting shape equivariant dictionary is then sampled to compose the segmentation output. Our method achieves state-of-the-art performance for the task of single domain generalisation for prostate and cardiac MRI segmentation. Code is available at https://github.com/AinkaranSanthi/A_Geometric_Perspective_For_Robust_Segmentation.
深度学习分割模型的鲁棒性对于将其安全地纳入临床实践至关重要。然而,当这些模型面临分布变化时,它们可能会失败。在磁共振成像 (MRI) 扫描中,由于不同领域的采集协议不同,导致图像特征(如纹理外观)存在差异,因此存在这一挑战。我们假设,通过利用多个 MRI 序列来学习纹理不变和形状等变特征,可以将受限的解剖学差异利用起来,将潜在空间细化为一组形状分量。学习到的集合旨在包含患者群体中发现的相关解剖形状变化。我们使用向量量化来构建形状字典,然后使用这些特征来探索这一点。我们研究了形状等变性与多种不同类型的组的关系。我们假设并证明,群组顺序越大,即约束越密集,模型的鲁棒性就越好。我们通过基于对比的方法或对卷积核施加等变约束来实现形状等变。然后对生成的形状等变字典进行采样,以组成分割输出。我们的方法在前列腺和心脏 MRI 分割的单域泛化任务中实现了最先进的性能。代码可在 https://github.com/AinkaranSanthi/A_Geometric_Perspective_For_Robust_Segmentation 上获得。