Schumacher Mona, Siebert Hanna, Genz Andreas, Bade Ragnar, Heinrich Mattias
University of Luebeck, Institute of Medical Informatics, Luebeck, Germany.
MeVis Medical Solutions AG, Bremen, Germany.
J Med Imaging (Bellingham). 2022 Jul;9(4):044001. doi: 10.1117/1.JMI.9.4.044001. Epub 2022 Jul 14.
: Image registration is the process of aligning images, and it is a fundamental task in medical image analysis. While many tasks in the field of image analysis, such as image segmentation, are handled almost entirely with deep learning and exceed the accuracy of conventional algorithms, currently available deformable image registration methods are often still conventional. Deep learning methods for medical image registration have recently reached the accuracy of conventional algorithms. However, they are often based on a weakly supervised learning scheme using multilabel image segmentations during training. The creation of such detailed annotations is very time-consuming. : We propose a weakly supervised learning scheme for deformable image registration. By calculating the loss function based on only bounding box labels, we are able to train an image registration network for large displacement deformations without using densely labeled images. We evaluate our model on interpatient three-dimensional abdominal CT and MRI images. : The results show an improvement of (for CT images) and 20% (for MRI images) in comparison to the unsupervised method. When taking into account the reduced annotation effort, the performance also exceeds the performance of weakly supervised training using detailed image segmentations. : We show that the performance of image registration methods can be enhanced with little annotation effort using our proposed method.
图像配准是将图像对齐的过程,是医学图像分析中的一项基础任务。虽然图像分析领域的许多任务,如图像分割,几乎完全由深度学习处理且精度超过了传统算法,但目前可用的可变形图像配准方法通常仍属于传统方法。用于医学图像配准的深度学习方法最近已达到传统算法的精度。然而,它们通常基于训练期间使用多标签图像分割的弱监督学习方案。创建此类详细注释非常耗时。
我们提出了一种用于可变形图像配准的弱监督学习方案。通过仅基于边界框标签计算损失函数,我们能够在不使用密集标记图像的情况下训练用于大位移变形的图像配准网络。我们在患者间三维腹部CT和MRI图像上评估我们的模型。
结果表明,与无监督方法相比,(CT图像)有 的提升,(MRI图像)有20%的提升。考虑到注释工作量的减少,该性能也超过了使用详细图像分割的弱监督训练的性能。
我们表明,使用我们提出的方法,只需很少的注释工作量就能提高图像配准方法的性能。