School of Information and Electronics, Beijing Institute of Technology, Beijing, China.
School of Computer Science and Technology, Xidian University, Xi'an, China.
Comput Med Imaging Graph. 2021 Mar;88:101842. doi: 10.1016/j.compmedimag.2020.101842. Epub 2020 Dec 25.
Convolutional neural networks (CNNs) have become an increasingly popular tool for brain lesion segmentation in recent years due to its accuracy and efficiency. However, CNN-based brain lesion segmentation generally requires a large amount of annotated training data, which can be costly for medical imaging. In many scenarios, only a few annotations of brain lesions are available. One common strategy to address the issue of limited annotated data is to transfer knowledge from a different yet relevant source task, where training data is abundant, to the target task of interest. Typically, a model can be pretrained for the source task, and then fine-tuned with the scarce training data associated with the target task. However, classic fine-tuning tends to make small modifications to the pretrained model, which could hinder its adaptation to the target task. Fine-tuning with increased model capacity has been shown to alleviate this negative impact in image classification problems. In this work, we extend the strategy of fine-tuning with increased model capacity to the problem of brain lesion segmentation, and then develop an advanced version that is better suitable for segmentation problems. First, we propose a vanilla strategy of increasing the capacity, where, like in the classification problem, the width of the network is augmented during fine-tuning. Second, because unlike image classification, in segmentation problems each voxel is associated with a labeling result, we further develop a spatially adaptive augmentation strategy during fine-tuning. Specifically, in addition to the vanilla width augmentation, we incorporate a module that computes a spatial map of the contribution of the information given by width augmentation in the final segmentation. For demonstration, the proposed method was applied to ischemic stroke lesion segmentation, where a model pretrained for brain tumor segmentation was fine-tuned, and the experimental results indicate the benefit of our method.
卷积神经网络(CNN)由于其准确性和效率,近年来已成为脑损伤分割的一种越来越受欢迎的工具。然而,基于 CNN 的脑损伤分割通常需要大量的标注训练数据,这对于医学成像来说可能是昂贵的。在许多情况下,只有少数脑损伤的标注数据。解决标注数据有限的问题的一种常见策略是将知识从不同但相关的源任务转移到感兴趣的目标任务,在源任务中,训练数据是丰富的。通常,可以对源任务进行模型预训练,然后使用与目标任务相关的少量训练数据进行微调。然而,经典的微调方法往往对预训练模型进行小的修改,这可能会阻碍其对目标任务的适应。在图像分类问题中,增加模型容量的微调已被证明可以减轻这种负面影响。在这项工作中,我们将增加模型容量的微调策略扩展到脑损伤分割问题,并进一步开发了一种更适合分割问题的高级版本。首先,我们提出了一种增加容量的香草策略,即在微调过程中增加网络的宽度,就像在分类问题中一样。其次,由于与图像分类不同,在分割问题中,每个体素都与一个标记结果相关联,我们在微调过程中进一步开发了一种空间自适应增强策略。具体来说,除了香草宽度增强外,我们还结合了一个模块,该模块计算了宽度增强在最终分割中给出的信息的空间映射。为了演示,我们将所提出的方法应用于缺血性中风损伤分割,其中对脑肿瘤分割进行了模型预训练,并进行了微调,实验结果表明了我们的方法的优势。
Comput Med Imaging Graph. 2021-3
Med Image Anal. 2022-7
Neuroimage. 2023-5-1
Comput Methods Programs Biomed. 2022-2
Comput Biol Med. 2018-11-16
IEEE Trans Med Imaging. 2018-7
Comput Methods Programs Biomed. 2020-8
Neuroimage Clin. 2018-12-10
Clin Appl Thromb Hemost. 2023