Department of Computing, Imperial College London, UK.
Institute for Digital Communications, School of Engineering, University of Edinburgh, UK; Department of Electronics and Electrical Engineering, Imperial College London, UK.
Med Image Anal. 2022 Nov;82:102597. doi: 10.1016/j.media.2022.102597. Epub 2022 Aug 28.
The success of neural networks on medical image segmentation tasks typically relies on large labeled datasets for model training. However, acquiring and manually labeling a large medical image set is resource-intensive, expensive, and sometimes impractical due to data sharing and privacy issues. To address this challenge, we propose AdvChain, a generic adversarial data augmentation framework, aiming at improving both the diversity and effectiveness of training data for medical image segmentation tasks. AdvChain augments data with dynamic data augmentation, generating randomly chained photo-metric and geometric transformations to resemble realistic yet challenging imaging variations to expand training data. By jointly optimizing the data augmentation model and a segmentation network during training, challenging examples are generated to enhance network generalizability for the downstream task. The proposed adversarial data augmentation does not rely on generative networks and can be used as a plug-in module in general segmentation networks. It is computationally efficient and applicable for both low-shot supervised and semi-supervised learning. We analyze and evaluate the method on two MR image segmentation tasks: cardiac segmentation and prostate segmentation with limited labeled data. Results show that the proposed approach can alleviate the need for labeled data while improving model generalization ability, indicating its practical value in medical imaging applications.
神经网络在医学图像分割任务上的成功通常依赖于大量的标记数据集进行模型训练。然而,获取和手动标记大量医学图像集是资源密集型的、昂贵的,并且由于数据共享和隐私问题,有时是不切实际的。为了解决这个挑战,我们提出了 AdvChain,一个通用的对抗性数据增强框架,旨在提高医学图像分割任务的训练数据的多样性和有效性。AdvChain 通过动态数据增强来增强数据,生成随机链式的光度和几何变换,以模拟逼真但具有挑战性的成像变化,从而扩展训练数据。通过在训练过程中联合优化数据增强模型和分割网络,生成具有挑战性的示例,以增强网络对下游任务的泛化能力。所提出的对抗性数据增强不依赖于生成网络,并且可以用作一般分割网络的插件模块。它计算效率高,适用于少样本监督和半监督学习。我们在两个磁共振图像分割任务上分析和评估了该方法:心脏分割和前列腺分割,使用有限的标记数据。结果表明,该方法可以减轻对标记数据的需求,同时提高模型的泛化能力,表明其在医学成像应用中的实际价值。