Zargari Abolfazl, Mashhadi Najmeh, Shariati S Ali
Department of Electrical and Computer Engineering, University of California, Santa Cruz, CA, USA.
Lead contact.
bioRxiv. 2023 Jul 28:2023.07.26.550715. doi: 10.1101/2023.07.26.550715.
The application of deep learning is rapidly transforming the field of bioimage analysis. While deep learning has shown great promise in complex microscopy tasks such as single-cell segmentation, the development of generalizable foundation deep learning segmentation models is hampered by the scarcity of large and diverse annotated datasets of cell images for training purposes. Generative Adversarial Networks (GANs) can generate realistic images that can potentially be easily used to train deep learning models without the generation of large manually annotated microscopy images. Here, we propose a customized CycleGAN architecture to train an enhanced cell segmentation model with limited annotated cell images, effectively addressing the challenge of paucity of annotated data in microscopy imaging. Our customized CycleGAN model can generate realistic synthetic images of cells with morphological details and nuances very similar to that of real images. This method not only increases the variability seen during training but also enhances the authenticity of synthetic samples, thereby enhancing the overall predictive accuracy and robustness of the cell segmentation model. Our experimental results show that our CycleGAN-based method significantly improves the performance of the segmentation model compared to conventional training techniques. Interestingly, we demonstrate that our model can extrapolate its knowledge by synthesizing imaging scenarios that were not seen during the training process. Our proposed customized CycleGAN method will accelerate the development of foundation models for cell segmentation in microscopy images.
深度学习的应用正在迅速改变生物图像分析领域。虽然深度学习在诸如单细胞分割等复杂的显微镜任务中显示出了巨大的潜力,但用于训练的细胞图像的大型多样注释数据集的稀缺阻碍了通用基础深度学习分割模型的发展。生成对抗网络(GAN)可以生成逼真的图像,这些图像有可能很容易用于训练深度学习模型,而无需生成大量手动注释的显微镜图像。在这里,我们提出了一种定制的循环一致对抗网络(CycleGAN)架构,以使用有限的注释细胞图像训练增强的细胞分割模型,有效解决显微镜成像中注释数据匮乏的挑战。我们定制的CycleGAN模型可以生成具有形态细节和细微差别的逼真的细胞合成图像,这些细节和细微差别与真实图像非常相似。这种方法不仅增加了训练期间看到的变异性,还提高了合成样本的真实性,从而提高了细胞分割模型的整体预测准确性和鲁棒性。我们的实验结果表明,与传统训练技术相比,我们基于CycleGAN的方法显著提高了分割模型的性能。有趣的是,我们证明我们的模型可以通过合成训练过程中未见过的成像场景来推断其知识。我们提出的定制CycleGAN方法将加速显微镜图像中细胞分割基础模型的开发。