Department of Radiology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangzhou, Guangdong 510080, China; Guangdong Cardiovascular Institute, Guangzhou, China; Guangdong Provincial Key Laboratory of Artificial Intelligence in Medical Image Analysis and Application, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangzhou 510080, China.
Department of Radiology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangzhou, Guangdong 510080, China; Guangdong Provincial Key Laboratory of Artificial Intelligence in Medical Image Analysis and Application, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangzhou 510080, China.
Med Image Anal. 2022 Aug;80:102481. doi: 10.1016/j.media.2022.102481. Epub 2022 May 18.
Cells/nuclei deliver massive information of microenvironment. An automatic nuclei segmentation approach can reduce pathologists' workload and allow precise of the microenvironment for biological and clinical researches. Existing deep learning models have achieved outstanding performance under the supervision of a large amount of labeled data. However, when data from the unseen domain comes, we still have to prepare a certain degree of manual annotations for training for each domain. Unfortunately, obtaining histopathological annotations is extremely difficult. It is high expertise-dependent and time-consuming. In this paper, we attempt to build a generalized nuclei segmentation model with less data dependency and more generalizability. To this end, we propose a meta multi-task learning (Meta-MTL) model for nuclei segmentation which requires fewer training samples. A model-agnostic meta-learning is applied as the outer optimization algorithm for the segmentation model. We introduce a contour-aware multi-task learning model as the inner model. A feature fusion and interaction block (FFIB) is proposed to allow feature communication across both tasks. Extensive experiments prove that our proposed Meta-MTL model can improve the model generalization and obtain a comparable performance with state-of-the-art models with fewer training samples. Our model can also perform fast adaptation on the unseen domain with only a few manual annotations. Code is available at https://github.com/ChuHan89/Meta-MTL4NucleiSegmentation.
细胞/细胞核传递大量的微环境信息。自动细胞核分割方法可以减少病理学家的工作量,并允许对生物和临床研究中的微环境进行精确研究。现有的深度学习模型在大量有监督的标记数据的监督下已经取得了优异的性能。然而,当来自看不见的领域的数据出现时,我们仍然必须为每个领域的训练准备一定程度的手动注释。不幸的是,获得组织病理学注释是极其困难的。它高度依赖专业知识,并且耗时。在本文中,我们试图建立一个依赖数据较少、通用性更强的通用细胞核分割模型。为此,我们提出了一种元多任务学习(Meta-MTL)模型,用于细胞核分割,该模型需要更少的训练样本。无模型元学习被用作分割模型的外部优化算法。我们引入了一个轮廓感知的多任务学习模型作为内部模型。提出了一个特征融合和交互块(FFIB),以允许两个任务之间的特征通信。大量的实验证明,我们提出的 Meta-MTL 模型可以提高模型的泛化能力,并在使用较少训练样本的情况下获得与最先进模型相当的性能。我们的模型还可以在只有少量手动注释的情况下快速适应看不见的领域。代码可在 https://github.com/ChuHan89/Meta-MTL4NucleiSegmentation 获得。