Zheng Hao, Perrine Susan M Motch, Pitirri M Kathleen, Kawasaki Kazuhiko, Wang Chaoli, Richtsmeier Joan T, Chen Danny Z
Department of Computer Science and Engineering, University of Notre Dame, Notre Dame, IN 46556, USA.
Department of Anthropology, Pennsylvania State University, University Park, PA 16802, USA.
Med Image Comput Comput Assist Interv. 2020 Oct;12261:802-812. doi: 10.1007/978-3-030-59710-8_78. Epub 2020 Sep 29.
Craniofacial syndromes often involve skeletal defects of the head. Studying the development of the (the part of the endoskeleton that protects the brain and other sense organs) is crucial to understanding genotype-phenotype relationships and early detection of skeletal malformation. Our goal is to segment craniofacial cartilages in 3D micro-CT images of embryonic mice stained with phosphotungstic acid. However, due to high image resolution, complex object structures, and low contrast, delineating fine-grained structures in these images is very challenging, even manually. Specifically, only experts can differentiate cartilages, and it is unrealistic to manually label whole volumes for deep learning model training. We propose a new framework to progressively segment cartilages in high-resolution 3D micro-CT images using extremely sparse annotation (e.g., annotating only a few selected slices in a volume). Our model consists of a lightweight fully convolutional network (FCN) to accelerate the training speed and generate pseudo labels (PLs) for unlabeled slices. Meanwhile, we take into account the reliability of PLs using a bootstrap ensemble based uncertainty quantification method. Further, our framework gradually learns from the PLs with the guidance of the uncertainty estimation via self-training. Experiments show that our method achieves high segmentation accuracy compared to prior arts and obtains performance gains by iterative self-training.
颅面综合征通常涉及头部的骨骼缺陷。研究颅骨(内骨骼中保护大脑和其他感觉器官的部分)的发育对于理解基因型-表型关系以及早期检测骨骼畸形至关重要。我们的目标是在经磷钨酸染色的胚胎小鼠的三维显微CT图像中分割颅面软骨。然而,由于图像分辨率高、物体结构复杂且对比度低,即使是手动在这些图像中描绘细粒度结构也极具挑战性。具体而言,只有专家才能区分软骨,并且为深度学习模型训练手动标记整个体积是不现实的。我们提出了一个新框架,使用极其稀疏的注释(例如,仅注释一个体积中的少数选定切片)在高分辨率三维显微CT图像中逐步分割软骨。我们的模型由一个轻量级全卷积网络(FCN)组成,以加快训练速度并为未标记切片生成伪标签(PL)。同时,我们使用基于自训练集成的不确定性量化方法考虑PL的可靠性。此外,我们的框架通过自我训练在不确定性估计的指导下从PL中逐步学习。实验表明,与现有技术相比,我们的方法实现了高分割精度,并通过迭代自我训练获得了性能提升。