CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; University of Chinese Academy of Sciences, Beijing 100049, China.
Stanford Center for Biomedical Informatics Research (BMIR), Department of Medicine, Stanford University, CA 94305, USA.
Med Image Anal. 2017 Aug;40:172-183. doi: 10.1016/j.media.2017.06.014. Epub 2017 Jun 30.
Accurate lung nodule segmentation from computed tomography (CT) images is of great importance for image-driven lung cancer analysis. However, the heterogeneity of lung nodules and the presence of similar visual characteristics between nodules and their surroundings make it difficult for robust nodule segmentation. In this study, we propose a data-driven model, termed the Central Focused Convolutional Neural Networks (CF-CNN), to segment lung nodules from heterogeneous CT images. Our approach combines two key insights: 1) the proposed model captures a diverse set of nodule-sensitive features from both 3-D and 2-D CT images simultaneously; 2) when classifying an image voxel, the effects of its neighbor voxels can vary according to their spatial locations. We describe this phenomenon by proposing a novel central pooling layer retaining much information on voxel patch center, followed by a multi-scale patch learning strategy. Moreover, we design a weighted sampling to facilitate the model training, where training samples are selected according to their degree of segmentation difficulty. The proposed method has been extensively evaluated on the public LIDC dataset including 893 nodules and an independent dataset with 74 nodules from Guangdong General Hospital (GDGH). We showed that CF-CNN achieved superior segmentation performance with average dice scores of 82.15% and 80.02% for the two datasets respectively. Moreover, we compared our results with the inter-radiologists consistency on LIDC dataset, showing a difference in average dice score of only 1.98%.
从计算机断层扫描 (CT) 图像中准确地分割肺结节对于基于图像的肺癌分析非常重要。然而,肺结节的异质性以及结节与其周围环境之间存在相似的视觉特征,使得稳健的结节分割变得困难。在这项研究中,我们提出了一种数据驱动的模型,称为中央焦点卷积神经网络 (CF-CNN),用于从异质 CT 图像中分割肺结节。我们的方法结合了两个关键见解:1)所提出的模型同时从 3-D 和 2-D CT 图像中捕获一组多样化的结节敏感特征;2)在对图像体素进行分类时,其邻体素的影响可以根据它们的空间位置而变化。我们通过提出一种新的中心池化层来描述这种现象,该层保留了关于体素补丁中心的大量信息,然后采用多尺度补丁学习策略。此外,我们设计了一种加权采样来促进模型训练,其中根据分割难度对训练样本进行选择。该方法已在包括 893 个结节的公共 LIDC 数据集和来自广东总医院 (GDGH) 的 74 个结节的独立数据集上进行了广泛评估。我们表明,CF-CNN 实现了卓越的分割性能,两个数据集的平均骰子分数分别为 82.15%和 80.02%。此外,我们将结果与 LIDC 数据集上的多位放射科医生的一致性进行了比较,平均骰子分数仅相差 1.98%。