College of Computer Science, Sichuan University, Chengdu 610065, China.
Department of Electronic Engineering, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong; Tencent AI Lab, Shenzhen 518057, China.
Med Image Anal. 2021 Feb;68:101914. doi: 10.1016/j.media.2020.101914. Epub 2020 Nov 25.
Hepatocellular carcinoma (HCC), as the most common type of primary malignant liver cancer, has become a leading cause of cancer deaths in recent years. Accurate segmentation of HCC lesions is critical for tumor load assessment, surgery planning, and postoperative examination. As the appearance of HCC lesions varies greatly across patients, traditional manual segmentation is a very tedious and time-consuming process, the accuracy of which is also difficult to ensure. Therefore, a fully automated and reliable HCC segmentation system is in high demand. In this work, we present a novel hybrid neural network based on multi-task learning and ensemble learning techniques for accurate HCC segmentation of hematoxylin and eosin (H&E)-stained whole slide images (WSIs). First, three task-specific branches are integrated to enlarge the feature space, based on which the network is able to learn more general features and thus reduce the risk of overfitting. Second, an ensemble learning scheme is leveraged to perform feature aggregation, in which selective kernel modules (SKMs) and spatial and channel-wise squeeze-and-excitation modules (scSEMs) are adopted for capturing the features from different spaces and scales. Our proposed method achieves state-of-the-art performance on three publicly available datasets, with segmentation accuracies of 0.797, 0.923, and 0.765 in the PAIP, CRAG, and UHCMC&CWRU datasets, respectively, which demonstrates its effectiveness in addressing the HCC segmentation problem. To the best of our knowledge, this is also the first work on the pixel-wise HCC segmentation of H&E-stained WSIs.
肝细胞癌(HCC)是原发性肝癌中最常见的类型,近年来已成为癌症死亡的主要原因。准确地对 HCC 病变进行分割对于肿瘤负荷评估、手术规划和术后检查至关重要。由于 HCC 病变在不同患者中的表现差异很大,传统的手动分割是一个非常繁琐和耗时的过程,而且准确性也难以保证。因此,人们非常需要一种完全自动化和可靠的 HCC 分割系统。在这项工作中,我们提出了一种基于多任务学习和集成学习技术的新型混合神经网络,用于对苏木精和伊红(H&E)染色的全切片图像(WSI)进行准确的 HCC 分割。首先,集成了三个特定于任务的分支,以扩大特征空间,在此基础上,网络能够学习更多的通用特征,从而降低过拟合的风险。其次,利用集成学习方案进行特征聚合,其中采用选择性核模块(SKM)和空间和通道压缩-激励模块(scSEM)来从不同的空间和尺度捕获特征。我们的方法在三个公开可用的数据集上取得了最先进的性能,在 PAIP、CRAG 和 UHCMC&CWRU 数据集上的分割精度分别为 0.797、0.923 和 0.765,这表明它在解决 HCC 分割问题方面是有效的。据我们所知,这也是首次对 H&E 染色 WSI 进行像素级 HCC 分割的工作。