Wen Han, Zhao Ying, Yang Yong, Wang Hongkai, Liu Ailian, Yao Yu, Fu Zhongliang
Chengdu Institute of Computer Applications, Chinese Academy of Sciences, Chengdu 610213, P. R. China.
University of Chinese Academy of Sciences, Beijing 100049, P. R. China.
Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2023 Feb 25;40(1):60-69. doi: 10.7507/1001-5515.202208045.
Hepatocellular carcinoma (HCC) is the most common liver malignancy, where HCC segmentation and prediction of the degree of pathological differentiation are two important tasks in surgical treatment and prognosis evaluation. Existing methods usually solve these two problems independently without considering the correlation of the two tasks. In this paper, we propose a multi-task learning model that aims to accomplish the segmentation task and classification task simultaneously. The model consists of a segmentation subnet and a classification subnet. A multi-scale feature fusion method is proposed in the classification subnet to improve the classification accuracy, and a boundary-aware attention is designed in the segmentation subnet to solve the problem of tumor over-segmentation. A dynamic weighted average multi-task loss is used to make the model achieve optimal performance in both tasks simultaneously. The experimental results of this method on 295 HCC patients are superior to other multi-task learning methods, with a Dice similarity coefficient (Dice) of (83.9 ± 0.88)% on the segmentation task, while the average recall is (86.08 ± 0.83)% and an F1 score is (80.05 ± 1.7)% on the classification task. The results show that the multi-task learning method proposed in this paper can perform the classification task and segmentation task well at the same time, which can provide theoretical reference for clinical diagnosis and treatment of HCC patients.
肝细胞癌(HCC)是最常见的肝脏恶性肿瘤,其中HCC分割和病理分化程度预测是外科治疗和预后评估中的两项重要任务。现有方法通常独立解决这两个问题,而不考虑这两项任务的相关性。在本文中,我们提出了一种多任务学习模型,旨在同时完成分割任务和分类任务。该模型由一个分割子网和一个分类子网组成。在分类子网中提出了一种多尺度特征融合方法以提高分类准确率,在分割子网中设计了一种边界感知注意力机制来解决肿瘤过度分割问题。使用动态加权平均多任务损失使模型在两项任务中同时实现最优性能。该方法在295例HCC患者上的实验结果优于其他多任务学习方法,在分割任务上的骰子相似系数(Dice)为(83.9 ± 0.88)%,而在分类任务上的平均召回率为(86.08 ± 0.83)%,F1分数为(80.05 ± 1.7)%。结果表明,本文提出的多任务学习方法能够同时很好地完成分类任务和分割任务,可为HCC患者的临床诊断和治疗提供理论参考。