School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai 201620, China.
Malaysia-Japan International Institute of Technology(MJIIT), Universiti Teknologi Malaysia, 54100 Kuala Lumpur, Malaysia; Andalusian Research Institute in Data Science and Computational Intelligence(DaSCI), University of Granada, Granada, Spain; Iwate Prefectural University, Iwate, Japan.
Comput Biol Med. 2024 Aug;178:108733. doi: 10.1016/j.compbiomed.2024.108733. Epub 2024 Jun 18.
Liver segmentation is pivotal for the quantitative analysis of liver cancer. Although current deep learning methods have garnered remarkable achievements for medical image segmentation, they come with high computational costs, significantly limiting their practical application in the medical field. Therefore, the development of an efficient and lightweight liver segmentation model becomes particularly important.
In our paper, we propose a real-time, lightweight liver segmentation model named G-MBRMD. Specifically, we employ a Transformer-based complex model as the teacher and a convolution-based lightweight model as the student. By introducing proposed multi-head mapping and boundary reconstruction strategies during the knowledge distillation process, Our method effectively guides the student model to gradually comprehend and master the global boundary processing capabilities of the complex teacher model, significantly enhancing the student model's segmentation performance without adding any computational complexity.
On the LITS dataset, we conducted rigorous comparative and ablation experiments, four key metrics were used for evaluation, including model size, inference speed, Dice coefficient, and HD95. Compared to other methods, our proposed model achieved an average Dice coefficient of 90.14±16.78%, with only 0.6 MB memory and 0.095 s inference speed for a single image on a standard CPU. Importantly, this approach improved the average Dice coefficient of the baseline student model by 1.64% without increasing computational complexity.
The results demonstrate that our method successfully realizes the unification of segmentation precision and lightness, and greatly enhances its potential for widespread application in practical settings.
肝脏分割是肝癌定量分析的关键。尽管当前的深度学习方法在医学图像分割方面取得了显著的成果,但它们的计算成本很高,极大地限制了它们在医学领域的实际应用。因此,开发高效、轻量级的肝脏分割模型变得尤为重要。
在本文中,我们提出了一个实时、轻量级的肝脏分割模型,名为 G-MBRMD。具体来说,我们使用基于 Transformer 的复杂模型作为教师,基于卷积的轻量级模型作为学生。通过在知识蒸馏过程中引入提出的多头映射和边界重建策略,我们的方法有效地引导学生模型逐渐理解和掌握复杂教师模型的全局边界处理能力,在不增加任何计算复杂度的情况下,显著提高学生模型的分割性能。
在 LITS 数据集上,我们进行了严格的对比和消融实验,使用了四个关键指标进行评估,包括模型大小、推理速度、Dice 系数和 HD95。与其他方法相比,我们提出的模型在平均 Dice 系数上达到了 90.14±16.78%,仅使用 0.6MB 的内存和标准 CPU 上每张图像 0.095s 的推理速度。重要的是,这种方法在不增加计算复杂度的情况下,将基线学生模型的平均 Dice 系数提高了 1.64%。
结果表明,我们的方法成功地实现了分割精度和轻量化的统一,极大地提高了其在实际应用中的广泛应用潜力。