Alotaibi Areej, AlSaeed Duaa
College of Computer and Information Sciences, King Saud University, Riyadh 11451, Saudi Arabia.
Diagnostics (Basel). 2025 Jan 3;15(1):99. doi: 10.3390/diagnostics15010099.
Early and accurate diagnosis of skin cancer improves survival rates; however, dermatologists often struggle with lesion detection due to similar pigmentation. Deep learning and transfer learning models have shown promise in diagnosing skin cancers through image processing. Integrating attention mechanisms (AMs) with deep learning has further enhanced the accuracy of medical image classification. While significant progress has been made, further research is needed to improve the detection accuracy. Previous studies have not explored the integration of attention mechanisms with the pre-trained Xception transfer learning model for binary classification of skin cancer. This study aims to investigate the impact of various attention mechanisms on the Xception model's performance in detecting benign and malignant skin lesions. We conducted four experiments on the HAM10000 dataset. Three models integrated self-attention (SL), hard attention (HD), and soft attention (SF) mechanisms, while the fourth model used the standard Xception without attention mechanisms. Each mechanism analyzed features from the Xception model uniquely: self-attention examined the input relationships, hard-attention selected elements sparsely, and soft-attention distributed the focus probabilistically. Integrating AMs into the Xception architecture effectively enhanced its performance. The accuracy of the Xception alone was 91.05%. With AMs, the accuracy increased to 94.11% using self-attention, 93.29% with soft attention, and 92.97% with hard attention. Moreover, the proposed models outperformed previous studies in terms of the recall metrics, which are crucial for medical investigations. These findings suggest that AMs can enhance performance in relation to complex medical imaging tasks, potentially supporting earlier diagnosis and improving treatment outcomes.
皮肤癌的早期准确诊断可提高生存率;然而,由于色素沉着相似,皮肤科医生在病变检测方面常常面临困难。深度学习和迁移学习模型在通过图像处理诊断皮肤癌方面已显示出前景。将注意力机制(AMs)与深度学习相结合进一步提高了医学图像分类的准确性。虽然已取得显著进展,但仍需要进一步研究以提高检测准确性。先前的研究尚未探索将注意力机制与预训练的Xception迁移学习模型相结合用于皮肤癌的二元分类。本研究旨在调查各种注意力机制对Xception模型检测良性和恶性皮肤病变性能的影响。我们在HAM10000数据集上进行了四项实验。三个模型分别集成了自注意力(SL)、硬注意力(HD)和软注意力(SF)机制,而第四个模型使用了没有注意力机制的标准Xception。每种机制对Xception模型的特征进行独特分析:自注意力检查输入关系,硬注意力稀疏地选择元素,软注意力概率性地分配关注点。将注意力机制集成到Xception架构中有效地提高了其性能。单独的Xception模型准确率为91.05%。使用注意力机制后,自注意力模型的准确率提高到94.11%,软注意力模型为93.29%,硬注意力模型为92.97%。此外,在召回率指标方面,所提出的模型优于先前的研究,而召回率指标对医学研究至关重要。这些发现表明,注意力机制可以提高复杂医学成像任务的性能,可能有助于早期诊断并改善治疗结果。