Image Processing Center, School of Astronautics, Beihang University, Beijing 100191, China; Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China.
Image Processing Center, School of Astronautics, Beihang University, Beijing 100191, China; Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China; Shanghai Aerospace Control Technology Institute, Shanghai 201109, China.
Med Image Anal. 2022 Apr;77:102301. doi: 10.1016/j.media.2021.102301. Epub 2021 Nov 6.
Dermoscopic image retrieval technology can provide dermatologists with valuable information such as similar confirmed skin disease cases and diagnosis reports to assist doctors in their diagnosis. In this study, we design a dermoscopic image retrieval algorithm using convolutional neural networks (CNNs) and hash coding. A hybrid dilated convolution spatial attention module is proposed, which can focus on important information and suppress irrelevant information based on the complex morphological characteristics of dermoscopic images. Furthermore, we also propose a Cauchy rotation invariance loss function in view of the skin lesion target without the main direction. This function constrains CNNs to learn output differences in samples from different angles and to make CNNs obtain a certain rotation invariance. Extensive experiments are conducted on dermoscopic image datasets to verify the effectiveness and versatility of the proposed module, algorithm, and loss function. Experiment results show that the rotation-invariance deep hashing network with the proposed spatial attention module obtains better performance on the task of dermoscopic image retrieval.
皮肤镜图像检索技术可以为皮肤科医生提供有价值的信息,如相似的已确诊皮肤病病例和诊断报告,以帮助医生进行诊断。在这项研究中,我们设计了一种使用卷积神经网络(CNN)和哈希编码的皮肤镜图像检索算法。提出了一种混合扩张卷积空间注意模块,它可以根据皮肤镜图像的复杂形态特征,关注重要信息并抑制无关信息。此外,鉴于皮肤病变目标没有主方向,我们还提出了一个柯西旋转不变损失函数。该函数约束 CNN 从不同角度学习样本的输出差异,并使 CNN 获得一定的旋转不变性。在皮肤镜图像数据集上进行了广泛的实验,以验证所提出的模块、算法和损失函数的有效性和通用性。实验结果表明,在皮肤镜图像检索任务中,带有所提出的空间注意模块的旋转不变深度哈希网络具有更好的性能。