Jiang Mingfeng, Yan Bin, Li Yang, Zhang Jucheng, Li Tieqiang, Ke Wei
School of Information Science and Technology, Zhejiang Sci-Tech University, Hangzhou 310018, China.
Department of Clinical Engineering, The Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou 310019, China.
Brain Sci. 2022 Feb 26;12(3):319. doi: 10.3390/brainsci12030319.
Automatic and accurate classification of Alzheimer's disease is a challenging and promising task. Fully Convolutional Network (FCN) can classify images at the pixel level. Adding an attention mechanism to the Fully Convolutional Network can effectively improve the classification performance of the model. However, the self-attention mechanism ignores the potential correlation between different samples. Aiming at this problem, we propose a new method for image classification of Alzheimer's disease based on the external-attention mechanism. The external-attention module is added after the fourth convolutional block of the fully convolutional network model. At the same time, the double normalization method of Softmax and L1 norm is introduced to obtain a better classification performance and richer feature information of the disease probability map. The activation function Softmax can increase the degree of fitting of the neural network to the training set, which transforms linearity into nonlinearity, thereby increasing the flexibility of the neural network. The L1 norm can avoid the attention map being affected by especially large (especially small) eigenvalues. The experiments in this paper use 550 three-dimensional MRI images and use five-fold cross-validation. The experimental results show that the proposed image classification method for Alzheimer's disease, combining the external-attention mechanism with double normalization, can effectively improve the classification performance of the model. With this method, the accuracy of the MLP-A model is 92.36%, the accuracy of the MLP-B model is 98.55%, and the accuracy of the fusion model MLP-C is 98.73%. The classification performance of the model is higher than similar models without adding any attention mechanism, and it is better than other comparison methods.
阿尔茨海默病的自动准确分类是一项具有挑战性且前景广阔的任务。全卷积网络(FCN)能够在像素级别对图像进行分类。在全卷积网络中添加注意力机制可以有效提高模型的分类性能。然而,自注意力机制忽略了不同样本之间的潜在相关性。针对这一问题,我们提出了一种基于外部注意力机制的阿尔茨海默病图像分类新方法。外部注意力模块添加在全卷积网络模型的第四个卷积块之后。同时,引入Softmax和L1范数的双重归一化方法,以获得更好的分类性能和疾病概率图更丰富的特征信息。激活函数Softmax可以提高神经网络对训练集的拟合程度,将线性转换为非线性,从而增加神经网络的灵活性。L1范数可以避免注意力图受到特别大(特别小)的特征值的影响。本文的实验使用了550张三维MRI图像,并采用五折交叉验证。实验结果表明,所提出的结合外部注意力机制和双重归一化的阿尔茨海默病图像分类方法能够有效提高模型的分类性能。使用该方法,MLP - A模型的准确率为92.36%,MLP - B模型的准确率为98.55%,融合模型MLP - C的准确率为98.73%。该模型的分类性能高于未添加任何注意力机制的类似模型,且优于其他比较方法。