• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于注意力机制和特征融合的多标签眼底图像分类

Multi-Label Fundus Image Classification Using Attention Mechanisms and Feature Fusion.

作者信息

Li Zhenwei, Xu Mengying, Yang Xiaoli, Han Yanqi

机构信息

College of Medical Technology and Engineering, Henan University of Science and Technology, Luoyang 471032, China.

出版信息

Micromachines (Basel). 2022 Jun 15;13(6):947. doi: 10.3390/mi13060947.

DOI:10.3390/mi13060947
PMID:35744561
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9230753/
Abstract

Fundus diseases can cause irreversible vision loss in both eyes if not diagnosed and treated immediately. Due to the complexity of fundus diseases, the probability of fundus images containing two or more diseases is extremely high, while existing deep learning-based fundus image classification algorithms have low diagnostic accuracy in multi-labeled fundus images. In this paper, a multi-label classification of fundus disease with binocular fundus images is presented, using a neural network algorithm model based on attention mechanisms and feature fusion. The algorithm highlights detailed features in binocular fundus images, and then feeds them into a ResNet50 network with attention mechanisms to extract fundus image lesion features. The model obtains global features of binocular images through feature fusion and uses Softmax to classify multi-label fundus images. The ODIR binocular fundus image dataset was used to evaluate the network classification performance and conduct ablation experiments. The model's backend is the Tensorflow framework. Through experiments on the test images, this method achieved accuracy, precision, recall, and 1 values of 94.23%, 99.09%, 99.23%, and 99.16%, respectively.

摘要

眼底疾病如果不立即诊断和治疗,可导致双眼不可逆的视力丧失。由于眼底疾病的复杂性,眼底图像包含两种或更多种疾病的概率极高,而现有的基于深度学习的眼底图像分类算法在多标签眼底图像中的诊断准确率较低。本文提出了一种利用双目眼底图像进行眼底疾病多标签分类的方法,采用基于注意力机制和特征融合的神经网络算法模型。该算法突出双目眼底图像中的细节特征,然后将其输入到具有注意力机制的ResNet50网络中,以提取眼底图像病变特征。该模型通过特征融合获得双目图像的全局特征,并使用Softmax对多标签眼底图像进行分类。使用ODIR双目眼底图像数据集评估网络分类性能并进行消融实验。该模型的后端是Tensorflow框架。通过对测试图像的实验,该方法的准确率、精确率、召回率和F1值分别达到了94.23%、99.09%、99.23%和99.16%。

相似文献

1
Multi-Label Fundus Image Classification Using Attention Mechanisms and Feature Fusion.基于注意力机制和特征融合的多标签眼底图像分类
Micromachines (Basel). 2022 Jun 15;13(6):947. doi: 10.3390/mi13060947.
2
A multi-class fundus disease classification system based on an adaptive scale discriminator and hybrid loss.一种基于自适应尺度判别器和混合损失的多类别眼底疾病分类系统。
Comput Biol Chem. 2024 Dec;113:108241. doi: 10.1016/j.compbiolchem.2024.108241. Epub 2024 Oct 11.
3
Discriminative kernel convolution network for multi-label ophthalmic disease detection on imbalanced fundus image dataset.用于不平衡眼底图像数据集上多标签眼科疾病检测的判别性核卷积网络。
Comput Biol Med. 2023 Feb;153:106519. doi: 10.1016/j.compbiomed.2022.106519. Epub 2023 Jan 2.
4
Multi-label classification of retinal diseases based on fundus images using Resnet and Transformer.基于眼底图像的 Resnet 和 Transformer 的视网膜疾病多标签分类。
Med Biol Eng Comput. 2024 Nov;62(11):3459-3469. doi: 10.1007/s11517-024-03144-6. Epub 2024 Jun 14.
5
Multi-label classification of fundus images with graph convolutional network and LightGBM.基于图卷积网络和 LightGBM 的眼底图像多标签分类。
Comput Biol Med. 2022 Oct;149:105909. doi: 10.1016/j.compbiomed.2022.105909. Epub 2022 Aug 11.
6
A Multi-Label Detection Deep Learning Model with Attention-Guided Image Enhancement for Retinal Images.一种用于视网膜图像的具有注意力引导图像增强功能的多标签检测深度学习模型。
Micromachines (Basel). 2023 Mar 22;14(3):705. doi: 10.3390/mi14030705.
7
BFENet: A two-stream interaction CNN method for multi-label ophthalmic diseases classification with bilateral fundus images.BFENet:一种用于双侧眼底图像的多标签眼科疾病分类的双流交互 CNN 方法。
Comput Methods Programs Biomed. 2022 Jun;219:106739. doi: 10.1016/j.cmpb.2022.106739. Epub 2022 Mar 11.
8
Combining convolutional neural networks and self-attention for fundus diseases identification.结合卷积神经网络和自注意力机制进行眼底疾病识别。
Sci Rep. 2023 Jan 2;13(1):76. doi: 10.1038/s41598-022-27358-6.
9
Cross-attention multi-branch network for fundus diseases classification using SLO images.基于 SLO 图像的眼底疾病分类的交叉注意力多分支网络。
Med Image Anal. 2021 Jul;71:102031. doi: 10.1016/j.media.2021.102031. Epub 2021 Mar 10.
10
Multi-Modal Retinal Image Classification With Modality-Specific Attention Network.基于模态特定注意力网络的多模态视网膜图像分类。
IEEE Trans Med Imaging. 2021 Jun;40(6):1591-1602. doi: 10.1109/TMI.2021.3059956. Epub 2021 Jun 1.

引用本文的文献

1
Deep Learning and Machine Learning Algorithms for Retinal Image Analysis in Neurodegenerative Disease: Systematic Review of Datasets and Models.深度学习和机器学习算法在神经退行性疾病视网膜图像分析中的应用:数据集和模型的系统评价。
Transl Vis Sci Technol. 2024 Feb 1;13(2):16. doi: 10.1167/tvst.13.2.16.
2
A Multi-Label Detection Deep Learning Model with Attention-Guided Image Enhancement for Retinal Images.一种用于视网膜图像的具有注意力引导图像增强功能的多标签检测深度学习模型。
Micromachines (Basel). 2023 Mar 22;14(3):705. doi: 10.3390/mi14030705.
3
Hardness-and-Type Recognition of Different Objects Based on a Novel Porous Graphene Flexible Tactile Sensor Array.

本文引用的文献

1
COVID-19 Risk Prediction for Diabetic Patients Using Fuzzy Inference System and Machine Learning Approaches.使用模糊推理系统和机器学习方法预测糖尿病患者的 COVID-19 风险。
J Healthc Eng. 2022 Apr 1;2022:4096950. doi: 10.1155/2022/4096950. eCollection 2022.
2
An Artificial Intelligent Risk Classification Method of High Myopia Based on Fundus Images.一种基于眼底图像的高度近视人工智能风险分类方法。
J Clin Med. 2021 Sep 29;10(19):4488. doi: 10.3390/jcm10194488.
3
Deep Learning Ensemble Method for Classifying Glaucoma Stages Using Fundus Photographs and Convolutional Neural Networks.
基于新型多孔石墨烯柔性触觉传感器阵列的不同物体硬度和类型识别
Micromachines (Basel). 2023 Jan 14;14(1):217. doi: 10.3390/mi14010217.
基于眼底照片和卷积神经网络的青光眼分期深度学习集成方法。
Curr Eye Res. 2021 Oct;46(10):1516-1524. doi: 10.1080/02713683.2021.1900268. Epub 2021 Apr 6.
4
Cross-attention multi-branch network for fundus diseases classification using SLO images.基于 SLO 图像的眼底疾病分类的交叉注意力多分支网络。
Med Image Anal. 2021 Jul;71:102031. doi: 10.1016/j.media.2021.102031. Epub 2021 Mar 10.
5
The Relative Performance of Ensemble Methods with Deep Convolutional Neural Networks for Image Classification.深度卷积神经网络集成方法在图像分类中的相对性能
J Appl Stat. 2018;45(15):2800-2818. doi: 10.1080/02664763.2018.1441383. Epub 2018 Feb 26.
6
Squeeze-and-Excitation Networks.挤压激励网络。
IEEE Trans Pattern Anal Mach Intell. 2020 Aug;42(8):2011-2023. doi: 10.1109/TPAMI.2019.2913372. Epub 2019 Apr 29.
7
A Deep Learning Algorithm for Prediction of Age-Related Eye Disease Study Severity Scale for Age-Related Macular Degeneration from Color Fundus Photography.一种基于深度学习的算法,可从眼底彩色照相图预测年龄相关性眼病研究严重程度评分-年龄相关性黄斑变性。
Ophthalmology. 2018 Sep;125(9):1410-1420. doi: 10.1016/j.ophtha.2018.02.037. Epub 2018 Apr 10.
8
Multi-categorical deep learning neural network to classify retinal images: A pilot study employing small database.用于视网膜图像分类的多分类深度学习神经网络:一项使用小型数据库的初步研究。
PLoS One. 2017 Nov 2;12(11):e0187336. doi: 10.1371/journal.pone.0187336. eCollection 2017.
9
A Review on Recent Developments for Detection of Diabetic Retinopathy.糖尿病视网膜病变检测的最新进展综述
Scientifica (Cairo). 2016;2016:6838976. doi: 10.1155/2016/6838976. Epub 2016 Sep 29.
10
Optic Disc and Optic Cup Segmentation Methodologies for Glaucoma Image Detection: A Survey.用于青光眼图像检测的视盘和视杯分割方法:一项综述。
J Ophthalmol. 2015;2015:180972. doi: 10.1155/2015/180972. Epub 2015 Nov 25.