• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于分层 Transformer 和掩模机制的医学图像目标检测。

Object Detection in Medical Images Based on Hierarchical Transformer and Mask Mechanism.

机构信息

School of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha 410082, Hunan, China.

College of Information Engineering, Changsha Medical University, Changsha 410219, Hunan, China.

出版信息

Comput Intell Neurosci. 2022 Aug 4;2022:5863782. doi: 10.1155/2022/5863782. eCollection 2022.

DOI:10.1155/2022/5863782
PMID:35965770
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9371842/
Abstract

The object detection task in the medical field is challenging in terms of classification and regression. Due to its crucial applications in computer-aided diagnosis and computer-aided detection techniques, an increasing number of researchers are transferring the object detection techniques to the medical field. However, in existing work on object detection, researchers do not consider the low resolution of medical images, the high amount of noise, and the small size of the objects to be detected. Based on this, this paper proposes a new algorithmic model called the MS Transformer, where a self-supervised learning approach is used to perform a random mask on the input image to reconstruct the input features, learn a richer feature vector, and filter out excessive noise. To focus the model on the small objects that are being detected, the hierarchical transformer model is introduced in this paper, and a sliding window with a local self-attention mechanism is used to give a higher attention score to the small objects to be detected. Finally, a single-stage object detection framework is used to predict the sequence of sets at the location of the bounding box and the class of objects to be detected. On the DeepLesion and BCDD benchmark dataset, the model proposed in this paper achieves better performance improvement on multiple evaluation metric categories.

摘要

医学领域中的目标检测任务在分类和回归方面具有挑战性。由于其在计算机辅助诊断和计算机辅助检测技术中的关键应用,越来越多的研究人员将目标检测技术应用于医学领域。然而,在现有的目标检测工作中,研究人员没有考虑到医学图像的低分辨率、高噪声和待检测目标的小尺寸等问题。基于此,本文提出了一种名为 MS Transformer 的新算法模型,该模型采用自监督学习方法对输入图像进行随机遮挡,以重建输入特征,学习更丰富的特征向量,并滤除过多的噪声。为了使模型专注于要检测的小目标,本文引入了分层 Transformer 模型,并使用具有局部自注意力机制的滑动窗口为要检测的小目标赋予更高的注意力得分。最后,使用单阶段目标检测框架预测边界框位置处的集合序列和要检测的对象类别。在 DeepLesion 和 BCDD 基准数据集上,本文提出的模型在多个评估指标类别上实现了更好的性能提升。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5340/9371842/87481e4d2815/CIN2022-5863782.003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5340/9371842/8253a5715a02/CIN2022-5863782.001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5340/9371842/a6cf5c902515/CIN2022-5863782.002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5340/9371842/87481e4d2815/CIN2022-5863782.003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5340/9371842/8253a5715a02/CIN2022-5863782.001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5340/9371842/a6cf5c902515/CIN2022-5863782.002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5340/9371842/87481e4d2815/CIN2022-5863782.003.jpg

相似文献

1
Object Detection in Medical Images Based on Hierarchical Transformer and Mask Mechanism.基于分层 Transformer 和掩模机制的医学图像目标检测。
Comput Intell Neurosci. 2022 Aug 4;2022:5863782. doi: 10.1155/2022/5863782. eCollection 2022.
2
Automatic creation of annotations for chest radiographs based on the positional information extracted from radiographic image reports.基于从放射影像报告中提取的位置信息,为胸部 X 光片自动创建注释。
Comput Methods Programs Biomed. 2021 Sep;209:106331. doi: 10.1016/j.cmpb.2021.106331. Epub 2021 Aug 4.
3
Object Detection Based on Swin Deformable Transformer-BiPAFPN-YOLOX.基于 Swin 变形 Transformer-BiPAFPN-YOLOX 的目标检测。
Comput Intell Neurosci. 2023 Mar 9;2023:4228610. doi: 10.1155/2023/4228610. eCollection 2023.
4
TransEffiDet: Aircraft Detection and Classification in Aerial Images Based on EfficientDet and Transformer.TransEffiDet:基于 EfficientDet 和 Transformer 的航空图像中飞机的检测与分类。
Comput Intell Neurosci. 2022 Apr 21;2022:2262549. doi: 10.1155/2022/2262549. eCollection 2022.
5
Focal DETR: Target-Aware Token Design for Transformer-Based Object Detection.聚焦 DETR:基于 Transformer 的目标检测中的目标感知 Token 设计。
Sensors (Basel). 2022 Nov 10;22(22):8686. doi: 10.3390/s22228686.
6
A Deep-Learning Model with Task-Specific Bounding Box Regressors and Conditional Back-Propagation for Moving Object Detection in ADAS Applications.一种用于 ADAS 应用中移动目标检测的具有特定任务边界框回归器和条件反向传播的深度学习模型。
Sensors (Basel). 2020 Sep 15;20(18):5269. doi: 10.3390/s20185269.
7
FEA-Swin: Foreground Enhancement Attention Swin Transformer Network for Accurate UAV-Based Dense Object Detection.FEA-Swin:用于基于无人机的精确密集目标检测的前景增强注意力Swin变压器网络
Sensors (Basel). 2022 Sep 15;22(18):6993. doi: 10.3390/s22186993.
8
DetectFormer: Category-Assisted Transformer for Traffic Scene Object Detection.DetectFormer:用于交通场景目标检测的类别辅助式 Transformer。
Sensors (Basel). 2022 Jun 26;22(13):4833. doi: 10.3390/s22134833.
9
Ghostformer: A GhostNet-Based Two-Stage Transformer for Small Object Detection.幽灵former:一种基于 GhostNet 的两阶段 Transformer 小目标检测方法。
Sensors (Basel). 2022 Sep 14;22(18):6939. doi: 10.3390/s22186939.
10
SFOD-Trans: semi-supervised fine-grained object detection framework with transformer module.SFOD-Trans:带有变压器模块的半监督细粒度目标检测框架。
Med Biol Eng Comput. 2022 Dec;60(12):3555-3566. doi: 10.1007/s11517-022-02682-1. Epub 2022 Oct 17.

引用本文的文献

1
Optimizing RetinaNet anchors using differential evolution for improved object detection.使用差分进化优化RetinaNet锚框以改进目标检测
Sci Rep. 2025 Jun 20;15(1):20101. doi: 10.1038/s41598-025-02888-x.
2
Enhanced nuclear information fusion and visual transformer for pathological breast cancer image classification.用于病理乳腺癌图像分类的增强核信息融合与视觉Transformer
Sci Rep. 2025 Jun 3;15(1):19490. doi: 10.1038/s41598-025-04344-2.
3
From Binary to Multi-Class Classification: A Two-Step Hybrid CNN-ViT Model for Chest Disease Classification Based on X-Ray Images.

本文引用的文献

1
The research of aptamer biosensor technologies for detection of microorganism.用于微生物检测的适配体生物传感器技术研究。
Appl Microbiol Biotechnol. 2020 Dec;104(23):9877-9890. doi: 10.1007/s00253-020-10940-1. Epub 2020 Oct 13.
2
FUNMarker: Fusion Network-Based Method to Identify Prognostic and Heterogeneous Breast Cancer Biomarkers.FUNMarker:基于融合网络的方法,用于识别预后和异质性乳腺癌生物标志物。
IEEE/ACM Trans Comput Biol Bioinform. 2021 Nov-Dec;18(6):2483-2491. doi: 10.1109/TCBB.2020.2973148. Epub 2021 Dec 8.
3
An experimental study on breast lesion detection and classification from ultrasound images using deep learning architectures.
从二分类到多分类:一种基于X射线图像的胸部疾病分类的两步混合卷积神经网络-视觉Transformer模型
Diagnostics (Basel). 2024 Dec 6;14(23):2754. doi: 10.3390/diagnostics14232754.
4
Stratum corneum nanotexture feature detection using deep learning and spatial analysis: a noninvasive tool for skin barrier assessment.利用深度学习和空间分析进行角质层纳米纹理特征检测:一种用于皮肤屏障评估的非侵入性工具。
Gigascience. 2024 Jan 2;13. doi: 10.1093/gigascience/giae095.
5
Intraoperative detection of parathyroid glands using artificial intelligence: optimizing medical image training with data augmentation methods.术中使用人工智能检测甲状旁腺:使用数据增强方法优化医学图像训练。
Surg Endosc. 2024 Oct;38(10):5732-5745. doi: 10.1007/s00464-024-11115-z. Epub 2024 Aug 13.
6
Hybrid Ensemble Deep Learning Model for Advancing Ischemic Brain Stroke Detection and Classification in Clinical Application.用于临床应用中推进缺血性脑卒检测与分类的混合集成深度学习模型
J Imaging. 2024 Jul 2;10(7):160. doi: 10.3390/jimaging10070160.
7
Multi-branch CNN and grouping cascade attention for medical image classification.多分支卷积神经网络和分组级联注意力在医学图像分类中的应用。
Sci Rep. 2024 Jul 1;14(1):15013. doi: 10.1038/s41598-024-64982-w.
8
AVD-YOLOv5: a new lightweight network architecture for high-speed aortic valve detection from a new and large echocardiography dataset.AVD-YOLOv5:一种新的轻量级网络架构,用于从新的大型超声心动图数据集高速检测主动脉瓣。
Med Biol Eng Comput. 2024 Aug;62(8):2511-2528. doi: 10.1007/s11517-024-03090-3. Epub 2024 Apr 18.
9
A survey of the impact of self-supervised pretraining for diagnostic tasks in medical X-ray, CT, MRI, and ultrasound.针对医学 X 射线、CT、MRI 和超声诊断任务的自监督预训练的影响进行调查。
BMC Med Imaging. 2024 Apr 6;24(1):79. doi: 10.1186/s12880-024-01253-0.
10
Recognition of rare antinuclear antibody patterns based on a novel attention-based enhancement framework.基于新型注意力增强框架识别罕见抗核抗体模式。
Brief Bioinform. 2024 Jan 22;25(2). doi: 10.1093/bib/bbad531.
基于深度学习架构的超声图像乳腺病变检测与分类的实验研究。
BMC Med Imaging. 2019 Jul 1;19(1):51. doi: 10.1186/s12880-019-0349-x.
4
Evaluate the Malignancy of Pulmonary Nodules Using the 3-D Deep Leaky Noisy-OR Network.利用三维深度渗漏噪声 OR 网络评估肺结节的恶性程度。
IEEE Trans Neural Netw Learn Syst. 2019 Nov;30(11):3484-3495. doi: 10.1109/TNNLS.2019.2892409. Epub 2019 Feb 14.
5
Automatic tumor segmentation in breast ultrasound images using a dilated fully convolutional network combined with an active contour model.使用带孔全卷积网络结合主动轮廓模型进行乳腺超声图像的自动肿瘤分割。
Med Phys. 2019 Jan;46(1):215-228. doi: 10.1002/mp.13268. Epub 2018 Nov 28.
6
DeepLesion: automated mining of large-scale lesion annotations and universal lesion detection with deep learning.深度病变:基于深度学习的大规模病变标注自动挖掘与通用病变检测
J Med Imaging (Bellingham). 2018 Jul;5(3):036501. doi: 10.1117/1.JMI.5.3.036501. Epub 2018 Jul 20.
7
Microaneurysm Detection Using Principal Component Analysis and Machine Learning Methods.基于主成分分析和机器学习方法的微动脉瘤检测。
IEEE Trans Nanobioscience. 2018 Jul;17(3):191-198. doi: 10.1109/TNB.2018.2840084. Epub 2018 May 24.
8
Classification of Alzheimer's Disease Based on Eight-Layer Convolutional Neural Network with Leaky Rectified Linear Unit and Max Pooling.基于带泄露整流线性单元和最大池化的八层卷积神经网络的阿尔茨海默病分类。
J Med Syst. 2018 Mar 26;42(5):85. doi: 10.1007/s10916-018-0932-7.
9
On Efficient Feature Ranking Methods for High-Throughput Data Analysis.关于高通量数据分析的高效特征排序方法
IEEE/ACM Trans Comput Biol Bioinform. 2015 Nov-Dec;12(6):1374-84. doi: 10.1109/TCBB.2015.2415790.