• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于相互学习的可解释多视图变压器框架用于精确乳腺癌病理图像分类。

Explainable multi-view transformer framework with mutual learning for precision breast cancer pathology image classification.

作者信息

Byeon Haewon, Alsaadi Mahmood, Vijay Richa, Assudani Purshottam J, Kumar Dutta Ashit, Bansal Monika, Singh Pavitar Parkash, Soni Mukesh, Bhatt Mohammed Wasim

机构信息

Convergence Department, Korea University of Technology and Education, Cheonan, Republic of Korea.

Department of Computer Sciences, College of Sciences, University of Al Maarif, Al Anbar, Iraq.

出版信息

Front Oncol. 2025 Jul 14;15:1626785. doi: 10.3389/fonc.2025.1626785. eCollection 2025.

DOI:10.3389/fonc.2025.1626785
PMID:40727468
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC12302034/
Abstract

Breast cancer remains the most prevalent cancer among women, where accurate and interpretable analysis of pathology images is vital for early diagnosis and personalized treatment planning. However, conventional single-network models fall short in balancing both performance and explainability-Convolutional Neural Networks (CNNs) lack the capacity to capture global contextual information, while Transformers are limited in modeling fine-grained local details. To overcome these challenges and contribute to the advancement of Explainable AI (XAI) in precision cancer diagnosis, this paper proposes MVT-OFML (Multi-View Transformer Online Fusion Mutual Learning), a novel and interpretable classification framework for breast cancer pathology images. MVT-OFML combines ResNet-50 for extracting detailed local features and a multi-view Transformer encoding module for capturing comprehensive global context across multiple perspectives. A key innovation is the Online Fusion Mutual Learning (OFML) mechanism, which enables bidirectional knowledge sharing between the CNN and Transformer branches by aligning both intermediate feature representations and prediction logits. This mutual learning framework enhances performance while also producing interpretable attention maps and feature-level visualizations that reveal the decision-making process of the model-promoting transparency, trust, and clinical usability. Extensive experiments on the BreakHis and BACH datasets demonstrate that MVT-OFML significantly outperforms the strongest baseline models, achieving accuracy improvements of 0.90% and 2.26%, and F-score gains of 4.75% and 3.21%, respectively. By integrating complementary modeling paradigms with explainable learning strategies, MVT-OFML offers a promising AI solution for precise and interpretable breast cancer diagnosis and prognosis, supporting informed decision-making in clinical settings.

摘要

乳腺癌仍然是女性中最常见的癌症,对病理图像进行准确且可解释的分析对于早期诊断和个性化治疗规划至关重要。然而,传统的单网络模型在平衡性能和可解释性方面存在不足——卷积神经网络(CNN)缺乏捕捉全局上下文信息的能力,而Transformer在对细粒度局部细节进行建模时存在局限性。为了克服这些挑战并推动可解释人工智能(XAI)在精准癌症诊断中的发展,本文提出了MVT - OFML(多视图Transformer在线融合相互学习),这是一种用于乳腺癌病理图像的新颖且可解释的分类框架。MVT - OFML结合了用于提取详细局部特征的ResNet - 50和用于从多个视角捕捉全面全局上下文的多视图Transformer编码模块。一个关键创新是在线融合相互学习(OFML)机制,它通过对齐中间特征表示和预测逻辑,实现了CNN和Transformer分支之间的双向知识共享。这种相互学习框架提高了性能,同时还生成了可解释的注意力图和特征级可视化,揭示了模型的决策过程——促进了透明度、可信度和临床可用性。在BreakHis和BACH数据集上进行的大量实验表明,MVT - OFML显著优于最强的基线模型,准确率分别提高了0.90%和2.26%,F分数分别提高了4.75%和3.21%。通过将互补的建模范式与可解释的学习策略相结合,MVT - OFML为精确且可解释的乳腺癌诊断和预后提供了一个有前景的人工智能解决方案,支持临床环境中的明智决策。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/93ff/12302034/951908698e08/fonc-15-1626785-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/93ff/12302034/c1a6bef1b527/fonc-15-1626785-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/93ff/12302034/73e934acfcef/fonc-15-1626785-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/93ff/12302034/b0c52c09f160/fonc-15-1626785-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/93ff/12302034/28257128560f/fonc-15-1626785-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/93ff/12302034/951908698e08/fonc-15-1626785-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/93ff/12302034/c1a6bef1b527/fonc-15-1626785-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/93ff/12302034/73e934acfcef/fonc-15-1626785-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/93ff/12302034/b0c52c09f160/fonc-15-1626785-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/93ff/12302034/28257128560f/fonc-15-1626785-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/93ff/12302034/951908698e08/fonc-15-1626785-g007.jpg

相似文献

1
Explainable multi-view transformer framework with mutual learning for precision breast cancer pathology image classification.基于相互学习的可解释多视图变压器框架用于精确乳腺癌病理图像分类。
Front Oncol. 2025 Jul 14;15:1626785. doi: 10.3389/fonc.2025.1626785. eCollection 2025.
2
Analyzing explainability of YOLO-based breast cancer detection using heat map visualizations.使用热图可视化分析基于YOLO的乳腺癌检测的可解释性。
Quant Imaging Med Surg. 2025 Jul 1;15(7):6252-6271. doi: 10.21037/qims-2024-2911. Epub 2025 Jun 30.
3
Comparative analysis of convolutional neural networks and transformer architectures for breast cancer histopathological image classification.用于乳腺癌组织病理学图像分类的卷积神经网络与Transformer架构的比较分析
Front Med (Lausanne). 2025 Jun 17;12:1606336. doi: 10.3389/fmed.2025.1606336. eCollection 2025.
4
3D-WDA-PMorph: Efficient 3D MRI/TRUS Prostate Registration using Transformer-CNN Network and Wavelet-3D-Depthwise-Attention.3D-WDA-PMorph:使用Transformer-CNN网络和小波3D深度注意力的高效3D MRI/TRUS前列腺配准
J Imaging Inform Med. 2025 Jul 25. doi: 10.1007/s10278-025-01615-2.
5
An explainable-by-design end-to-end AI framework based on prototypical part learning for lesion detection and classification in Digital Breast Tomosynthesis images.一种基于原型部分学习的可设计解释的端到端人工智能框架,用于数字乳腺断层合成图像中的病变检测和分类。
Comput Struct Biotechnol J. 2025 Jun 10;27:2649-2660. doi: 10.1016/j.csbj.2025.06.008. eCollection 2025.
6
Multi-level channel-spatial attention and light-weight scale-fusion network (MCSLF-Net): multi-level channel-spatial attention and light-weight scale-fusion transformer for 3D brain tumor segmentation.多级通道空间注意力与轻量级尺度融合网络(MCSLF-Net):用于3D脑肿瘤分割的多级通道空间注意力与轻量级尺度融合变换器
Quant Imaging Med Surg. 2025 Jul 1;15(7):6301-6325. doi: 10.21037/qims-2025-354. Epub 2025 Jun 30.
7
Advancing personalized healthcare: leveraging explainable AI for BPPV risk assessment.推进个性化医疗:利用可解释人工智能进行良性阵发性位置性眩晕风险评估。
Health Inf Sci Syst. 2024 Nov 24;13(1):1. doi: 10.1007/s13755-024-00317-3. eCollection 2025 Dec.
8
Stabilizing machine learning for reproducible and explainable results: A novel validation approach to subject-specific insights.稳定机器学习以获得可重复和可解释的结果:一种针对特定个体见解的新型验证方法。
Comput Methods Programs Biomed. 2025 Jun 21;269:108899. doi: 10.1016/j.cmpb.2025.108899.
9
Knowledge Graph-Enhanced Deep Learning Model (H-SYSTEM) for Hypertensive Intracerebral Hemorrhage: Model Development and Validation.用于高血压性脑出血的知识图谱增强深度学习模型(H-SYSTEM):模型开发与验证
J Med Internet Res. 2025 Jun 12;27:e66055. doi: 10.2196/66055.
10
UnetTransCNN: integrating transformers with convolutional neural networks for enhanced medical image segmentation.UnetTransCNN:将Transformer与卷积神经网络相结合以增强医学图像分割
Front Oncol. 2025 Jul 10;15:1467672. doi: 10.3389/fonc.2025.1467672. eCollection 2025.

本文引用的文献

1
Methodological and reporting quality of machine learning studies on cancer diagnosis, treatment, and prognosis.关于癌症诊断、治疗和预后的机器学习研究的方法学与报告质量。
Front Oncol. 2025 Apr 14;15:1555247. doi: 10.3389/fonc.2025.1555247. eCollection 2025.
2
From Silos to Synthesis: A comprehensive review of domain adaptation strategies for multi-source data integration in healthcare.从孤岛到整合:医疗保健多源数据集成领域适应策略的全面综述
Comput Biol Med. 2025 Jun;191:110108. doi: 10.1016/j.compbiomed.2025.110108. Epub 2025 Apr 9.
3
CNN-TumorNet: leveraging explainability in deep learning for precise brain tumor diagnosis on MRI images.
CNN-肿瘤网络:利用深度学习中的可解释性对MRI图像进行精确脑肿瘤诊断
Front Oncol. 2025 Mar 26;15:1554559. doi: 10.3389/fonc.2025.1554559. eCollection 2025.
4
CLIP in medical imaging: A survey.医学成像中的CLIP:一项综述。
Med Image Anal. 2025 May;102:103551. doi: 10.1016/j.media.2025.103551. Epub 2025 Mar 22.
5
Explainable AI in medical imaging: an interpretable and collaborative federated learning model for brain tumor classification.医学成像中的可解释人工智能:一种用于脑肿瘤分类的可解释且协作的联邦学习模型。
Front Oncol. 2025 Feb 27;15:1535478. doi: 10.3389/fonc.2025.1535478. eCollection 2025.
6
Integrating language into medical visual recognition and reasoning: A survey.将语言融入医学视觉识别与推理:一项综述。
Med Image Anal. 2025 May;102:103514. doi: 10.1016/j.media.2025.103514. Epub 2025 Feb 27.
7
Exploring the role of artificial intelligence in chemotherapy development, cancer diagnosis, and treatment: present achievements and future outlook.探索人工智能在化疗研发、癌症诊断和治疗中的作用:当前成就与未来展望。
Front Oncol. 2025 Feb 4;15:1475893. doi: 10.3389/fonc.2025.1475893. eCollection 2025.
8
Computer vision algorithms in healthcare: Recent advancements and future challenges.医疗保健中的计算机视觉算法:最新进展与未来挑战。
Comput Biol Med. 2025 Feb;185:109531. doi: 10.1016/j.compbiomed.2024.109531. Epub 2024 Dec 14.
9
A Commentary on Multi-omics Data Integration in Systems Vaccinology.系统疫苗学中多组学数据整合述评
J Mol Biol. 2024 Apr 15;436(8):168522. doi: 10.1016/j.jmb.2024.168522. Epub 2024 Mar 7.
10
Artificial intelligence for predictive biomarker discovery in immuno-oncology: a systematic review.人工智能在免疫肿瘤学预测生物标志物发现中的应用:系统评价。
Ann Oncol. 2024 Jan;35(1):29-65. doi: 10.1016/j.annonc.2023.10.125. Epub 2023 Oct 23.