• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

对比多实例学习:一种用于在无标签情况下学习全切片组织病理学图像的幻灯片级表示的无监督框架。

Contrastive Multiple Instance Learning: An Unsupervised Framework for Learning Slide-Level Representations of Whole Slide Histopathology Images without Labels.

作者信息

Tavolara Thomas E, Gurcan Metin N, Niazi M Khalid Khan

机构信息

Center for Biomedical Informatics, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA.

出版信息

Cancers (Basel). 2022 Nov 24;14(23):5778. doi: 10.3390/cancers14235778.

DOI:10.3390/cancers14235778
PMID:36497258
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9738801/
Abstract

Recent methods in computational pathology have trended towards semi- and weakly-supervised methods requiring only slide-level labels. Yet, even slide-level labels may be absent or irrelevant to the application of interest, such as in clinical trials. Hence, we present a fully unsupervised method to learn meaningful, compact representations of WSIs. Our method initially trains a tile-wise encoder using SimCLR, from which subsets of tile-wise embeddings are extracted and fused via an attention-based multiple-instance learning framework to yield slide-level representations. The resulting set of intra-slide-level and inter-slide-level embeddings are attracted and repelled via contrastive loss, respectively. This resulted in slide-level representations with self-supervision. We applied our method to two tasks- (1) non-small cell lung cancer subtyping (NSCLC) as a classification prototype and (2) breast cancer proliferation scoring (TUPAC16) as a regression prototype-and achieved an AUC of 0.8641 ± 0.0115 and correlation (R) of 0.5740 ± 0.0970, respectively. Ablation experiments demonstrate that the resulting unsupervised slide-level feature space can be fine-tuned with small datasets for both tasks. Overall, our method approaches computational pathology in a novel manner, where meaningful features can be learned from whole-slide images without the need for annotations of slide-level labels. The proposed method stands to benefit computational pathology, as it theoretically enables researchers to benefit from completely unlabeled whole-slide images.

摘要

计算病理学的最新方法已趋向于采用仅需玻片级标签的半监督和弱监督方法。然而,即使是玻片级标签也可能缺失或与感兴趣的应用无关,例如在临床试验中。因此,我们提出了一种完全无监督的方法来学习有意义的、紧凑的全切片图像表示。我们的方法首先使用SimCLR训练一个逐块编码器,从中提取逐块嵌入的子集,并通过基于注意力的多实例学习框架进行融合,以生成玻片级表示。通过对比损失分别对所得的玻片内级和玻片间级嵌入集进行吸引和排斥。这产生了具有自监督的玻片级表示。我们将我们的方法应用于两项任务——(1)将非小细胞肺癌亚型分类(NSCLC)作为分类原型,(2)将乳腺癌增殖评分(TUPAC16)作为回归原型——分别实现了0.8641±0.0115的曲线下面积(AUC)和0.5740±0.0970的相关性(R)。消融实验表明,所得的无监督玻片级特征空间可以用小数据集对这两项任务进行微调。总体而言,我们的方法以一种新颖的方式处理计算病理学,即可以从全切片图像中学习有意义的特征,而无需玻片级标签的注释。所提出的方法有望使计算病理学受益,因为从理论上讲,它使研究人员能够从完全未标记的全切片图像中受益。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7a29/9738801/660a150bb327/cancers-14-05778-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7a29/9738801/232e79951f69/cancers-14-05778-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7a29/9738801/331547c19813/cancers-14-05778-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7a29/9738801/660a150bb327/cancers-14-05778-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7a29/9738801/232e79951f69/cancers-14-05778-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7a29/9738801/331547c19813/cancers-14-05778-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7a29/9738801/660a150bb327/cancers-14-05778-g003.jpg

相似文献

1
Contrastive Multiple Instance Learning: An Unsupervised Framework for Learning Slide-Level Representations of Whole Slide Histopathology Images without Labels.对比多实例学习:一种用于在无标签情况下学习全切片组织病理学图像的幻灯片级表示的无监督框架。
Cancers (Basel). 2022 Nov 24;14(23):5778. doi: 10.3390/cancers14235778.
2
Iterative multiple instance learning for weakly annotated whole slide image classification.基于迭代多示例学习的弱标注全切片图像分类。
Phys Med Biol. 2023 Jul 19;68(15). doi: 10.1088/1361-6560/acde3f.
3
SAMPLER: unsupervised representations for rapid analysis of whole slide tissue images.SAMPLER:用于快速分析全玻片组织图像的无监督表示。
EBioMedicine. 2024 Jan;99:104908. doi: 10.1016/j.ebiom.2023.104908. Epub 2023 Dec 14.
4
DeepSMILE: Contrastive self-supervised pre-training benefits MSI and HRD classification directly from H&E whole-slide images in colorectal and breast cancer.DeepSMILE:从结直肠癌和乳腺癌的 H&E 全切片图像中直接进行对比自监督预训练,有利于 MSI 和 HRD 分类。
Med Image Anal. 2022 Jul;79:102464. doi: 10.1016/j.media.2022.102464. Epub 2022 Apr 29.
5
Masked hypergraph learning for weakly supervised histopathology whole slide image classification.基于掩蔽超图学习的弱监督病理切片图像分类。
Comput Methods Programs Biomed. 2024 Aug;253:108237. doi: 10.1016/j.cmpb.2024.108237. Epub 2024 May 23.
6
Local contrastive loss with pseudo-label based self-training for semi-supervised medical image segmentation.基于伪标签自训练的局部对比损失的半监督医学图像分割。
Med Image Anal. 2023 Jul;87:102792. doi: 10.1016/j.media.2023.102792. Epub 2023 Mar 11.
7
Unsupervised mutual transformer learning for multi-gigapixel Whole Slide Image classification.无监督的多千兆像素全幻灯片图像分类的互变压器学习。
Med Image Anal. 2024 Aug;96:103203. doi: 10.1016/j.media.2024.103203. Epub 2024 May 21.
8
Prototypical multiple instance learning for predicting lymph node metastasis of breast cancer from whole-slide pathological images.用于从全切片病理图像预测乳腺癌淋巴结转移的典型多实例学习
Med Image Anal. 2023 Apr;85:102748. doi: 10.1016/j.media.2023.102748. Epub 2023 Jan 13.
9
MuRCL: Multi-Instance Reinforcement Contrastive Learning for Whole Slide Image Classification.MuRCL:用于全切片图像分类的多实例强化对比学习。
IEEE Trans Med Imaging. 2023 May;42(5):1337-1348. doi: 10.1109/TMI.2022.3227066. Epub 2023 May 2.
10
Contrastive learning-based histopathological features infer molecular subtypes and clinical outcomes of breast cancer from unannotated whole slide images.基于对比学习的组织病理学特征可从无注释全切片图像推断乳腺癌的分子亚型和临床结局。
Comput Biol Med. 2024 Mar;170:107997. doi: 10.1016/j.compbiomed.2024.107997. Epub 2024 Jan 19.

引用本文的文献

1
HistoChat: Instruction-tuning multimodal vision language assistant for colorectal histopathology on limited data.HistoChat:用于有限数据上的结直肠癌组织病理学的指令微调多模态视觉语言助手。
Patterns (N Y). 2025 May 30;6(8):101284. doi: 10.1016/j.patter.2025.101284. eCollection 2025 Aug 8.
2
Model-Agnostic Binary Patch Grouping for Bone Marrow Whole Slide Image Representation.基于模型无关二进制斑块分组的骨髓全切片图像表示方法。
Am J Pathol. 2024 May;194(5):721-734. doi: 10.1016/j.ajpath.2024.01.012. Epub 2024 Feb 5.
3
Translating prognostic quantification of c-MYC and BCL2 from tissue microarrays to whole slide images in diffuse large B-cell lymphoma using deep learning.

本文引用的文献

1
A self-supervised contrastive learning approach for whole slide image representation in digital pathology.一种用于数字病理学中全切片图像表征的自监督对比学习方法。
J Pathol Inform. 2022 Aug 28;13:100133. doi: 10.1016/j.jpi.2022.100133. eCollection 2022.
2
RetCCL: Clustering-guided contrastive learning for whole-slide image retrieval.RetCCL:用于全切片图像检索的聚类引导对比学习
Med Image Anal. 2023 Jan;83:102645. doi: 10.1016/j.media.2022.102645. Epub 2022 Oct 1.
3
Transformer-based unsupervised contrastive learning for histopathological image classification.
利用深度学习技术将弥漫性大 B 细胞淋巴瘤组织微阵列中 c-MYC 和 BCL2 的预后定量结果转化为全切片图像。
Diagn Pathol. 2024 Jan 19;19(1):17. doi: 10.1186/s13000-023-01425-6.
4
SAMPLER: unsupervised representations for rapid analysis of whole slide tissue images.SAMPLER:用于快速分析全玻片组织图像的无监督表示。
EBioMedicine. 2024 Jan;99:104908. doi: 10.1016/j.ebiom.2023.104908. Epub 2023 Dec 14.
5
Attention2Minority: A salient instance inference-based multiple instance learning for classifying small lesions in whole slide images.关注少数:基于显著实例推断的多实例学习方法,用于分类全切片图像中的小病变。
Comput Biol Med. 2023 Dec;167:107607. doi: 10.1016/j.compbiomed.2023.107607. Epub 2023 Oct 20.
6
Deep Learning for Lung Cancer Diagnosis, Prognosis and Prediction Using Histological and Cytological Images: A Systematic Review.使用组织学和细胞学图像的深度学习在肺癌诊断、预后和预测中的应用:一项系统综述。
Cancers (Basel). 2023 Aug 5;15(15):3981. doi: 10.3390/cancers15153981.
7
BCR-Net: A deep learning framework to predict breast cancer recurrence from histopathology images.BCR-Net:一种从组织病理学图像预测乳腺癌复发的深度学习框架。
PLoS One. 2023 Apr 4;18(4):e0283562. doi: 10.1371/journal.pone.0283562. eCollection 2023.
8
Phenotyping the Histopathological Subtypes of Non-Small-Cell Lung Carcinoma: How Beneficial Is Radiomics?非小细胞肺癌组织病理学亚型的表型分析:影像组学有多大益处?
Diagnostics (Basel). 2023 Mar 18;13(6):1167. doi: 10.3390/diagnostics13061167.
基于 Transformer 的无监督对比学习在组织病理学图像分类中的应用。
Med Image Anal. 2022 Oct;81:102559. doi: 10.1016/j.media.2022.102559. Epub 2022 Jul 30.
4
iMIL4PATH: A Semi-Supervised Interpretable Approach for Colorectal Whole-Slide Images.iMIL4PATH:一种用于结直肠癌全切片图像的半监督可解释方法。
Cancers (Basel). 2022 May 18;14(10):2489. doi: 10.3390/cancers14102489.
5
Attention2majority: Weak multiple instance learning for regenerative kidney grading on whole slide images.关注多数:基于全切片图像的肾脏再生分级的弱多重实例学习。
Med Image Anal. 2022 Jul;79:102462. doi: 10.1016/j.media.2022.102462. Epub 2022 Apr 17.
6
Fine-Tuned DenseNet-169 for Breast Cancer Metastasis Prediction Using FastAI and 1-Cycle Policy.使用 FastAI 和 1-Cycle 策略对密集型 DenseNet-169 进行微调,以进行乳腺癌转移预测。
Sensors (Basel). 2022 Apr 13;22(8):2988. doi: 10.3390/s22082988.
7
Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learning.基于自监督对比学习的双流多实例学习网络用于全切片图像分类
Conf Comput Vis Pattern Recognit Workshops. 2021 Jun;2021:14318-14328. doi: 10.1109/CVPR46437.2021.01409. Epub 2021 Nov 13.
8
Federated learning for computational pathology on gigapixel whole slide images.基于千兆像素全切片图像的计算病理学联邦学习。
Med Image Anal. 2022 Feb;76:102298. doi: 10.1016/j.media.2021.102298. Epub 2021 Nov 25.
9
Lung cancer subtype classification using histopathological images based on weakly supervised multi-instance learning.基于弱监督多实例学习的组织病理学图像肺癌亚型分类
Phys Med Biol. 2021 Dec 2;66(23). doi: 10.1088/1361-6560/ac3b32.
10
Self-supervised driven consistency training for annotation efficient histopathology image analysis.用于高效标注组织病理学图像分析的自监督驱动一致性训练
Med Image Anal. 2022 Jan;75:102256. doi: 10.1016/j.media.2021.102256. Epub 2021 Oct 13.