Department of Computer Engineering, Yıldız Technical University, Istanbul, Turkey; Health Institutes of Türkiye, Istanbul, Turkey.
Department of Computer Engineering, Yıldız Technical University, Istanbul, Turkey; BILGEM TUBITAK, Kocaeli, Turkey.
Lab Invest. 2024 Oct;104(10):102130. doi: 10.1016/j.labinv.2024.102130. Epub 2024 Sep 2.
In digital pathology, accurate mitosis detection in histopathological images is critical for cancer diagnosis and prognosis. However, this remains challenging due to the inherent variability in cell morphology and the domain shift problem. This study introduces ConvNext Mitosis Identification-You Only Look Once (CNMI-YOLO), a new 2-stage deep learning method that uses the YOLOv7 architecture for cell detection and the ConvNeXt architecture for cell classification. The goal is to improve the identification of mitosis in different types of cancers. We utilized the Mitosis Domain Generalization Challenge 2022 data set in the experiments to ensure the model's robustness and success across various scanners, species, and cancer types. The CNMI-YOLO model demonstrates superior performance in accurately detecting mitotic cells, significantly outperforming existing models in terms of precision, recall, and F1 score. The CNMI-YOLO model achieved an F1 score of 0.795 on the Mitosis Domain Generalization Challenge 2022 and demonstrated robust generalization with F1 scores of 0.783 and 0.759 on the external melanoma and sarcoma test sets, respectively. Additionally, the study included ablation studies to evaluate various object detection and classification models, such as Faster-RCNN and Swin Transformer. Furthermore, we assessed the model's robustness performance on unseen data, confirming its ability to generalize and its potential for real-world use in digital pathology, using soft tissue sarcoma and melanoma samples not included in the training data set.
在数字病理学中,准确检测组织病理学图像中的有丝分裂对于癌症的诊断和预后至关重要。然而,由于细胞形态的固有可变性和领域转移问题,这仍然具有挑战性。本研究介绍了 ConvNext 有丝分裂识别-只看一次(CNMI-YOLO),这是一种新的两阶段深度学习方法,使用 YOLOv7 架构进行细胞检测,使用 ConvNeXt 架构进行细胞分类。目标是提高不同类型癌症中对有丝分裂的识别能力。我们在实验中利用了 2022 年有丝分裂领域泛化挑战数据集,以确保模型在各种扫描仪、物种和癌症类型中具有鲁棒性和成功性。CNMI-YOLO 模型在准确检测有丝分裂细胞方面表现出卓越的性能,在精度、召回率和 F1 分数方面明显优于现有模型。CNMI-YOLO 模型在 2022 年有丝分裂领域泛化挑战中获得了 0.795 的 F1 分数,并在外部黑色素瘤和肉瘤测试集上分别获得了 0.783 和 0.759 的稳健泛化 F1 分数。此外,该研究还包括消融研究,以评估各种目标检测和分类模型,如 Faster-RCNN 和 Swin Transformer。此外,我们评估了模型在未见数据上的稳健性性能,证实了其泛化能力以及在数字病理学中实际应用的潜力,使用了未包含在训练数据集的软组织肉瘤和黑色素瘤样本。