Department of Pathology, Aarhus University Hospital, Palle Juul-Jensens Boulevard 35, DK-8200 Aarhus, Denmark.
Department of Clinical Medicine, Aarhus University, Palle Juul-Jensens Boulevard 82, DK-8200 Aarhus, Denmark.
Int J Environ Res Public Health. 2022 Nov 2;19(21):14327. doi: 10.3390/ijerph192114327.
Deep learning for the analysis of H&E stains requires a large annotated training set. This may form a labor-intensive task involving highly skilled pathologists. We aimed to optimize and evaluate computer-assisted annotation based on digital dual stains of the same tissue section. H&E stains of primary and metastatic melanoma ( = 77) were digitized, re-stained with SOX10, and re-scanned. Because images were aligned, annotations of SOX10 image analysis were directly transferred to H&E stains of the training set. Based on 1,221,367 annotated nuclei, a convolutional neural network for calculating tumor burden (CNN) was developed. For primary melanomas, precision of annotation was 100% (95%CI, 99% to 100%) for tumor cells and 99% (95%CI, 98% to 100%) for normal cells. Due to low or missing tumor-cell SOX10 positivity, precision for normal cells was markedly reduced in lymph-node and organ metastases compared with primary melanomas ( < 0.001). Compared with stereological counts within skin lesions, mean difference in tumor burden was 6% (95%CI, -1% to 13%, = 0.10) for CNN and 16% (95%CI, 4% to 28%, = 0.02) for pathologists. Conclusively, the technique produced a large annotated H&E training set with high quality within a reasonable timeframe for primary melanomas and subcutaneous metastases. For these lesion types, the training set generated a high-performing CNN, which was superior to the routine assessments of pathologists.
深度学习分析 H&E 染色需要大量标注的训练集。这可能是一项劳动密集型任务,需要高度熟练的病理学家参与。我们旨在通过对同一组织切片的数字双染色进行优化和评估计算机辅助标注。对原发和转移性黑色素瘤(=77)的 H&E 染色进行数字化、再用 SOX10 染色并重新扫描。由于图像对齐,SOX10 图像分析的标注可直接转移到训练集中的 H&E 染色。基于 1,221,367 个标注核,开发了用于计算肿瘤负担的卷积神经网络(CNN)。对于原发黑色素瘤,肿瘤细胞的标注精度为 100%(95%CI,99%至 100%),正常细胞的标注精度为 99%(95%CI,98%至 100%)。由于淋巴结和器官转移中肿瘤细胞 SOX10 阳性率低或缺失,正常细胞的标注精度明显低于原发黑色素瘤(<0.001)。与皮肤病变内的体视学计数相比,CNN 组的肿瘤负担平均差异为 6%(95%CI,-1%至 13%, = 0.10),而病理学家的差异为 16%(95%CI,4%至 28%, = 0.02)。总之,该技术在合理的时间内为原发黑色素瘤和皮下转移生成了具有高质量的大型 H&E 训练集。对于这些病变类型,生成的训练集产生了性能较高的 CNN,优于病理学家的常规评估。