Lee Li-Yu, Yang Cheng-Han, Lin Yu-Chieh, Hsieh Yu-Han, Chen Yung-An, Chang Margaret Dah-Tsyr, Lin Yen-Yin, Liao Chun-Ta
Department of Pathology, Chang Gung Memorial Hospital and Chang Gung University, Taoyuan, Taiwan.
Department of Strategic Technology, JelloX Biotech Inc., Hsinchu, Taiwan.
Front Oncol. 2022 Oct 24;12:951560. doi: 10.3389/fonc.2022.951560. eCollection 2022.
Perineural invasion (PNI), a form of local invasion defined as the ability of cancer cells to invade in, around, and through nerves, has a negative prognostic impact in oral cavity squamous cell carcinoma (OCSCC). Unfortunately, the diagnosis of PNI suffers from a significant degree of intra- and interobserver variability. The aim of this pilot study was to develop a deep learning-based human-enhanced tool, termed domain knowledge enhanced yield (Domain-KEY) algorithm, for identifying PNI in digital slides.
Hematoxylin and eosin (H&E)-stained whole-slide images (WSIs, n = 85) were obtained from 80 patients with OCSCC. The model structure consisted of two parts to simulate human decision-making skills in diagnostic pathology. To this aim, two semantic segmentation models were constructed (i.e., identification of nerve fibers followed by the diagnosis of PNI). The inferred results were subsequently subjected to post-processing of generated decision rules for diagnostic labeling. Ten H&E-stained WSIs not previously used in the study were read and labeled by the Domain-KEY algorithm. Thereafter, labeling correctness was visually inspected by two independent pathologists.
The Domain-KEY algorithm was found to outperform the ResnetV2_50 classifier for the detection of PNI (diagnostic accuracy: 89.01% and 61.94%, respectively). On analyzing WSIs, the algorithm achieved a mean diagnostic accuracy as high as 97.50% traditional pathology. The observed accuracy in a validation dataset of 25 WSIs obtained from seven patients with oropharyngeal (cancer of the tongue base, n = 1; tonsil cancer, n = 1; soft palate cancer, n = 1) and hypopharyngeal (cancer of posterior wall, n = 2; pyriform sinus cancer, n = 2) malignancies was 96%. Notably, the algorithm was successfully applied in the analysis of WSIs to shorten the time required to reach a diagnosis. The addition of the model decreased the mean time required to reach a diagnosis by 15.0% and 23.7% for the first and second pathologists, respectively. On analyzing digital slides, the tool was effective in supporting human diagnostic thinking.
The Domain-KEY algorithm successfully mimicked human decision-making skills and supported expert pathologists in the routine diagnosis of PNI.
神经周围浸润(PNI)是一种局部浸润形式,定义为癌细胞侵入、围绕并穿过神经的能力,对口腔鳞状细胞癌(OCSCC)的预后有负面影响。不幸的是,PNI的诊断存在显著的观察者内和观察者间差异。本试点研究的目的是开发一种基于深度学习的人机增强工具,称为领域知识增强产量(Domain-KEY)算法,用于在数字切片中识别PNI。
从80例OCSCC患者中获取苏木精和伊红(H&E)染色的全切片图像(WSIs,n = 85)。模型结构由两部分组成,以模拟诊断病理学中的人类决策技能。为此,构建了两个语义分割模型(即识别神经纤维,然后诊断PNI)。随后,对推断结果进行生成诊断标签的决策规则的后处理。由Domain-KEY算法读取并标记10张先前未用于该研究的H&E染色WSIs。此后,由两名独立病理学家目视检查标记的正确性。
发现Domain-KEY算法在检测PNI方面优于ResnetV2_50分类器(诊断准确率分别为89.01%和61.94%)。在分析WSIs时,该算法的平均诊断准确率高达97.50%,高于传统病理学。在从7例口咽(舌根癌,n = 1;扁桃体癌,n = 1;软腭癌,n = 1)和下咽(后壁癌,n = 2;梨状窦癌,n = 2)恶性肿瘤患者获得的25张WSIs的验证数据集中观察到的准确率为96%。值得注意的是,该算法成功应用于WSIs分析,以缩短做出诊断所需的时间。该模型的加入分别使第一位和第二位病理学家做出诊断所需的平均时间减少了15.0%和23.7%。在分析数字切片时,该工具有效地支持了人类的诊断思维。
Domain-KEY算法成功地模仿了人类决策技能,并在PNI的常规诊断中支持专家病理学家。