Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai, China.
Engineering Research Center of Nanophotonics & Advanced Instrument, Ministry of Education, East China Normal University, Shanghai, China.
J Biophotonics. 2022 Nov;15(11):e202200163. doi: 10.1002/jbio.202200163. Epub 2022 Aug 1.
Gastric cancer (GC) is one of the most common cancers worldwide. A lot of studies have found that early GC has good prognosis. Unfortunately, the diagnosis rate of early GC is suboptimal due to inadequate disease screening and the insidious nature of early lesions. Pathological diagnosis is usually regarded as the "gold standard" for the diagnosis of GC. However, traditional pathological diagnosis is tedious and time-consuming. With the development of deep learning, computer-aided diagnosis is widely used to assist pathologists for diagnosis. As conventional pathology, diagnosis is based on color images, it is not as informative as hyperspectral imaging, which introduces spectroscopy into imaging techniques. This article combines microscopic hyperspectral image (HSI) with deep learning networks to assist in the diagnosis of precancerous lesions in gastric cancer (PLGC). A large scale microscopic hyperspectral PLGC dataset with 924 effective scenes is built and self-supervised learning is adopted to provide pretrained models for HSI. These pretrained models effectively improve the performance of downstream classification tasks. Furthermore, a symmetrically deep connected network is proposed to train with images from different imaging modalities and improve the diagnostic accuracy to 96.59%.
胃癌(GC)是全球最常见的癌症之一。大量研究发现早期 GC 具有良好的预后。不幸的是,由于疾病筛查不足和早期病变的隐匿性,早期 GC 的诊断率并不理想。病理诊断通常被认为是 GC 诊断的“金标准”。然而,传统的病理诊断繁琐且耗时。随着深度学习的发展,计算机辅助诊断被广泛用于辅助病理学家进行诊断。与常规病理学一样,诊断基于彩色图像,其信息量不如将光谱学引入成像技术的高光谱成像。本文将微观高光谱图像(HSI)与深度学习网络相结合,以辅助诊断胃癌前病变(PLGC)。建立了一个具有 924 个有效场景的大规模微观高光谱 PLGC 数据集,并采用自监督学习为 HSI 提供预训练模型。这些预训练模型有效地提高了下游分类任务的性能。此外,还提出了一种对称深度连接网络,用于训练来自不同成像模式的图像,并将诊断准确率提高到 96.59%。