Du Jian, Tao Chenglong, Xue Shuang, Zhang Zhoufeng
Key Laboratory of Spectral Imaging Technology CAS, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an 710119, China.
Xi'an Key Laboratory for Biomedical Spectroscopy, Xi'an 710119, China.
Diagnostics (Basel). 2023 Jun 8;13(12):2002. doi: 10.3390/diagnostics13122002.
In order to improve the clinical application of hyperspectral technology in the pathological diagnosis of tumor tissue, a joint diagnostic method based on spectral-spatial transfer features was established by simulating the actual clinical diagnosis process and combining micro-hyperspectral imaging with large-scale pathological data. In view of the limited sample volume of medical hyperspectral data, a multi-data transfer model pre-trained on conventional pathology datasets was applied to the classification task of micro-hyperspectral images, to explore the differences in spectral-spatial transfer features in the wavelength of 410-900 nm between tumor tissues and normal tissues. The experimental results show that the spectral-spatial transfer convolutional neural network (SST-CNN) achieved a classification accuracy of 95.46% for the gastric cancer dataset and 95.89% for the thyroid cancer dataset, thus outperforming models trained on single conventional digital pathology and single hyperspectral data. The joint diagnostic method established based on SST-CNN can complete the interpretation of a section of data in 3 min, thus providing a new technical solution for the rapid diagnosis of pathology. This study also explored problems involving the correlation between tumor tissues and typical spectral-spatial features, as well as the efficient transformation of conventional pathological and transfer spectral-spatial features, which solidified the theoretical research on hyperspectral pathological diagnosis.
为提高高光谱技术在肿瘤组织病理诊断中的临床应用水平,通过模拟实际临床诊断过程,将显微高光谱成像与大规模病理数据相结合,建立了一种基于光谱-空间转移特征的联合诊断方法。鉴于医学高光谱数据样本量有限,将在传统病理数据集上预训练的多数据转移模型应用于显微高光谱图像的分类任务,以探究肿瘤组织与正常组织在410-900nm波长范围内光谱-空间转移特征的差异。实验结果表明,光谱-空间转移卷积神经网络(SST-CNN)在胃癌数据集上的分类准确率达到95.46%,在甲状腺癌数据集上达到95.89%,优于基于单一传统数字病理和单一高光谱数据训练的模型。基于SST-CNN建立的联合诊断方法能够在3分钟内完成一段数据的解读,为病理快速诊断提供了一种新的技术解决方案。本研究还探讨了肿瘤组织与典型光谱-空间特征之间的相关性以及传统病理特征与转移光谱-空间特征的有效转换等问题,夯实了高光谱病理诊断的理论研究基础。