Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an 710119, China.
University of Chinese Academy of Sciences, Beijing 100049, China.
Cells. 2023 Jan 19;12(3):379. doi: 10.3390/cells12030379.
Identifying infectious pathogens quickly and accurately is significant for patients and doctors. Identifying single bacterial strains is significant in eliminating culture and speeding up diagnosis. We present an advanced optical method for the rapid detection of infectious (including common and uncommon) pathogens by combining hyperspectral microscopic imaging and deep learning. To acquire more information regarding the pathogens, we developed a hyperspectral microscopic imaging system with a wide wavelength range and fine spectral resolution. Furthermore, an end-to-end deep learning network based on feature fusion, called BI-Net, was designed to extract the species-dependent features encoded in cell-level hyperspectral images as the fingerprints for species differentiation. After being trained based on a large-scale dataset that we built to identify common pathogens, BI-Net was used to classify uncommon pathogens via transfer learning. An extensive analysis demonstrated that BI-Net was able to learn species-dependent characteristics, with the classification accuracy and Kappa coefficients being 92% and 0.92, respectively, for both common and uncommon species. Our method outperformed state-of-the-art methods by a large margin and its excellent performance demonstrates its excellent potential in clinical practice.
快速准确地识别感染性病原体对患者和医生都非常重要。鉴定单一的细菌菌株对于消除培养和加速诊断具有重要意义。我们提出了一种结合高光谱显微镜成像和深度学习的快速检测传染病(包括常见和罕见)病原体的先进光学方法。为了获取更多有关病原体的信息,我们开发了一种具有宽波长范围和精细光谱分辨率的高光谱显微镜成像系统。此外,我们设计了一个基于特征融合的端到端深度学习网络,称为 BI-Net,用于提取细胞级高光谱图像中编码的与物种相关的特征,作为物种分化的指纹。在基于我们构建的用于识别常见病原体的大型数据集进行训练后,BI-Net 用于通过迁移学习对罕见病原体进行分类。广泛的分析表明,BI-Net 能够学习物种相关的特征,对于常见和罕见物种,分类准确率和 Kappa 系数分别为 92%和 0.92。我们的方法大大优于最先进的方法,其出色的性能证明了它在临床实践中的巨大潜力。