School of Electrical and Information Engineering, Zhengzhou University, Zhengzhou 450001, China.
China Academy of Chinese Medical Sciences, Beijing 100700, China.
Molecules. 2023 Sep 4;28(17):6427. doi: 10.3390/molecules28176427.
Turtle shell () is a prized traditional Chinese dietary therapy, and the growth year of turtle shell has a significant impact on its quality attributes. In this study, a hyperspectral imaging (HSI) technique combined with a proposed deep learning (DL) network algorithm was investigated for the objective determination of the growth year of turtle shells. The acquisition of hyperspectral images was carried out in the near-infrared range (948.72-2512.97 nm) from samples spanning five different growth years. To fully exploit the spatial and spectral information while reducing redundancy in hyperspectral data simultaneously, three modules were developed. First, the spectral-spatial attention (SSA) module was developed to better protect the spectral correlation among spectral bands and capture fine-grained spatial information of hyperspectral images. Second, the 3D convolutional neural network (CNN), more suitable for the extracted 3D feature map, was employed to facilitate the joint spatial-spectral feature representation. Thirdly, to overcome the constraints of convolution kernels as well as better capture long-range correlation between spectral bands, the transformer encoder (TE) module was further designed. These modules were harmoniously orchestrated, driven by the need to effectively leverage both spatial and spectral information within hyperspectral data. They collectively enhance the model's capacity to extract joint spatial and spectral features to discern growth years accurately. Experimental studies demonstrated that the proposed model (named SSA-3DTE) achieved superior classification accuracy, with 98.94% on average for five-category classification, outperforming traditional machine learning methods using only spectral information and representative deep learning methods. Also, ablation experiments confirmed the effectiveness of each module to improve performance. The encouraging results of this study revealed the potentiality of HSI combined with the DL algorithm as an efficient and non-destructive method for the quality control of turtle shells.
龟甲()是一种珍贵的传统中医食疗品,龟甲的生长年份对其品质属性有重要影响。本研究采用高光谱成像(HSI)技术结合提出的深度学习(DL)网络算法,对龟甲的生长年份进行客观测定。在近红外波段(948.72-2512.97nm)采集了跨越五个不同生长年份的样本的高光谱图像。为了充分利用空间和光谱信息,同时减少高光谱数据的冗余,开发了三个模块。首先,开发了光谱-空间注意力(SSA)模块,以更好地保护光谱带之间的光谱相关性,并捕获高光谱图像的细粒度空间信息。其次,采用更适合提取 3D 特征图的 3D 卷积神经网络(CNN),有利于联合空间-光谱特征表示。第三,为了克服卷积核的限制,更好地捕捉光谱带之间的长程相关性,进一步设计了变压器编码器(TE)模块。这些模块协同工作,需要有效地利用高光谱数据中的空间和光谱信息。它们共同提高了模型提取联合空间和光谱特征的能力,从而准确识别生长年份。实验研究表明,所提出的模型(命名为 SSA-3DTE)在五类分类中平均达到 98.94%的优异分类精度,优于仅使用光谱信息的传统机器学习方法和代表性的深度学习方法。此外,消融实验证实了每个模块提高性能的有效性。该研究的令人鼓舞的结果表明,HSI 结合 DL 算法作为一种高效、无损的龟甲质量控制方法具有潜力。