Fang Tianyu, Li Zhenyu, Zhang Jialin, Qi Dawei, Zhang Lei
College of Mechanical and Electrical Engineering, Northeast Forestry University, Harbin 150040, China.
Dean's Office, The Open University of Harbin, Harbin 150001, China.
J Imaging. 2023 Jul 30;9(8):154. doi: 10.3390/jimaging9080154.
An open-set recognition scheme for tree leaves based on deep learning feature extraction is presented in this study. Deep learning algorithms are used to extract leaf features for different wood species, and the leaf set of a wood species is divided into two datasets: the leaf set of a known wood species and the leaf set of an unknown species. The deep learning network (CNN) is trained on the leaves of selected known wood species, and the features of the remaining known wood species and all unknown wood species are extracted using the trained CNN. Then, the single-class classification is performed using the weighted SVDD algorithm to recognize the leaves of known and unknown wood species. The features of leaves recognized as known wood species are fed back to the trained CNN to recognize the leaves of known wood species. The recognition results of a single-class classifier for known and unknown wood species are combined with the recognition results of a multi-class CNN to finally complete the open recognition of wood species. We tested the proposed method on the publicly available Swedish Leaf Dataset, which includes 15 wood species (5 species used as known and 10 species used as unknown). The test results showed that, with F1 scores of 0.7797 and 0.8644, mixed recognition rates of 95.15% and 93.14%, and Kappa coefficients of 0.7674 and 0.8644 under two different data distributions, the proposed method outperformed the state-of-the-art open-set recognition algorithms in all three aspects. And, the more wood species that are known, the better the recognition. This approach can extract effective features from tree leaf images for open-set recognition and achieve wood species recognition without compromising tree material.
本研究提出了一种基于深度学习特征提取的树叶开放集识别方案。利用深度学习算法提取不同木材种类的树叶特征,并将某一木材种类的树叶集划分为两个数据集:已知木材种类的树叶集和未知种类的树叶集。在选定的已知木材种类的树叶上训练深度学习网络(CNN),并使用训练好的CNN提取其余已知木材种类和所有未知木材种类的特征。然后,使用加权SVDD算法进行单类分类,以识别已知和未知木材种类的树叶。将被识别为已知木材种类的树叶特征反馈给训练好的CNN,以识别已知木材种类的树叶。将单类分类器对已知和未知木材种类的识别结果与多类CNN的识别结果相结合,最终完成木材种类的开放识别。我们在公开可用的瑞典树叶数据集上测试了所提出的方法,该数据集包括15种木材(5种用作已知种类,10种用作未知种类)。测试结果表明,在两种不同的数据分布下,所提出的方法在F1分数分别为0.7797和0.8644、混合识别率分别为95.15%和93.14%、Kappa系数分别为0.7674和0.8644这三个方面均优于当前最先进的开放集识别算法。而且,已知的木材种类越多,识别效果越好。这种方法可以从树叶图像中提取有效的特征用于开放集识别,并在不损害树木材料的情况下实现木材种类识别。