Yang Sen, Feng Quan, Zhang Jianhua, Yang Wanxia, Zhou Wenwei, Yan Wenbo
College of Mechanical and Electrical Engineering, Gansu Agricultural University, Lanzhou, China.
Agricultural Information Institute, Chinese Academy of Agricultural Sciences, Beijing, China.
Front Plant Sci. 2024 Dec 18;15:1434222. doi: 10.3389/fpls.2024.1434222. eCollection 2024.
Few-shot learning (FSL) methods have made remarkable progress in the field of plant disease recognition, especially in scenarios with limited available samples. However, current FSL approaches are usually limited to a restrictive setting where base classes and novel classes come from the same domain such as PlantVillage. Consequently, when the model is generalized to new domains (field disease datasets), its performance drops sharply. In this work, we revisit the cross-domain performance of existing FSL methods from both data and model perspectives, aiming to better achieve cross-domain generalization of disease by exploring inter-domain correlations. Specifically, we propose a broader cross-domain few-shot learning(CD-FSL) framework for crop disease identification that allows the classifier to generalize to previously unseen categories and domains. Within this framework, three representative CD-FSL models were developed by integrating the Brownian distance covariance (BCD) module and improving the general feature extractor, namely metric-based CD-FSL(CDFSL-BDC), optimization-based CD-FSL(CDFSL-MAML), and non-meta-learning-based CD-FSL (CDFSL-NML). To capture the impact of domain shift on model performance, six public datasets with inconsistent feature distributions between domains were selected as source domains. We provide a unified testbed to conduct extensive meta-training and meta-testing experiments on the proposed benchmarks to evaluate the generalization performance of CD-FSL in the disease domain. The results showed that the accuracy of the three CD-FSL models improved significantly as the inter-domain similarity increased. Compared with other state-of-the-art CD-FSL models, the CDFSL-BDC models had the best average performance under different domain gaps. Shifting from the pest domain to the crop disease domain, the CDFSL-BDC model achieved an accuracy of 63.95% and 80.13% in the 1-shot/5-shot setting, respectively. Furthermore, extensive evaluation on a multi-domain datasets demonstrated that multi-domain learning exhibits stronger domain transferability compared to single-domain learning when there is a large domain gap between the source and target domain. These comparative results suggest that optimizing the CD-FSL method from a data perspective is highly effective for solving disease identification tasks in field environments. This study holds promise for expanding the application of deep learning techniques in disease detection and provides a technical reference for cross-domain disease detection.
少样本学习(FSL)方法在植物病害识别领域取得了显著进展,尤其是在可用样本有限的场景中。然而,当前的FSL方法通常局限于一种受限的设置,即基类和新类来自同一领域,如植物村(PlantVillage)。因此,当模型推广到新领域(田间病害数据集)时,其性能会急剧下降。在这项工作中,我们从数据和模型两个角度重新审视现有FSL方法的跨域性能,旨在通过探索域间相关性更好地实现病害的跨域泛化。具体而言,我们提出了一种用于作物病害识别的更广泛的跨域少样本学习(CD-FSL)框架,该框架允许分类器推广到以前未见过的类别和领域。在此框架内,通过集成布朗距离协方差(BCD)模块并改进通用特征提取器,开发了三种代表性的CD-FSL模型,即基于度量的CD-FSL(CDFSL-BDC)、基于优化的CD-FSL(CDFSL-MAML)和基于非元学习的CD-FSL(CDFSL-NML)。为了捕捉域转移对模型性能的影响,选择了六个域间特征分布不一致的公共数据集作为源域。我们提供了一个统一的测试平台,在所提出的基准上进行广泛的元训练和元测试实验,以评估CD-FSL在病害领域的泛化性能。结果表明,随着域间相似度的增加,三种CD-FSL模型的准确率显著提高。与其他现有最先进的CD-FSL模型相比,CDFSL-BDC模型在不同域差距下具有最佳的平均性能。从害虫领域转移到作物病害领域,CDFSL-BDC模型在1-shot/5-shot设置下的准确率分别达到63.95%和80.13%。此外,在多域数据集上的广泛评估表明,当源域和目标域之间存在较大域差距时,多域学习比单域学习表现出更强的域可转移性。这些比较结果表明,从数据角度优化CD-FSL方法对于解决田间环境中的病害识别任务非常有效。这项研究有望扩展深度学习技术在病害检测中的应用,并为跨域病害检测提供技术参考。