School of Digital and Intelligence Industry, Inner Mongolia University of Science and Technology, Baotou, 014010, Inner Mongolia, China.
School of Automation and Electrical Engineering, Inner Mongolia University of Science and Technology, Baotou, 014010, Inner Mongolia, China.
Sci Rep. 2024 Nov 4;14(1):26631. doi: 10.1038/s41598-024-76718-x.
In farming scenarios, cattle identification has become a key issue for the development of precision farming. In precision livestock farming, single-feature recognition methods are prone to misjudgment in complex scenarios involving multiple cattle obscuring each other during drinking and feeding. This paper proposes a decision-level identification method based on the multi-feature fusion of cattle faces, muzzle patterns, and ear tags. The method utilizes the SOLO algorithm to segment images and employs the FaceNet and PP-OCRv4 networks to extract features for the cattle's faces, muzzle patterns, and ear tags. These features are compared with the Ground truth, from which the Top 3 features are extracted. The corresponding cattle IDs of these features are then processed using One-Hot encoding to serve as the final input for the decision layer, and various ensemble strategies are used to optimize the model. The results show that using the multimodal decision fusion method makes the recognition accuracy reach 95.74%, 1.4% higher than the traditional optimal unimodal recognition accuracy. The verification rate reaches 94.72%, 10.65% higher than the traditional optimal unimodal recognition verification rate. The research results demonstrate that the multi-feature fusion recognition method has significant advantages in drinking and feeding farm environments, providing an efficient and reliable solution for precise identification and management of cattle in farms and significantly improving recognition accuracy and stability.
在农业场景中,牛只识别已成为精准农业发展的关键问题。在精准畜牧养殖中,单特征识别方法在牛只互相遮挡的复杂场景下,如在饮水和进食时,容易出现误判。本文提出了一种基于牛脸、口鼻图案和耳标多特征融合的决策级识别方法。该方法利用 SOLO 算法进行图像分割,并使用 FaceNet 和 PP-OCRv4 网络提取牛脸、口鼻图案和耳标的特征。将这些特征与 Ground truth 进行比较,从中提取前 3 个特征。然后对这些特征的相应牛 ID 进行 One-Hot 编码处理,作为决策层的最终输入,并采用各种集成策略对模型进行优化。结果表明,使用多模态决策融合方法可使识别准确率达到 95.74%,比传统最优单模态识别准确率高 1.4%。验证率达到 94.72%,比传统最优单模态识别验证率高 10.65%。研究结果表明,多特征融合识别方法在饮水和进食农场环境中具有显著优势,为农场牛的精确识别和管理提供了高效可靠的解决方案,显著提高了识别精度和稳定性。