Chen Xian, Pu Hongli, He Yihui, Lai Mengzhen, Zhang Daike, Chen Junyang, Pu Haibo
College of Information Engineering, Sichuan Agricultural University, Ya'an 625000, China.
Ya'an Digital Agricultural Engineering Technology Research Center, Ya'an 625000, China.
Animals (Basel). 2023 May 22;13(10):1713. doi: 10.3390/ani13101713.
To protect birds, it is crucial to identify their species and determine their population across different regions. However, currently, bird monitoring methods mainly rely on manual techniques, such as point counts conducted by researchers and ornithologists in the field. This method can sometimes be inefficient, prone to errors, and have limitations, which may not always be conducive to bird conservation efforts. In this paper, we propose an efficient method for wetland bird monitoring based on object detection and multi-object tracking networks. First, we construct a manually annotated dataset for bird species detection, annotating the entire body and head of each bird separately, comprising 3737 bird images. We also built a new dataset containing 11,139 complete, individual bird images for the multi-object tracking task. Second, we perform comparative experiments using a state-of-the-art batch of object detection networks, and the results demonstrated that the YOLOv7 network, trained with a dataset labeling the entire body of the bird, was the most effective method. To enhance YOLOv7 performance, we added three GAM modules on the head side of the YOLOv7 to minimize information diffusion and amplify global interaction representations and utilized Alpha-IoU loss to achieve more accurate bounding box regression. The experimental results revealed that the improved method offers greater accuracy, with mAP@0.5 improving to 0.951 and mAP@0.5:0.95 improving to 0.815. Then, we send the detection information to DeepSORT for bird tracking and classification counting. Finally, we use the area counting method to count according to the species of birds to obtain information about flock distribution. The method described in this paper effectively addresses the monitoring challenges in bird conservation.
为了保护鸟类,识别它们的物种并确定不同地区的鸟类数量至关重要。然而,目前鸟类监测方法主要依赖人工技术,例如研究人员和鸟类学家在野外进行的定点计数。这种方法有时可能效率低下,容易出错且存在局限性,可能并不总是有利于鸟类保护工作。在本文中,我们提出了一种基于目标检测和多目标跟踪网络的湿地鸟类高效监测方法。首先,我们构建了一个用于鸟类物种检测的人工标注数据集,分别对每只鸟的全身和头部进行标注,包含3737张鸟类图像。我们还构建了一个新的数据集,其中包含11139张完整的个体鸟类图像用于多目标跟踪任务。其次,我们使用一批先进的目标检测网络进行对比实验,结果表明,使用标注鸟类全身的数据集训练的YOLOv7网络是最有效的方法。为了提高YOLOv7的性能,我们在YOLOv7的头部添加了三个GAM模块,以最小化信息扩散并放大全局交互表示,并利用Alpha-IoU损失实现更精确的边界框回归。实验结果表明,改进后的方法具有更高的准确率,mAP@0.5提高到0.951,mAP@0.5:0.95提高到0.815。然后,我们将检测信息发送到DeepSORT进行鸟类跟踪和分类计数。最后,我们使用面积计数法根据鸟类物种进行计数,以获取鸟群分布信息。本文所述方法有效解决了鸟类保护中的监测挑战。