Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.
National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.
Zool Res. 2022 May 18;43(3):343-351. doi: 10.24272/j.issn.2095-8137.2021.353.
Behavioral analysis of macaques provides important experimental evidence in the field of neuroscience. In recent years, video-based automatic animal behavior analysis has received widespread attention. However, methods capable of extracting and analyzing daily movement trajectories of macaques in their daily living cages remain underdeveloped, with previous approaches usually requiring specific environments to reduce interference from occlusion or environmental change. Here, we introduce a novel method, called MonkeyTrail, which satisfies the above requirements by frequently generating virtual empty backgrounds and using background subtraction to accurately obtain the foreground of moving animals. The empty background is generated by combining the frame difference method (FDM) and deep learning-based model (YOLOv5). The entire setup can be operated with low-cost hardware and can be applied to the daily living environments of individually caged macaques. To test MonkeyTrail performance, we labeled a dataset containing >8 000 video frames with the bounding boxes of macaques under various conditions as ground-truth. Results showed that the tracking accuracy and stability of MonkeyTrail exceeded that of two deep learning-based methods (YOLOv5 and Single-Shot MultiBox Detector), traditional frame difference method, and naïve background subtraction method. Using MonkeyTrail to analyze long-term surveillance video recordings, we successfully assessed changes in animal behavior in terms of movement amount and spatial preference. Thus, these findings demonstrate that MonkeyTrail enables low-cost, large-scale daily behavioral analysis of macaques.
猕猴的行为分析为神经科学领域提供了重要的实验证据。近年来,基于视频的自动动物行为分析受到了广泛关注。然而,能够提取和分析猕猴在其日常生活笼中日常运动轨迹的方法仍不够发达,以前的方法通常需要特定的环境来减少遮挡或环境变化的干扰。在这里,我们介绍了一种名为 MonkeyTrail 的新方法,它通过频繁生成虚拟空背景并使用背景减除来准确获取运动动物的前景,满足了上述要求。空背景是通过结合帧差法(FDM)和基于深度学习的模型(YOLOv5)生成的。整个设置可以用低成本的硬件操作,并可应用于单独笼养猕猴的日常生活环境中。为了测试 MonkeyTrail 的性能,我们使用各种条件下的猕猴边界框对包含>8000 个视频帧的数据集进行了标注作为真实数据。结果表明,MonkeyTrail 的跟踪精度和稳定性超过了两种基于深度学习的方法(YOLOv5 和单步多盒检测器)、传统的帧差法和简单的背景减除法。使用 MonkeyTrail 分析长期监控视频记录,我们成功地评估了动物行为在运动量和空间偏好方面的变化。因此,这些发现表明 MonkeyTrail 能够实现低成本、大规模的猕猴日常行为分析。