Sun Guanglong, Lyu Chenfei, Cai Ruolan, Yu Chencen, Sun Hao, Schriver Kenneth E, Gao Lixia, Li Xinjian
Department of Neurology of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, Zhejiang University School of Medicine, Hangzhou, China.
Key Laboratory of Medical Neurobiology of Zhejiang Province, Hangzhou, China.
Front Behav Neurosci. 2021 Oct 28;15:750894. doi: 10.3389/fnbeh.2021.750894. eCollection 2021.
Behavioral measurement and evaluation are broadly used to understand brain functions in neuroscience, especially for investigations of movement disorders, social deficits, and mental diseases. Numerous commercial software and open-source programs have been developed for tracking the movement of laboratory animals, allowing animal behavior to be analyzed digitally. optical imaging and electrophysiological recording in freely behaving animals are now widely used to understand neural functions in circuits. However, it is always a challenge to accurately track the movement of an animal under certain complex conditions due to uneven environment illumination, variations in animal models, and interference from recording devices and experimenters. To overcome these challenges, we have developed a strategy to track the movement of an animal by combining a deep learning technique, the You Only Look Once (YOLO) algorithm, with a background subtraction algorithm, a method we label DeepBhvTracking. In our method, we first train the detector using manually labeled images and a pretrained deep-learning neural network combined with YOLO, then generate bounding boxes of the targets using the trained detector, and finally track the center of the targets by calculating their centroid in the bounding box using background subtraction. Using DeepBhvTracking, the movement of animals can be tracked accurately in complex environments and can be used in different behavior paradigms and for different animal models. Therefore, DeepBhvTracking can be broadly used in studies of neuroscience, medicine, and machine learning algorithms.
行为测量与评估在神经科学中被广泛用于理解大脑功能,尤其是在运动障碍、社交缺陷和精神疾病的研究中。已经开发了许多商业软件和开源程序来跟踪实验动物的运动,从而能够对动物行为进行数字分析。自由活动动物的光学成像和电生理记录现在被广泛用于理解神经回路中的神经功能。然而,由于环境光照不均匀、动物模型的差异以及记录设备和实验者的干扰,在某些复杂条件下准确跟踪动物的运动始终是一项挑战。为了克服这些挑战,我们开发了一种将深度学习技术(即你只看一次(YOLO)算法)与背景减法算法相结合的动物运动跟踪策略,我们将这种方法称为深度行为跟踪(DeepBhvTracking)。在我们的方法中,我们首先使用手动标记的图像和结合了YOLO的预训练深度学习神经网络来训练检测器,然后使用训练好的检测器生成目标的边界框,并最终通过使用背景减法计算边界框中目标的质心来跟踪目标的中心。使用深度行为跟踪(DeepBhvTracking),可以在复杂环境中准确跟踪动物的运动,并且可用于不同的行为范式和不同的动物模型。因此,深度行为跟踪(DeepBhvTracking)可广泛应用于神经科学研究、医学和机器学习算法。