Harvard University, Department of Organismic and Evolutionary Biology, Cambridge, MA 02138, USA.
Duke University, Pratt School of Engineering, Department of Biomedical Engineering, Durham, NC 27708, USA. Electronic address: https://twitter.com/tianqingxli.
Curr Opin Neurobiol. 2022 Apr;73:102522. doi: 10.1016/j.conb.2022.02.002. Epub 2022 Apr 19.
Animals move in three dimensions (3D). Thus, 3D measurement is necessary to report the true kinematics of animal movement. Existing 3D measurement techniques draw on specialized hardware, such as motion capture or depth cameras, as well as deep multi-view and monocular computer vision. Continued advances at the intersection of deep learning and computer vision will facilitate 3D tracking across more anatomical features, with less training data, in additional species, and within more natural, occlusive environments. 3D behavioral measurement enables unique applications in phenotyping, investigating the neural basis of behavior, and designing artificial agents capable of imitating animal behavior.
动物在三维空间中移动。因此,为了报告动物运动的真实运动学,需要进行三维测量。现有的三维测量技术依赖于专门的硬件,如运动捕捉或深度摄像机,以及深度多视图和单目计算机视觉。深度学习和计算机视觉的交叉领域的持续进步将有助于在更多解剖特征、更少训练数据、更多物种和更自然的封闭环境中进行 3D 跟踪。3D 行为测量在表型分析、研究行为的神经基础以及设计能够模仿动物行为的人工智能代理方面具有独特的应用。