Sagol School of Neuroscience and Department of Physiology and Pharmacology, Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
Donders Institute for Brain, Cognition and Behavior, Radboud University Nijmegen, Nijmegen, the Netherlands.
J Neurosci Methods. 2019 Apr 15;318:69-77. doi: 10.1016/j.jneumeth.2018.12.016. Epub 2019 Jan 14.
Modern electrophysiological experiments are moving towards closing the loop, where the extrinsic (behavioral) and intrinsic (neuronal) variables automatically affect stimulation parameters. Rodent experiments targeting spatial behavior require animal 2D kinematics to be continuously monitored in a reliable and accurate manner. Cameras provide a robust, flexible, and simple way to track kinematics on the fly. Indeed, several available camera-based systems yield high spatiotemporal resolution. However, the acquired kinematic data cannot be accessed with sufficient temporal resolution for precise real-time feedback.
Here, we describe a novel software and hardware system for movement tracking based on color-markers with real-time low-noise output that works in both light and dark conditions. The analog outputs precisely represent 2D movement features including position, orientation, and their temporal derivatives, velocity and angular velocity.
Using adaptive windowing, contour extraction, and rigid-body Kalman filtering, a 640-by-360 pixel frame is processed in 28 ms with less than 4 ms jitter, for 100 frames per second. The system is robust to outliers, has low noise, and maintains a smooth, accurate output even when one or more markers are temporarily missing. Using freely-moving mice, we demonstrate novel applications such as replacing conventional sensors in a behavioral arena and inducing novel place fields via closed-loop optogenetic stimulation.
COMPARISON WITH EXISTING METHOD(S): To the best of our knowledge, this is the first tracking system that yields analog output in real-time.
This modular system for closed-loop experiment tracking can be implemented by downloading an open-source software and assembling low-cost hardware circuity.
现代电生理实验正朝着闭环方向发展,外在(行为)和内在(神经元)变量自动影响刺激参数。针对空间行为的啮齿动物实验需要可靠且准确地连续监测动物的 2D 运动学。摄像机提供了一种强大、灵活且简单的方式来实时跟踪运动学。事实上,有几个可用的基于摄像机的系统可以提供高时空分辨率。然而,所获取的运动学数据无法以足够的时间分辨率访问,无法进行精确的实时反馈。
在这里,我们描述了一种基于颜色标记的新型软件和硬件运动跟踪系统,具有实时低噪声输出,可在明、暗两种条件下工作。模拟输出精确表示包括位置、方向及其时间导数、速度和角速度在内的 2D 运动特征。
使用自适应窗口、轮廓提取和刚体卡尔曼滤波,每秒处理 100 帧,640x360 像素的帧在 28 毫秒内处理完成,抖动小于 4 毫秒。该系统对异常值具有鲁棒性,噪声低,即使一个或多个标记暂时丢失,也能保持平滑、准确的输出。使用自由移动的老鼠,我们展示了一些新的应用,例如在行为场中取代传统传感器,以及通过闭环光遗传刺激诱导新的位置场。
据我们所知,这是第一个实时提供模拟输出的跟踪系统。
这个用于闭环实验跟踪的模块化系统可以通过下载开源软件和组装低成本硬件电路来实现。