Chakravarty Pritish, Maalberg Maiki, Cozzi Gabriele, Ozgul Arpat, Aminian Kamiar
1School of Engineering, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.
2School of Information Technologies, Tallinn University of Technology, Tallinn, Estonia.
Mov Ecol. 2019 Aug 27;7:28. doi: 10.1186/s40462-019-0172-6. eCollection 2019.
Animal-borne data loggers today often house several sensors recording simultaneously at high frequency. This offers opportunities to gain fine-scale insights into behaviour from individual-sensor as well as integrated multi-sensor data. In the context of behaviour recognition, even though accelerometers have been used extensively, magnetometers have recently been shown to detect specific behaviours that accelerometers miss. The prevalent constraint of limited training data necessitates the importance of identifying behaviours with high robustness to data from new individuals, and may require fusing data from both these sensors. However, no study yet has developed an end-to-end approach to recognise common animal behaviours such as foraging, locomotion, and resting from magnetometer data in a common classification framework capable of accommodating and comparing data from both sensors.
We address this by first leveraging magnetometers' similarity to accelerometers to develop biomechanical descriptors of movement: we use the static component given by sensor tilt with respect to Earth's local magnetic field to estimate posture, and the dynamic component given by change in sensor tilt with time to characterise movement intensity and periodicity. We use these descriptors within an existing hybrid scheme that combines biomechanics and machine learning to recognise behaviour. We showcase the utility of our method on triaxial magnetometer data collected on ten wild Kalahari meerkats (), with annotated video recordings of each individual serving as groundtruth. Finally, we compare our results with accelerometer-based behaviour recognition.
The overall recognition accuracy of > 94% obtained with magnetometer data was found to be comparable to that achieved using accelerometer data. Interestingly, higher robustness to inter-individual variability in dynamic behaviour was achieved with the magnetometer, while the accelerometer was better at estimating posture.
Magnetometers were found to accurately identify common behaviours, and were particularly robust to dynamic behaviour recognition. The use of biomechanical considerations to summarise magnetometer data makes the hybrid scheme capable of accommodating data from either or both sensors within the same framework according to each sensor's strengths. This provides future studies with a method to assess the added benefit of using magnetometers for behaviour recognition.
如今,动物携带的数据记录器通常内置多个传感器,能够高频同步记录数据。这为从单个传感器以及整合的多传感器数据中获取行为的精细尺度洞察提供了机会。在行为识别的背景下,尽管加速度计已被广泛使用,但最近研究表明磁力计能够检测到加速度计遗漏的特定行为。训练数据有限这一普遍限制凸显了识别对新个体数据具有高稳健性的行为的重要性,这可能需要融合来自这两种传感器的数据。然而,尚未有研究开发出一种端到端的方法,在一个能够容纳和比较来自两种传感器数据的通用分类框架中,从磁力计数据识别诸如觅食、运动和休息等常见动物行为。
我们首先利用磁力计与加速度计的相似性来开发运动的生物力学描述符,以此解决这一问题:我们使用传感器相对于地球局部磁场的倾斜度给出的静态分量来估计姿势,并使用传感器倾斜度随时间的变化给出的动态分量来表征运动强度和周期性。我们在一个结合生物力学和机器学习的现有混合方案中使用这些描述符来识别行为。我们在从十只野生喀拉哈里狐獴收集的三轴磁力计数据上展示了我们方法的效用,每只个体的带注释视频记录作为地面真值。最后,我们将我们的结果与基于加速度计的行为识别结果进行比较。
发现使用磁力计数据获得的总体识别准确率>94%,与使用加速度计数据实现的准确率相当。有趣的是,磁力计在动态行为的个体间变异性方面具有更高的稳健性,而加速度计在估计姿势方面表现更好。
发现磁力计能够准确识别常见行为,并且在动态行为识别方面特别稳健。利用生物力学考量来总结磁力计数据,使得混合方案能够根据每个传感器的优势,在同一框架内容纳来自任一传感器或两个传感器的数据。这为未来的研究提供了一种方法,以评估使用磁力计进行行为识别的额外益处。