Adelaide Medical School, The University of Adelaide, Adelaide, SA 5000, Australia.
Defence Science and Technology Group, Department of Defence, Adelaide, SA 5000, Australia.
Sensors (Basel). 2023 Mar 23;23(7):3392. doi: 10.3390/s23073392.
Walking gait data acquired with force platforms may be used for person re-identification (re-ID) in various authentication, surveillance, and forensics applications. Current force platform-based re-ID systems classify a fixed set of identities (IDs), which presents a problem when IDs are added or removed from the database. We formulated force platform-based re-ID as a deep metric learning (DML) task, whereby a deep neural network learns a feature representation that can be compared between inputs using a distance metric. The force platform dataset used in this study is one of the largest and the most comprehensive of its kind, containing 193 IDs with significant variations in clothing, footwear, walking speed, and time between trials. Several DML model architectures were evaluated in a challenging setting where none of the IDs were seen during training (i.e., zero-shot re-ID) and there was only one prior sample per ID to compare with each query sample. The best architecture was 85% accurate in this setting, though an analysis of changes in walking speed and footwear between measurement instances revealed that accuracy was 28% higher on same-speed, same-footwear comparisons, compared to cross-speed, cross-footwear comparisons. These results demonstrate the potential of DML algorithms for zero-shot re-ID using force platform data, and highlight challenging cases.
步态数据可用于各种认证、监控和法医应用中的人员重新识别(re-ID)。当前基于力台的 re-ID 系统对固定数量的身份(IDs)进行分类,这在数据库中添加或删除 ID 时会带来问题。我们将基于力台的 re-ID 表述为一个深度度量学习(DML)任务,其中深度神经网络学习一种特征表示,然后可以使用距离度量在输入之间进行比较。本研究中使用的力台数据集是同类数据集中最大和最全面的数据集之一,包含 193 个 ID,其穿着、鞋子、行走速度和试验之间的时间都有很大的变化。在一个具有挑战性的环境中评估了几种 DML 模型架构,在该环境中,训练期间没有看到任何 ID(即零样本 re-ID),并且每个查询样本只能与每个 ID 的一个先验样本进行比较。在这种设置下,最好的架构准确率为 85%,但对测量实例之间的行走速度和鞋子变化的分析表明,在同速、同鞋比较中,准确率比跨速、跨鞋比较高 28%。这些结果表明 DML 算法在使用力台数据进行零样本 re-ID 方面具有潜力,同时突出了具有挑战性的情况。