Assistance Systems and Medical Device Technology, Department for Health Services Research, School of Medicine and Health Sciences, Carl von Ossietzky University, Ammerländer Heerstraße 114-118, 26129 Oldenburg, Germany.
Geriatric Medicine, Department for Health Services Research, School of Medicine and Health Sciences, Carl von Ossietzky University, Ammerländer Heerstraße 114-118, 26129 Oldenburg, Germany.
Sensors (Basel). 2023 Jan 12;23(2):878. doi: 10.3390/s23020878.
The Azure Kinect DK is an RGB-D-camera popular in research and studies with humans. For good scientific practice, it is relevant that Azure Kinect yields consistent and reproducible results. We noticed the yielded results were inconsistent. Therefore, we examined 100 body tracking runs per processing mode provided by the Azure Kinect Body Tracking SDK on two different computers using a prerecorded video. We compared those runs with respect to spatiotemporal progression (spatial distribution of joint positions per processing mode and run), derived parameters (bone length), and differences between the computers. We found a previously undocumented converging behavior of joint positions at the start of the body tracking. Euclidean distances of joint positions varied clinically relevantly with up to 87 mm between runs for CUDA and TensorRT; CPU and DirectML had no differences on the same computer. Additionally, we found noticeable differences between two computers. Therefore, we recommend choosing the processing mode carefully, reporting the processing mode, and performing all analyses on the same computer to ensure reproducible results when using Azure Kinect and its body tracking in research. Consequently, results from previous studies with Azure Kinect should be reevaluated, and until then, their findings should be interpreted with caution.
Azure Kinect DK 是一款在人体研究中广受欢迎的 RGB-D 相机。为了良好的科学实践,Azure Kinect 应产生一致且可重复的结果。我们注意到得到的结果不一致。因此,我们使用预先录制的视频,在两台不同的计算机上,按照 Azure Kinect 人体跟踪 SDK 提供的 100 种处理模式检查了 100 次人体跟踪运行。我们比较了这些运行在时空进展(每种处理模式和运行的关节位置的空间分布)、导出参数(骨骼长度)和计算机之间的差异。我们发现人体跟踪开始时关节位置存在以前未记录的收敛行为。对于 CUDA 和 TensorRT,关节位置的欧几里得距离在运行之间变化很大,最大可达 87mm;在同一台计算机上,CPU 和 DirectML 没有差异。此外,我们还发现两台计算机之间存在明显差异。因此,我们建议在使用 Azure Kinect 及其人体跟踪进行研究时,仔细选择处理模式、报告处理模式,并在同一台计算机上执行所有分析,以确保可重复的结果。因此,应该重新评估之前使用 Azure Kinect 进行的研究结果,在重新评估之前,应谨慎解释其发现。