Su Yuanzhi, Hou Huiying Cynthia, Lan Haifeng, Ma Christina Zong-Hao
Department of Building Environment and Energy Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China.
Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China.
Bioengineering (Basel). 2025 Aug 21;12(8):891. doi: 10.3390/bioengineering12080891.
Human pose estimation (HPE) in privacy-sensitive environments such as healthcare facilities and smart homes demands non-visual sensing solutions. Millimeter-wave (mmWave) radar emerges as a promising alternative, yet its development is hindered by the scarcity of high-fidelity datasets with accurate annotations. This paper introduces mmFree-Pose, the first dedicated mmWave radar dataset specifically designed for privacy-preserving HPE. Collected through a novel visual-free framework that synchronizes mmWave radar with VDSuit-Full motion-capture sensors, our dataset covers 10+ actions, from basic gestures to complex falls. Each sample provides (i) raw 3D point clouds with Doppler velocity and intensity, (ii) precise 23-joint skeletal annotations, and (iii) full-body motion sequences in privacy-critical scenarios. Crucially, all data is captured without the use of visual sensors, ensuring fundamental privacy protection by design. Unlike conventional approaches that rely on RGB or depth cameras, our framework eliminates the risk of visual data leakage while maintaining high annotation fidelity. The dataset also incorporates scenarios involving occlusions, different viewing angles, and multiple subject variations to enhance generalization in real-world applications. By providing a high-quality and privacy-compliant dataset, mmFree-Pose bridges the gap between RF sensing and home monitoring applications, where safeguarding personal identity and behavior remains a critical concern.
在医疗保健设施和智能家居等对隐私敏感的环境中,人体姿态估计(HPE)需要非视觉传感解决方案。毫米波(mmWave)雷达成为一种很有前景的替代方案,但其发展受到缺乏带有准确注释的高保真数据集的阻碍。本文介绍了mmFree-Pose,这是第一个专门为保护隐私的人体姿态估计设计的毫米波雷达数据集。通过一个新颖的无视觉框架收集,该框架将毫米波雷达与VDSuit-Full运动捕捉传感器同步,我们的数据集涵盖了10多种动作,从基本手势到复杂跌倒。每个样本提供(i)带有多普勒速度和强度的原始3D点云,(ii)精确的23关节骨骼注释,以及(iii)隐私关键场景中的全身运动序列。至关重要的是,所有数据都是在不使用视觉传感器的情况下捕获的,通过设计确保了基本的隐私保护。与依赖RGB或深度相机的传统方法不同,我们的框架消除了视觉数据泄露的风险,同时保持了高注释保真度。该数据集还纳入了涉及遮挡、不同视角和多个主体变化的场景,以增强在实际应用中的通用性。通过提供高质量且符合隐私要求的数据集,mmFree-Pose弥合了射频传感与家庭监测应用之间的差距,在这些应用中,保护个人身份和行为仍然是一个关键问题。