Jeon Eun Som, Mitra Sinjini, Lee Jisoo, Save Omik M, Shukla Ankita, Lee Hyunglae, Turaga Pavan
Department of Computer Science and Engineering, Seoul National University of Science and Technology, Seoul, 01811, Republic of Korea.
Geometric Media Lab, School of Arts, Media and Engineering and School of Electrical, Computer and Energy Engineering, Arizona State University, Tempe, AZ 85281 USA.
IEEE Internet Things J. 2025 Aug 15;12(16):34406-34420. doi: 10.1109/jiot.2025.3578012. Epub 2025 Jun 9.
Human gait analysis with wearable sensors has been widely used in various applications, such as daily life healthcare, rehabilitation, physical therapy, and clinical diagnostics and monitoring. In particular, ground reaction force (GRF) provides critical information about how the body interacts with the ground during locomotion. Although instrumented treadmills have been widely used as the gold standard for measuring GRF during walking, their lack of portability and high cost make them impractical for many applications. As an alternative, low-cost, portable, wearable insole sensors have been utilized to measure GRF; however, these sensors are susceptible to noise and disturbance and are less accurate than treadmill measurements. Deep learning has shown potential in addressing these issues, but such methods are computationally expensive and often require extensive computing resources, limiting their feasibility for real-time and portable systems. To address these challenges, we propose a Time-aware Knowledge Distillation framework for GRF estimation from insole sensor data. This framework leverages similarity and temporal features within a mini-batch during the knowledge distillation process, effectively capturing the complementary relationships between features and the sequential properties of the target and input data. The performance of the lightweight models distilled through this framework was evaluated by comparing GRF estimations from insole sensor data against measurements from an instrumented treadmill. Various teacher-student model architectures and learning strategies were evaluated across multiple performance metrics using data collected at different walking speeds. Empirical results demonstrated that Time-aware Knowledge Distillation outperforms current baselines in GRF estimation from wearable sensor data. Moreover, our method significantly reduces the number of training parameters needed for GRF estimation, offering a data- and resource-efficient solution for human gait analysis while achieving excellent accuracy and model reliability.
利用可穿戴传感器进行人体步态分析已广泛应用于各种领域,如日常生活保健、康复、物理治疗以及临床诊断与监测。特别是,地面反作用力(GRF)提供了有关身体在运动过程中与地面相互作用的关键信息。尽管仪器化跑步机已被广泛用作步行过程中测量GRF的金标准,但其缺乏便携性和高成本使其在许多应用中不切实际。作为替代方案,低成本、便携式的可穿戴鞋垫传感器已被用于测量GRF;然而,这些传感器容易受到噪声和干扰,并且比跑步机测量的准确性更低。深度学习在解决这些问题方面已显示出潜力,但此类方法计算成本高昂,且通常需要大量计算资源,限制了其在实时和便携式系统中的可行性。为应对这些挑战,我们提出了一种用于从鞋垫传感器数据估计GRF的时间感知知识蒸馏框架。该框架在知识蒸馏过程中利用小批量数据中的相似性和时间特征,有效地捕捉特征之间的互补关系以及目标数据和输入数据的顺序属性。通过将鞋垫传感器数据的GRF估计与仪器化跑步机的测量结果进行比较,评估了通过该框架蒸馏的轻量级模型的性能。使用在不同步行速度下收集的数据,针对多个性能指标评估了各种师生模型架构和学习策略。实证结果表明,时间感知知识蒸馏在从可穿戴传感器数据估计GRF方面优于当前基线。此外,我们的方法显著减少了GRF估计所需的训练参数数量,为人体步态分析提供了一种数据和资源高效的解决方案,同时实现了出色的准确性和模型可靠性。