Liu Yuxuan, Zhou Guohui, He Wei, Zhu Hailong, Cui Yanling
School of Computer Science and Information Engineering, Harbin Normal University, Harbin, China.
PLoS One. 2025 Sep 2;20(9):e0325540. doi: 10.1371/journal.pone.0325540. eCollection 2025.
Scale variation is a challenge in human pose estimation. The scale variations of human body are related to the accuracy and robustness of posture estimation. For example, the prediction accuracy of smaller joints (such as ankles and wrists) is less than that of larger joints (such as head and shoulders). To address the impact of scale variations across parts of the human body on the positioning of key points. In this paper, we propose a Detail Enhanced High-Resolution Network (DE-HRNet), which can efficiently extract local detail features and mitigate the impact of scale variations for human pose estimation. First, we propose a Detail Enhancement Module (DEM) to relearn the lost low-level detailed features and enhance the model's ability to capture delicate local features, which is crucial for improving the accuracy of scale-varying keypoints. Second, we introduce an ultra-lightweight dynamic sampler - dySample, which is used to replace nearest up-sampling. It aims to reduce the loss of detail information from low-resolution features during up-sampling, while simultaneously preserving finer local representations for high resolution, it can be beneficial in improving the robustness of the model in dealing with scale-varying keypoints. On the COCO test-dev2017 and MPII valid datasets, our method achieved 75.6 AP and 90.7 PCKh@0.5, respectively, compared to High-Resolution Network (HRNet), it improved by 0.7 and 0.4 points. In comparison with the other works, the proposed method has performed well in the scale variation.
尺度变化是人体姿态估计中的一个挑战。人体的尺度变化与姿态估计的准确性和鲁棒性相关。例如,较小关节(如脚踝和手腕)的预测精度低于较大关节(如头部和肩部)。为了解决人体各部位尺度变化对关键点定位的影响。在本文中,我们提出了一种细节增强高分辨率网络(DE-HRNet),它可以有效地提取局部细节特征,并减轻尺度变化对人体姿态估计的影响。首先,我们提出了一个细节增强模块(DEM)来重新学习丢失的低级细节特征,并增强模型捕捉精细局部特征的能力,这对于提高尺度变化关键点的准确性至关重要。其次,我们引入了一个超轻量级动态采样器——dySample,用于替代最近邻上采样。其目的是减少上采样过程中低分辨率特征的细节信息丢失,同时为高分辨率保留更精细的局部表示,这有助于提高模型处理尺度变化关键点的鲁棒性。在COCO test-dev2017和MPII有效数据集上,我们的方法分别达到了75.6 AP和90.7 PCKh@0.5,与高分辨率网络(HRNet)相比,分别提高了0.7和0.4个百分点。与其他方法相比,所提出的方法在尺度变化方面表现良好。