Wang Xusheng, Liu Guowei, Feng Yongfei, Li Wei, Niu Jianye, Gan Zhongxue
Academy for Engineering & Technology, Fudan University, Shanghai, China.
Parallel Robot and Mechatronic System Laboratory of Hebei Province and Key Laboratory of Advanced Forging & Stamping Technology and Science of Ministry of Education, Yanshan University, Qinhuangdao, China.
Front Neurorobot. 2021 Oct 15;15:753924. doi: 10.3389/fnbot.2021.753924. eCollection 2021.
To provide stroke patients with good rehabilitation training, the rehabilitation robot should ensure that each joint of the limb of the patient does not exceed its joint range of motion. Based on the machine vision combined with an RGB-Depth (RGB-D) camera, a convenient and quick human-machine interaction method to measure the lower limb joint range of motion of the stroke patient is proposed. By analyzing the principle of the RGB-D camera, the transformation relationship between the camera coordinate system and the pixel coordinate system in the image is established. Through the markers on the human body and chair on the rehabilitation robot, an RGB-D camera is used to obtain their image data with relative position. The threshold segmentation method is used to process the image. Through the analysis of the image data with the least square method and the vector product method, the range of motion of the hip joint, knee joint in the sagittal plane, and hip joint in the coronal plane could be obtained. Finally, to verify the effectiveness of the proposed method for measuring the lower limb joint range of motion of human, the mechanical leg joint range of motion from a lower limb rehabilitation robot, which will be measured by the angular transducers and the RGB-D camera, was used as the control group and experiment group for comparison. The angle difference in the sagittal plane measured by the proposed detection method and angle sensor is relatively conservative, and the maximum measurement error is not more than 2.2 degrees. The angle difference in the coronal plane between the angle at the peak obtained by the designed detection system and the angle sensor is not more than 2.65 degrees. This paper provides an important and valuable reference for the future rehabilitation robot to set each joint range of motion limited in the safe workspace of the patient.
为给中风患者提供良好的康复训练,康复机器人应确保患者肢体的每个关节不超过其关节活动范围。基于结合了RGB-Depth(RGB-D)相机的机器视觉,提出了一种方便快捷的人机交互方法来测量中风患者下肢关节活动范围。通过分析RGB-D相机的原理,建立了相机坐标系与图像中像素坐标系之间的变换关系。通过康复机器人上人体和椅子上的标记,利用RGB-D相机获取它们具有相对位置的图像数据。采用阈值分割方法处理图像。通过最小二乘法和向量积法对图像数据进行分析,可得到矢状面内髋关节、膝关节以及冠状面内髋关节的活动范围。最后,为验证所提方法测量人体下肢关节活动范围的有效性,将下肢康复机器人通过角度传感器测量的机械腿关节活动范围作为对照组,将通过RGB-D相机测量的结果作为实验组进行比较。所提检测方法与角度传感器在矢状面测量的角度差异较为保守,最大测量误差不超过2.2度。设计的检测系统在冠状面获得的峰值角度与角度传感器之间的角度差异不超过2.65度。本文为未来康复机器人在患者安全工作空间内设置各关节活动范围限制提供了重要且有价值的参考。