Vamsikrishna K M, Dogra Debi Prosad, Desarkar Maunendra Sankar
IEEE Trans Biomed Eng. 2016 May;63(5):991-1001. doi: 10.1109/TBME.2015.2480881. Epub 2015 Sep 22.
Physical rehabilitation supported by the computer-assisted-interface is gaining popularity among health-care fraternity. In this paper, we have proposed a computer-vision-assisted contactless methodology to facilitate palm and finger rehabilitation. Leap motion controller has been interfaced with a computing device to record parameters describing 3-D movements of the palm of a user undergoing rehabilitation. We have proposed an interface using Unity3D development platform. Our interface is capable of analyzing intermediate steps of rehabilitation without the help of an expert, and it can provide online feedback to the user. Isolated gestures are classified using linear discriminant analysis (DA) and support vector machines (SVM). Finally, a set of discrete hidden Markov models (HMM) have been used to classify gesture sequence performed during rehabilitation. Experimental validation using a large number of samples collected from healthy volunteers reveals that DA and SVM perform similarly while applied on isolated gesture recognition. We have compared the results of HMM-based sequence classification with CRF-based techniques. Our results confirm that both HMM and CRF perform quite similarly when tested on gesture sequences. The proposed system can be used for home-based palm or finger rehabilitation in the absence of experts.
由计算机辅助接口支持的物理康复在医疗保健界越来越受欢迎。在本文中,我们提出了一种计算机视觉辅助的非接触式方法来促进手掌和手指康复。Leap Motion控制器已与计算设备连接,以记录描述正在接受康复治疗的用户手掌三维运动的参数。我们提出了一个使用Unity3D开发平台的接口。我们的接口能够在无需专家帮助的情况下分析康复的中间步骤,并且可以向用户提供在线反馈。使用线性判别分析(DA)和支持向量机(SVM)对孤立手势进行分类。最后,使用一组离散隐马尔可夫模型(HMM)对手掌康复过程中执行的手势序列进行分类。使用从健康志愿者收集的大量样本进行的实验验证表明,在应用于孤立手势识别时,DA和SVM的表现相似。我们将基于HMM的序列分类结果与基于CRF的技术进行了比较。我们的结果证实,在手势序列测试中,HMM和CRF的表现非常相似。所提出的系统可用于在没有专家的情况下进行家庭式手掌或手指康复。