Lidstone Daniel E, Rochowiak Rebecca, Pacheco Carolina, Tunçgenç Bahar, Vidal Rene, Mostofsky Stewart H
Center for Neurodevelopmental and Imaging Research, Kennedy Krieger Institute, Baltimore, MD, 21205, USA.
Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, 21205, USA.
Res Autism Spectr Disord. 2021 Sep;87. doi: 10.1016/j.rasd.2021.101840. Epub 2021 Aug 14.
Motor imitation difficulties are pervasive in children with Autism Spectrum Disorder (ASD). Previous research demonstrated the validity and reliability of an algorithm called Computerized Assessment of Motor Imitation (CAMI) using 3D depth cameras. However, incorporating CAMI into serious games and making it accessible in clinic and home settings requires a more scalable approach that uses "off-the-shelf" 2D cameras.
In a brief (one-minute) task, children (23 ASD, 17 typically developing [TD]) imitated a model's dance movements while simultaneously being recorded using Kinect Xbox motion tracking technology (Kinect 3D) and a single 2D camera. Pose-estimation software (OpenPose 2D) was used on the 2D camera video to fit a skeleton to the imitating child. Motor imitation scores computed from the fully automated OpenPose 2D CAMI method were compared to scores computed from the Kinect 3D CAMI and Human Observation Coding (HOC) methods.
Motor imitation scores obtained from the OpenPose 2D CAMI method were significantly correlated with scores obtained from the Kinect 3D CAMI method ( = 0.82, < 0.001) and the HOC method ( = 0.80, < 0.001). Both 2D and 3D CAMI methods showed better discriminative ability than the HOC, with the Kinect 3D CAMI method outperforming the OpenPose 2D CAMI method (area under ROC curve (AUC): AUC = 0.799, AUC = 0.876, AUC = 0.94). Finally, all motor imitation scores were significantly associated with the social-communication impairment (all ≤ 0.003).
This pilot-study demonstrated that motor imitation can be automatically quantified using a single 2D camera.
运动模仿困难在自闭症谱系障碍(ASD)儿童中普遍存在。先前的研究证明了一种名为计算机化运动模仿评估(CAMI)的算法使用3D深度相机的有效性和可靠性。然而,将CAMI整合到严肃游戏中并使其在临床和家庭环境中可用,需要一种更具可扩展性的方法,即使用“现成的”2D相机。
在一项简短(一分钟)的任务中,儿童(23名ASD儿童、17名发育正常[TD]儿童)模仿模型的舞蹈动作,同时使用Kinect Xbox运动跟踪技术(Kinect 3D)和单个2D相机进行记录。对2D相机视频使用姿态估计软件(OpenPose 2D),为模仿儿童拟合骨骼。将通过全自动OpenPose 2D CAMI方法计算的运动模仿分数与通过Kinect 3D CAMI和人类观察编码(HOC)方法计算的分数进行比较。
通过OpenPose 2D CAMI方法获得的运动模仿分数与通过Kinect 3D CAMI方法获得的分数(r = 0.82,p < (此处原文似乎不完整))和HOC方法获得的分数(r = 0.80,p < (此处原文似乎不完整))显著相关。2D和3D CAMI方法均显示出比HOC更好的辨别能力,Kinect 3D CAMI方法优于OpenPose 2D CAMI方法(ROC曲线下面积(AUC):AUC = 0.799,AUC = 0.876,AUC = 0.94)。最后,所有运动模仿分数均与社交沟通障碍显著相关(所有p ≤ 0.003)。
这项初步研究表明,使用单个2D相机可以自动量化运动模仿。