McDonald Denisa Qori, Zampella Casey J, Sariyanidi Evangelos, Manakiwala Aashvi, DeJardin Ellis, Herrington John D, Schultz Robert T, Tunç Birkan
Children's Hospital of Philadelphia, Philadelphia, PA, USA.
University of Pennsylvania, Philadelphia, PA, USA.
ICMI22 Companion (2022). 2022 Nov;2022:185-195. doi: 10.1145/3536220.3563366. Epub 2022 Nov 7.
Advances in computational behavior analysis have the potential to increase our understanding of behavioral patterns and developmental trajectories in neurotypical individuals, as well as in individuals with mental health conditions marked by motor, social, and emotional difficulties. This study focuses on investigating how head movement patterns during face-to-face conversations vary with age from childhood through adulthood. We rely on computer vision techniques due to their suitability for analysis of social behaviors in naturalistic settings, since video data capture can be unobtrusively embedded within conversations between two social partners. The methods in this work include unsupervised learning for movement pattern clustering, and supervised classification and regression as a function of age. The results demonstrate that 3-minute video recordings of head movements during conversations show patterns that distinguish between participants that are younger vs. older than 12 years with 78% accuracy. Additionally, we extract relevant patterns of head movement upon which the age distinction was determined by our models.
计算行为分析的进展有可能增进我们对神经典型个体以及存在运动、社交和情感困难的心理健康状况个体的行为模式和发展轨迹的理解。本研究聚焦于调查从童年到成年期间,面对面交谈时头部运动模式如何随年龄变化。我们依赖计算机视觉技术,因为它们适用于分析自然场景中的社交行为,视频数据采集可以不引人注意地嵌入两个社交伙伴之间的对话中。这项工作中的方法包括用于运动模式聚类的无监督学习,以及作为年龄函数的监督分类和回归。结果表明,对话期间头部运动的3分钟视频记录显示出的模式能够以78%的准确率区分12岁以上和以下的参与者。此外,我们提取了相关的头部运动模式,我们的模型就是基于这些模式来确定年龄差异的。