Yang Yahan, Cho Sunghye, Covello Maxine, Knox Azia, Bastani Osbert, Weimer James, Dobriban Edgar, Schultz Robert, Lee Insup, Parish-Morris Julia
University of Pennsylvania, Philadelphia, PA.
Children's Hospital of Philadelphia, Philadelphia, PA.
Interspeech. 2023 Aug;2023:4603-4607. doi: 10.21437/interspeech.2023-2251.
Social interaction quality ratings derived from short natural conversations can differentiate children with and without autism at the group level. In this work, we explored conversations between children and an unfamiliar adult who rated their social interaction success on six dimensions. Using hand-crafted acoustic and lexical features, we built different classifiers to predict children's dimensional conversation quality. The best classifier achieved 61% accuracy, which outperformed human raters (49%). Follow-up analyses revealed that a subset of features determined communication quality scores. Additionally, we extracted acoustic features using a pretrained audio transformer and improved our prediction to 68%. This study suggests that automatically predicting conversation quality could be an inexpensive and objective way to monitor intervention progress in children with communication challenges, and could be used to identify intervention targets for improving conversational success.
从简短的自然对话中得出的社交互动质量评分能够在群体层面区分出自闭症儿童和非自闭症儿童。在这项研究中,我们探究了儿童与一位不熟悉的成年人之间的对话,该成年人会从六个维度对他们的社交互动成功程度进行评分。我们利用手工制作的声学和词汇特征构建了不同的分类器,以预测儿童在各个维度上的对话质量。最佳分类器的准确率达到了61%,超过了人工评分者(49%)。后续分析表明,一部分特征决定了沟通质量得分。此外,我们使用预训练的音频变换器提取声学特征,并将预测准确率提高到了68%。这项研究表明,自动预测对话质量可能是一种低成本且客观的方式,用于监测有沟通障碍儿童的干预进展,并且可用于识别提高对话成功率的干预目标。