Dutta Manaswita, Mohapatra Bijoyaa
Department of Speech and Hearing Sciences, Portland State University, Portland, OR, United States.
Department of Communication Sciences and Disorders, Louisiana State University, Baton Rouge, LA, United States.
Front Hum Neurosci. 2024 Sep 25;18:1419311. doi: 10.3389/fnhum.2024.1419311. eCollection 2024.
Aphasia, resulting from acquired brain injury, disrupts language processing and usage, significantly impacting individuals' social communication and life participation. Given the limitations of traditional assessments in capturing the nuanced challenges faced by individuals with aphasia, this study seeks to explore the potential benefits of integrating multimodal communication elements into discourse analysis to better capture narrative proficiency in this population.
This study examined how incorporating multimodal communication elements (e.g., physical gestures, writing, drawing) into discourse analysis may affect the narrative outcomes of persons with aphasia compared to those observed using methods that exclude multimodal considerations.
Participants included individuals with chronic aphasia and age-and education-matched healthy controls who completed a storytelling task-the Bear and the Fly story. Macrolinguistic scores were obtained using verbal-only and multimodal scoring approaches. Additionally, the frequency and type of multimodal communication use during storytelling were examined in relation to aphasia characteristics. Statistical analyses included both within-group and between-group comparisons as well as correlational analyses.
Individuals with aphasia scored significantly higher in terms of their macrolinguistic abilities when multimodal scoring was considered compared to verbal-only scoring. Within the aphasia group, there were prominent differences noted in macrolinguistic scores for both fluent and nonfluent aphasia. Specifically, both groups scored higher on Main Concepts when multimodal scoring was considered, with the nonfluent group demonstrating significantly higher Main Concept and total macrolinguistic rubric scores in multimodal scoring compared to verbal scoring on the storytelling task. Additionally, aphasia severity showed moderate positive correlations with total macrolinguistic scores, indicating that individuals with less severe aphasia tended to produce higher quality narratives. Lastly, although persons with aphasia used different types of nonverbal modalities (i.e., drawing, writing), the use of meaning-laden gestures was most predominant during storytelling, emphasizing the importance of multimodal elements in communication for individuals with aphasia.
Our preliminary study findings underscore the importance of considering multimodal communication in assessing discourse performance among individuals with aphasia. Tailoring assessment approaches based on aphasia subtypes can provide valuable insights into linguistic abilities and inform targeted intervention strategies for improving communication outcomes.
失语症由后天脑损伤引起,会扰乱语言处理和使用,严重影响个体的社交沟通和生活参与。鉴于传统评估在捕捉失语症患者所面临的细微挑战方面存在局限性,本研究旨在探索将多模态沟通元素整合到话语分析中的潜在益处,以便更好地捕捉该人群的叙事能力。
本研究考察了与使用排除多模态因素的方法所观察到的结果相比,将多模态沟通元素(如身体手势、书写、绘画)纳入话语分析如何影响失语症患者的叙事结果。
参与者包括患有慢性失语症的个体以及年龄和教育程度匹配的健康对照者,他们完成了一项讲故事任务——《熊和苍蝇》的故事。使用仅言语评分方法和多模态评分方法获得宏观语言分数。此外,还考察了讲故事过程中多模态沟通使用的频率和类型与失语症特征的关系。统计分析包括组内和组间比较以及相关性分析。
与仅言语评分相比,考虑多模态评分时,失语症患者在宏观语言能力方面得分显著更高。在失语症组中,流利性失语症和非流利性失语症在宏观语言分数上存在显著差异。具体而言,考虑多模态评分时,两组在主要概念方面得分更高,在讲故事任务中,非流利性失语症组在多模态评分中的主要概念和宏观语言总评分显著高于言语评分。此外,失语症严重程度与宏观语言总评分呈中度正相关,表明失语症较轻的个体往往能产生质量更高的叙事。最后,虽然失语症患者使用了不同类型的非言语模态(即绘画、书写),但在讲故事过程中,富含意义的手势使用最为普遍,强调了多模态元素在失语症患者沟通中的重要性。
我们的初步研究结果强调了在评估失语症患者的话语表现时考虑多模态沟通的重要性。根据失语症亚型调整评估方法可以为语言能力提供有价值的见解,并为改善沟通结果的针对性干预策略提供依据。