Department of Biobehavioral Sciences, Teachers College, Columbia University, New York, NY.
Am J Speech Lang Pathol. 2019 Aug 9;28(3):1099-1114. doi: 10.1044/2019_AJSLP-18-0268. Epub 2019 Jul 22.
Purpose The purpose of this study was to determine whether the correct information unit (CIU) can be reliably applied to unstructured conversational discourse in people with aphasia (PWA). The CIU was developed by Nicholas and Brookshire (1993) to measure word-level informativeness in structured monologue-level discourse and is widely used by clinicians and researchers for this purpose. A case study (Oelschlaeger & Thorne, 1999) investigating the use of the CIU in conversation has suggested potential issues with interrater reliability (IRR), which has discouraged application of the CIU to this discourse context. However, no further research has been conducted to replicate or extend this finding. Given a clinical and research need for reliable linguistic measures appropriate for use in unstructured conversation, revisiting the reliability, stability, and suitability of the CIU is indicated. Method The CIU protocol developed by Nicholas and Brookshire (1993) was modified according to the needs of conversational discourse, resulting in the CIU in conversation (CIUconv) protocol. Two speech-language pathology graduate student research assistants completed training on use of the CIUconv with the 1st author. Sixteen conversations held by 8 PWA (i.e., 2 conversations each) were used as language samples to determine IRR of percent CIU (%CIU) in conversation through use of the CIUconv. Test-retest stability of %CIU as applied per this protocol was then assessed across the 2 conversations collected for each PWA. Results Use of the CIUconv resulted in excellent IRR of %CIU for each research assistant and the 1st author. Likewise, test-retest stability for the measure was excellent. Results were evaluated at both the group and individual levels. Conclusions %CIU demonstrated excellent interrater and test-retest reliability when applied to unstructured conversation using the CIUconv procedure, which was developed to account for expected linguistic characteristics of conversation. These findings suggest that %CIU may be a feasible, reliable measure of informativeness in unstructured conversation in PWA when the CIUconv is used by trained raters.
目的 本研究旨在确定正确的信息单位(CIU)是否可以可靠地应用于失语症患者(PWA)的非结构化会话语料中。CIU 是由 Nicholas 和 Brookshire(1993)开发的,用于测量结构化独白话语中的词级信息量,临床医生和研究人员广泛将其用于此目的。一项针对 CIU 在会话中使用的案例研究(Oelschlaeger 和 Thorne,1999)表明,其存在可靠性(IRR)的潜在问题,这阻碍了将 CIU 应用于该话语环境。但是,没有进一步的研究来复制或扩展这一发现。鉴于对适用于非结构化会话的可靠语言测量方法的临床和研究需求,重新审视 CIU 的可靠性、稳定性和适用性是必要的。 方法 根据会话话语的需求,对 Nicholas 和 Brookshire(1993)开发的 CIU 协议进行了修改,得到了会话中的 CIU(CIUconv)协议。两名言语语言病理学研究生研究助理在第一作者的指导下完成了使用 CIUconv 的培训。使用 CIUconv 协议,对 8 名 PWA(即每人 2 次会话)进行的 16 次会话作为语言样本,以确定会话中 CIU 的百分比(%CIU)的 IRR。然后,根据本协议,评估每个 PWA 收集的 2 次会话中%CIU 的测试-重测稳定性。 结果 每个研究助理和第一作者使用 CIUconv 得到的%CIU 的 IRR 都非常好。同样,该措施的测试-重测稳定性也非常好。结果在组和个体水平上进行了评估。 结论 当使用 CIUconv 程序将 CIU 应用于非结构化会话时,%CIU 的组内和个体间的可靠性均非常高,该程序是为了考虑会话的预期语言特征而开发的。这些发现表明,当经过培训的评估者使用 CIUconv 时,%CIU 可能是一种可行的、可靠的失语症患者非结构化会话中信息量的测量方法。