Department of Speech-Language-Hearing Sciences, Hofstra University, Hempstead, NY.
Department of Communicative Sciences and Disorders, New York University, New York.
Am J Speech Lang Pathol. 2023 Aug 17;32(4S):1866-1883. doi: 10.1044/2023_AJSLP-22-00166. Epub 2023 May 17.
The Multilevel word Accuracy Composite Scale (MACS) is a novel whole-word measure of speech production accuracy designed to evaluate behaviors commonly targeted in motor-based intervention for childhood apraxia of speech (CAS). The MACS yields a composite score generated through ratings of and . This study examined the validity of the MACS through comparison to established measures of speech accuracy. Reliability was also examined within and between practicing speech-language pathologists (SLPs).
The MACS was used to rate 117 tokens produced by children with severe CAS. Ratings were performed in the laboratory setting by two expert raters and by practicing SLPs ( = 19). Concurrent validity was estimated through comparison of expert MACS ratings (i.e., MACS score and each component rating) to measures of speech accuracy (percent phoneme correct and the 3-point scale) using correlational analyses. Reliability was examined between expert raters and across SLP raters using the intraclass correlation coefficient to examine interrater reliability of expert ratings, in addition to inter- and intrarater reliability of SLP ratings.
Correlation analyses between MACS ratings (i.e., MACS score and component ratings) and existing measures of speech accuracy revealed small to large positive correlations between measures. Reliability analyses revealed moderate to excellent reliability for MACS ratings performed by expert raters and between (interrater) and within (intrarater) SLP raters.
Analyses of concurrent validity indicate that the MACS aligns with established measures, yet contributes novel elements for rating speech accuracy. Results further support the MACS as a reliable measure for rating speech accuracy in children with severe speech impairment for ratings performed by expert raters and practicing clinicians.
多水平单词准确性综合量表(MACS)是一种新颖的全词言语产生准确性测量工具,旨在评估儿童言语运动障碍(CAS)的基于运动的干预中常见的行为。MACS 通过 和 的评分来生成综合评分。本研究通过与现有的言语准确性测量工具进行比较来检验 MACS 的有效性。还在练习言语语言病理学家(SLP)内部和之间检查了可靠性。
使用 MACS 对 117 个由严重 CAS 儿童产生的音位进行评分。评分由两位专家评估者和 19 名练习 SLP 在实验室环境中进行。通过相关分析,通过比较专家 MACS 评分(即 MACS 得分和每个组成部分的评分)与言语准确性测量(音位百分比正确和 3 分制)来估计并行效度。使用组内相关系数检查专家评分之间的可靠性以及 SLP 评分之间的可靠性,以检查专家评分的组内可靠性,以及 SLP 评分的组内和组间可靠性。
MACS 评分(即 MACS 得分和组成部分评分)与现有的言语准确性测量之间的相关分析显示,两种测量之间存在小到中等的正相关。可靠性分析显示,专家评估者和(组间)和(组内)SLP 评估者之间的 MACS 评分具有中等至极好的可靠性。
并行效度分析表明,MACS 与现有的测量工具一致,但为言语准确性评分提供了新的元素。结果进一步支持 MACS 作为一种可靠的工具,用于评估严重言语障碍儿童的言语准确性,适用于专家评估者和练习临床医生的评估。