Allison Kristen M, Millington Marnie, Grimm Alanna
Department of Communication Sciences and Disorders, Northeastern University, Boston, MA.
Children's Speech and Feeding Therapy, Needham, MA.
Am J Speech Lang Pathol. 2025 Mar 10;34(2):853-867. doi: 10.1044/2024_AJSLP-24-00247. Epub 2025 Feb 24.
This study aimed to investigate the accuracy and reliability of subjective intelligibility estimates of young children's speech made by speech-language pathologists (SLPs) compared to naive listeners, and to examine how the severity of the child's speech impairment influences SLPs' intelligibility estimates.
Eighteen certified SLPs and 18 naive listeners provided intelligibility ratings of single-word speech samples produced by six preschoolers with speech disorders. All listeners rated intelligibility using two different methods: orthographic transcription and subjective estimation of the percentage of words understood. Absolute differences between estimated and transcription intelligibility scores were used to examine accuracy of intelligibility estimates in both listener groups, and intraclass correlations were used to evaluate interrater reliability.
Subjective intelligibility estimates differed from orthographic transcription-based intelligibility scores by 12.4% in the SLP listener group and 18.9% in the naive listener group. Interrater reliability of estimated intelligibility was substantially lower than transcription intelligibility in both listener groups.
Results of this preliminary study suggest that subjective intelligibility estimates by SLPs are not adequately accurate or reliable for measurement of children's speech intelligibility.
本研究旨在调查言语语言病理学家（SLP）与普通听众相比，对幼儿言语主观可懂度估计的准确性和可靠性，并研究儿童言语障碍的严重程度如何影响SLP的可懂度估计。
18名认证的SLP和18名普通听众对6名患有言语障碍的学龄前儿童的单字言语样本的可懂度进行评分。所有听众使用两种不同的方法对可懂度进行评分：正字法转录和对听懂单词百分比的主观估计。估计的和转录的可懂度分数之间的绝对差异用于检验两组听众可懂度估计的准确性，组内相关系数用于评估评分者间的可靠性。
在SLP听众组中，主观可懂度估计与基于正字法转录的可懂度分数相差12.4%，在普通听众组中相差18.9%。在两组听众中，估计可懂度的评分者间可靠性均显著低于转录可懂度。
这项初步研究的结果表明，SLP的主观可懂度估计在测量儿童言语可懂度方面不够准确或可靠。
