Eisenberg Sarita L, Guo Ling-Yu
Department of Communication Sciences and Disorders, Montclair State University, Bloomfield, NJ.
Department of Communicative Sciences and Disorders, University at Buffalo, NY.
Lang Speech Hear Serv Sch. 2018 Jan 9;49(1):98-107. doi: 10.1044/2017_LSHSS-16-0070.
This report investigated the validity of using percent grammatical responses (PGR) as a measure for assessing grammaticality. To establish construct validity, we computed the correlation of PGR with another measure of grammar skills and with an unrelated skill area. To establish concurrent validity for PGR, we computed the correlation of PGR with a previously validated measure of grammaticality, percent grammatical utterances (PGU), and examined the extent to which PGR and PGU agreed upon pass/fail decisions for children.
Participants included 79 3-year-olds from mostly middle socioeconomic status homes. Language samples were elicited by asking children to describe 15 pictures in response to 4 questions per picture. To calculate PGU, children's responses to all 4 questions were segmented into communication units, and each communication unit was evaluated for grammatical errors. To calculate PGR, the entire response to just the first question was evaluated for grammatical errors.
PGR scores significantly correlated with a standardized test of grammar (r = .70), but not with a measure of vocabulary (i.e., type-token ratio; r = .11). In addition, PGR scores were significantly correlated with PGU scores (r = .88). Agreement between PGR and PGU was 92% for pass decisions and 94% for fail decisions.
The current study establishes the construct validity of PGR as a measure of grammar and supports the use of PGR as a measure to assess grammaticality.
本报告探讨了使用语法正确反应百分比(PGR)作为评估语法准确性指标的有效性。为了建立结构效度,我们计算了PGR与另一项语法技能指标以及一个不相关技能领域的相关性。为了建立PGR的同时效度,我们计算了PGR与先前验证过的语法准确性指标——语法正确话语百分比(PGU)的相关性,并考察了PGR和PGU在判定儿童通过/未通过方面的一致程度。
参与者包括79名来自社会经济地位大多处于中等水平家庭的3岁儿童。通过要求儿童根据每张图片的4个问题描述15张图片来收集语言样本。为了计算PGU,将儿童对所有4个问题的回答分割成交流单元,并对每个交流单元的语法错误进行评估。为了计算PGR,仅对第一个问题的完整回答进行语法错误评估。
PGR分数与一项标准化语法测试显著相关(r = .70),但与一项词汇指标(即类型-标志比;r = .11)不相关。此外,PGR分数与PGU分数显著相关(r = .88)。PGR和PGU在通过判定上的一致性为92%,在未通过判定上的一致性为94%。
本研究确立了PGR作为语法指标的结构效度,并支持将PGR用作评估语法准确性的指标。