University of Delaware, United States.
J Sch Psychol. 2018 Jun;68:19-37. doi: 10.1016/j.jsp.2017.12.005. Epub 2018 Feb 3.
The adoption of the Common Core State Standards and its associated assessments has placed increased focus on writing performance. Consequently, weak writers may be at risk of failing Common Core English language arts (ELA) assessments. Thus, the current study sampled a diverse group of third and fourth grade students (n=100 and 130, respectively) who were administered Fall and Spring writing screeners using the procedures of a Direct Assessment of Writing (DAW). Results were used to predict whether students did or did not attain grade-level standards as evaluated by the summative Smarter Balanced ELA assessment. Writing screeners were scored using the Project Essay Grade (PEG) automated essay scoring system. ROC curve analysis and logistic regression were used to evaluate screening models. Area under the ROC curve (AUC) values for grade 3 were in the acceptable range (Fall=0.74, Spring=0.75). AUCs approached or fell within the excellent range for grade 4 (Fall=0.79, Spring=0.83). Sensitivity-based and d-based cutpoints were selected and measures of diagnostic accuracy, including sensitivity and specificity, are reported. Results indicate that automatically-scored DAW has promise for universal screening for writing risk.
共同核心州立标准及其相关评估的采用更加关注写作表现。因此，写作能力较弱的学生可能有无法通过共同核心英语语言艺术（ELA）评估的风险。因此，本研究对来自三、四年级的学生进行了抽样调查（Fall 组分别有 100 人和 Spring 组 130 人），他们使用直接写作评估（DAW）程序接受了秋季和春季的写作筛查。结果用于预测学生是否达到了由总结性 Smarter Balanced ELA 评估评估的年级水平标准。写作筛查使用项目论文评分（PEG）自动论文评分系统进行评分。ROC 曲线分析和逻辑回归用于评估筛选模型。ROC 曲线下面积（AUC）值在可接受范围内（Fall=0.74，Spring=0.75）。四年级的 AUC 值接近或达到优秀范围（Fall=0.79，Spring=0.83）。选择了基于敏感性和 d 的切点，并报告了诊断准确性的度量，包括敏感性和特异性。结果表明，自动评分的 DAW 具有用于写作风险普筛的潜力。
