Swartz Carl W, Burdick Donald S, Hanlon Sean T, Stenner A Jackson, Kyngdon Andrew, Burdick Harold, Smith Malbert
MetaMetrics, 1000 Park Forty Plaza Dr., Ste. 120, Durham, NC 27713, USA,
J Appl Meas. 2014;15(4):359-71.
Validity of specification equations used by auto-text processors to estimate theoretical text complexity have increased importance because of the Common Core State Standards. Theoretical estimates of text complexity will inform (a) setting standards for college and career readiness, (b) grade-level standards, matching readers to text, and (d) creating a daily diet of stretch and targeted text designed to grow reading ability and content knowledge. The purpose of this research was to investigate the specification equation used in the Lexile Framework for Reading to measure text complexity. The Lexile Reading Analyzer contains a specification equation that uses proxies for the semantic difficulty and syntactic complexity to estimate the theoretical complexity of professionally-edited text. Differences between theoretical and empirical estimates of text complexity were examined for a set of 446 professionally authored, previously published passages. Students in grades 2-12 read these passages using A Learning Oasis, a web-based technology, to ensure that most of the articles read were well-targeted to student ability (+100L). Each article was response illustrated using an auto-generated semantic cloze item type embedded into passages. Observed student performance on this item type was used to derive an empirical estimate of text complexity for each passage. Theoretical estimates of text complexity accounted for approximately 90 percent of the variance in empirical estimates of text complexity. These findings suggest that the specification equation contains powerful predictors of empirical text complexity, speculation remains on what additional variables might account for the 10 percent of unexplained variation.
由于《共同核心州立标准》,自动文本处理器用于估计理论文本复杂度的规范方程的有效性变得愈发重要。文本复杂度的理论估计将为以下方面提供信息:(a)设定大学和职业准备标准;(b)年级水平标准,使读者与文本匹配;以及(d)制定旨在提高阅读能力和内容知识的每日拓展性和针对性文本阅读计划。本研究的目的是调查用于《蓝思阅读框架》中衡量文本复杂度的规范方程。蓝思阅读分析器包含一个规范方程,该方程使用语义难度和句法复杂度的替代指标来估计专业编辑文本的理论复杂度。针对一组446篇专业撰写且已发表的文章,研究了文本复杂度理论估计值与实证估计值之间的差异。2至12年级的学生使用基于网络的技术“学习绿洲”阅读这些文章,以确保所阅读的大多数文章与学生能力(+100L)高度匹配。每篇文章都通过嵌入其中的自动生成的语义完形填空题型进行反应说明。观察到的学生在该题型上的表现被用于得出每篇文章文本复杂度的实证估计值。文本复杂度的理论估计值约占文本复杂度实证估计值方差的90%。这些发现表明,该规范方程包含了实证文本复杂度的有力预测指标,不过对于哪些额外变量可能导致10%的无法解释的变异,仍存在猜测。