Department of Educational Psychology, University of Minnesota, Minneapolis, MN.
J Appl Behav Anal. 2020 Jan;53(1):572-583. doi: 10.1002/jaba.560. Epub 2019 Mar 29.
Visual analysis is integral to the analysis of single-case experimental design (SCED) data. Previous studies have shown that many factors may influence the interrater agreement (IRA) of visual analysis. One factor that has received little direct attention is the impact of contextual information. In the current study, authors of recently published SCED studies were asked to make judgments regarding functional relations based on published datasets that met criteria for design quality. Respondents were randomly assigned to view graphs with or without contextual information and the degree of interrater agreement was compared. Results revealed that contextual information had no impact on IRA for decisions of a functional relation. IRA was high across both groups for 6 of the 7 datasets examined. Implications and recommendations based on these results are discussed.
视觉分析是单项实验设计（SCED）数据分析不可或缺的一部分。先前的研究表明，许多因素可能会影响视觉分析的评分者间一致性（IRA）。一个很少受到直接关注的因素是上下文信息的影响。在本研究中，要求最近发表的 SCED 研究的作者根据符合设计质量标准的已发表数据集，对功能关系做出判断。被试被随机分配观看带有或不带有上下文信息的图表，并比较评分者间的一致性程度。结果表明，上下文信息对功能关系判断的 IRA 没有影响。在 7 个被检查的数据集的 6 个中，两组的 IRA 都很高。基于这些结果的含义和建议进行了讨论。
