Green Samuel B, Yang Yanyun, Alt Mary, Brinkley Shara, Gray Shelley, Hogan Tiffany, Cowan Nelson
Arizona State University, Social Sciences Building, 951 S Cady Mall, P.O. Box 873701, Tempe, AZ, 85287-3701, USA.
Florida State University, Tallahassee, FL, USA.
Psychon Bull Rev. 2016 Jun;23(3):750-63. doi: 10.3758/s13423-015-0968-3.
Reliabilities of scores for experimental tasks are likely to differ from one study to another to the extent that the task stimuli change, the number of trials varies, the type of individuals taking the task changes, the administration conditions are altered, or the focal task variable differs. Given that reliabilities vary as a function of the design of these tasks and the characteristics of the individuals taking them, making inferences about the reliability of scores in an ongoing study based on reliability estimates from prior studies is precarious. Thus, it would be advantageous to estimate reliability based on data from the ongoing study. We argue that internal consistency estimates of reliability are underutilized for experimental task data and in many applications could provide this information using a single administration of a task. We discuss different methods for computing internal consistency estimates with a generalized coefficient alpha and the conditions under which these estimates are accurate. We illustrate use of these coefficients using data for three different tasks.
实验任务得分的可靠性在不同研究中可能存在差异，具体取决于任务刺激的变化、试验次数的不同、参与任务的个体类型的改变、施测条件的变更，或者核心任务变量的差异。鉴于可靠性会因这些任务的设计以及参与任务的个体特征而有所不同，基于先前研究的可靠性估计对正在进行的研究中的得分可靠性进行推断是不可靠的。因此，基于正在进行的研究中的数据来估计可靠性会更具优势。我们认为，可靠性的内部一致性估计在实验任务数据中未得到充分利用，并且在许多应用中，使用任务的单次施测就可以提供此信息。我们讨论了使用广义系数α计算内部一致性估计的不同方法以及这些估计准确的条件。我们使用三个不同任务的数据来说明这些系数的用法。
