Endres L S, Guastello S J, Rieke M L
Johnson Controls, Inc., Milwaukee, WI.
J Pers Assess. 1992 Dec;59(3):448-67. doi: 10.1207/s15327752jpa5903_3.
Meta-interpretive reliability is a new method to evaluate the accuracy with which personality trait scores are communicated via interpretive statements in a computer-based test interpretation (CBTI). The prototypic experimental design is based on a two-way repeated measures analysis of variance (ANOVA); the two effects are personality traits and randomly chosen CBTI protocols. In this application, 101 psychologists read four examples of the Karson Clinical Report (KCR, Karson & O'Dell, 1975) and estimated the original trait scores from the Sixteen Personality Factor Questionnaire (16PF; Cattell, Eber, & Tatsuoka, 1970) on which the KCR is based. Estimated trait score variance was significantly related to the Trait x Protocol interaction and the main effects for personality trait and differences among protocols (omega 2 = .55). The total effect size corresponded to a multiple correlation of .74, suggesting that the KCR had acceptable meta-interpretive reliability. The protocol effect denoted a context effect created by the juxtaposition of several interpretive statements. Additional analyses showed that individual differences among raters contributed to less than 1% of the estimated standard ten (sten) score variance. Meta-interpretive reliability is proposed as an index of the upper limit of validity for CBTIs.
元解释可靠性是一种评估通过计算机化测试解释（CBTI）中的解释性陈述传达人格特质分数的准确性的新方法。典型的实验设计基于双向重复测量方差分析（ANOVA）；两个效应分别是人格特质和随机选择的CBTI协议。在本应用中，101位心理学家阅读了卡森临床报告（KCR，卡森和奥德尔，1975年）的四个示例，并根据KCR所基于的十六种人格因素问卷（16PF；卡特尔、埃伯和龙冈，1970年）估计了原始特质分数。估计的特质分数方差与特质×协议交互作用以及人格特质的主效应和协议之间的差异显著相关（ω2 = 0.55）。总效应大小对应于多重相关系数0.74，表明KCR具有可接受的元解释可靠性。协议效应表示由几个解释性陈述并列产生的上下文效应。进一步分析表明，评分者之间的个体差异对估计的标准十分（sten）分数方差的贡献不到1%。元解释可靠性被提议作为CBTIs有效性上限的一个指标。
