Rotello Caren M, Masson Michael E J, Verde Michael F
Department of Psychology, University of Massachusetts, Amherst, Massachusetts 01003-7710, USA.
Percept Psychophys. 2008 Feb;70(2):389-401. doi: 10.3758/pp.70.2.389.
Experiments often produce a hit rate and a false alarm rate in each of two conditions. These response rates are summarized into a single-point sensitivity measure such as d', and t tests are conducted to test for experimental effects. Using large-scale Monte Carlo simulations, we evaluate the Type I error rates and power that result from four commonly used single-point measures: d', A', percent correct, and gamma. We also test a newly proposed measure called gammaC. For all measures, we consider several ways of handling cases in which false alarm rate = 0 or hit rate = 1. The results of our simulations indicate that power is similar for these measures but that the Type I error rates are often unacceptably high. Type I errors are minimized when the selected sensitivity measure is theoretically appropriate for the data.
实验通常会在两种条件下分别产生一个命中率和一个误报率。这些反应率被汇总为一个单点敏感性度量,如d',并进行t检验以检验实验效果。通过大规模蒙特卡罗模拟,我们评估了四种常用单点度量(d'、A'、正确率和γ)所导致的I型错误率和检验功效。我们还测试了一种新提出的度量,称为gammaC。对于所有度量,我们考虑了几种处理误报率=0或命中率=1情况的方法。我们的模拟结果表明,这些度量的检验功效相似,但I型错误率往往高得令人无法接受。当所选的敏感性度量在理论上适用于数据时,I型错误会降至最低。