Higham Philip A
School of Psychology, University of Southampton, Highfield, Southampton, England.
J Exp Psychol Gen. 2007 Feb;136(1):1-22. doi: 10.1037/0096-3445.136.1.1.
Two experiments investigated criterion setting and metacognitive processes underlying the strategic regulation of accuracy on the Scholastic Aptitude Test (SAT) using Type-2 signal detection theory (SDT). In Experiment 1, report bias was manipulated by penalizing participants either 0.25 (low incentive) or 4 (high incentive) points for each error. Best guesses to unanswered items were obtained so that Type-2 signal detection indices of discrimination and bias could be calculated. The same incentive manipulation was used in Experiment 2, only the test was computerized, confidence ratings were taken so that receiver operating characteristic (ROC) curves could be generated, and feedback was manipulated. The results of both experiments demonstrated that SDT provides a viable alternative to A. Koriat and M. Goldsmith's (1996c) framework of monitoring and control and reveals information about the regulation of accuracy that their framework does not. For example, ROC analysis indicated that the threshold model implied by formula scoring is inadequate. Instead, performance on the SAT should be modeled with an equal-variance Gaussian, Type-2 signal detection model.
两项实验使用二类信号检测理论(SDT)研究了学术能力评估测试(SAT)中准确性的策略调节背后的标准设定和元认知过程。在实验1中,通过对每个错误惩罚参与者0.25分(低激励)或4分(高激励)来操纵报告偏差。获取对未回答项目的最佳猜测,以便能够计算二类信号检测的辨别力和偏差指标。实验2采用了相同的激励操纵方式,只是测试采用了计算机化形式,获取了信心评级以便生成接收者操作特征(ROC)曲线,并对反馈进行了操纵。两项实验的结果均表明,SDT为A.科里亚特和M.戈德史密斯(1996c)的监测与控制框架提供了一种可行的替代方案,并揭示了其框架未涉及的有关准确性调节的信息。例如,ROC分析表明公式评分所隐含的阈值模型并不充分。相反,SAT的表现应以等方差高斯二类信号检测模型来建模。