Department of Computing Science, University of Alberta, Edmonton, Alberta, Canada.
Behav Res Methods. 2020 Apr;52(2):694-722. doi: 10.3758/s13428-019-01270-w.
Best-worst scaling is a judgment format in which participants are presented with K items and must choose the best and worst items from that set, along some underlying latent dimension. Best-worst scaling has seen recent use in natural-language processing and psychology to collect lexical semantic norms. In such applications, four items have always been presented on each trial. The present study provides reasoning that values other than 4 might provide better estimates of latent values. The results from simulation experiments and behavioral research confirmed this: Both suggest that, in the general case, six items per trial better reduces errors in the latent value estimates.
最佳最差标度法是一种判断格式，参与者会看到 K 个项目，并必须从该组中选择最好和最差的项目，同时考虑一些潜在的潜在维度。最佳最差标度法最近在自然语言处理和心理学中被用于收集词汇语义规范。在这种应用中，每个试验总是呈现四个项目。本研究提供了一些理由，表明除了 4 以外的其他值可能提供更好的潜在值估计。模拟实验和行为研究的结果证实了这一点：都表明，在一般情况下，每次试验六个项目可以更好地减少潜在值估计中的误差。
