Center for Adaptive Rationality.
Department of Developmental Psychology.
Psychol Methods. 2021 Apr;26(2):175-185. doi: 10.1037/met0000294. Epub 2020 Jun 25.
With the advent of online and app-based studies, researchers in psychology are making increasing use of repeated subjective reports. The new methods open up opportunities to study behavior in the field and to map causal processes, but they also pose new challenges. Recent work has added initial elevation bias to the list of common pitfalls; here, higher negative states (i.e., thoughts and feelings) are reported on the first day of assessment than on later days. This article showcases a new approach to addressing this and other measurement reactivity biases. Specifically, we employed a planned missingness design in a daily diary study of more than 1,300 individuals who were assessed over a period of up to 70 days to estimate and adjust for measurement reactivity biases. We found that day of first item presentation, item order, and item number were associated with only negligible bias: Items were not answered differently depending on when and where they were shown. Initial elevation bias may thus be more limited than has previously been reported or it may act only at the level of the survey, not at the item level. We encourage researchers to make design choices that will allow them to routinely assess measurement reactivity biases in their studies. Specifically, we advocate the routine randomization of item display and order, as well as of the timing and frequency of measurement. Randomized planned missingness makes it possible to empirically gauge how fatigue, familiarity, and learning interact to bias responses. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
随着在线和基于应用程序的研究的出现，心理学研究人员越来越多地使用重复的主观报告。新方法为在现场研究行为和绘制因果过程开辟了机会，但也带来了新的挑战。最近的工作将初始升高偏差添加到常见陷阱列表中；在这里，在评估的第一天报告的负面状态较高（即思想和感觉）比在以后的日子里高。本文展示了一种解决此问题和其他测量反应性偏差的新方法。具体来说，我们在一项超过 1300 人的日常日记研究中采用了计划缺失设计，在长达 70 天的时间内对测量反应性偏差进行了估计和调整。我们发现，第一天的项目呈现、项目顺序和项目数量仅与可忽略的偏差相关：项目的回答不会因何时以及何地显示而有所不同。初始升高偏差可能比以前报道的更有限，或者它可能只在调查层面起作用，而不在项目层面起作用。我们鼓励研究人员做出设计选择，以便在他们的研究中经常评估测量反应性偏差。具体来说，我们提倡项目展示和顺序的随机化，以及测量的时间和频率的随机化。随机化计划缺失使得可以根据疲劳、熟悉度和学习相互作用来偏置响应的方式进行实证评估。（PsycInfo 数据库记录（c）2021 APA，保留所有权利）。
