Hox Joop J, De Leeuw Edith D, Zijlmans Eva A O
Department of Methodology and Statistics, Utrecht University Utrecht, Netherlands.
Department of Methodology and Statistics, Tilburg University Tilburg, Netherlands.
Front Psychol. 2015 Feb 5;6:87. doi: 10.3389/fpsyg.2015.00087. eCollection 2015.
Surveys increasingly use mixed mode data collection (e.g., combining face-to-face and web) because this controls costs and helps to maintain good response rates. However, a combination of different survey modes in one study, be it cross-sectional or longitudinal, can lead to different kinds of measurement errors. For example, respondents in a face-to-face survey or a web survey may interpret the same question differently, and might give a different answer, just because of the way the question is presented. This effect of survey mode on the question-answer process is called measurement mode effect. This study develops methodological and statistical tools to identify the existence and size of mode effects in a mixed mode survey. In addition, it assesses the size and importance of mode effects in measurement instruments using a specific mixed mode panel survey (Netherlands Kinship Panel Study). Most measurement instruments in the NKPS are multi-item scales, therefore confirmatory factor analysis (CFA) will be used as the main analysis tool, using propensity score methods to correct for selection effects. The results show that the NKPS scales by and large have measurement equivalence, but in most cases only partial measurement equivalence. Controlling for respondent differences on demographic variables, and on scale scores from the previous uni-mode measurement occasion, tends to improve measurement equivalence, but not for all scales. The discussion ends with a review of the implications of our results for analyses employing these scales.
调查越来越多地采用混合模式数据收集方法（例如，将面对面调查和网络调查相结合），因为这样可以控制成本并有助于保持较高的回应率。然而，在一项研究中，无论是横断面研究还是纵向研究，采用不同调查模式的组合都可能导致不同类型的测量误差。例如，面对面调查或网络调查中的受访者可能会因问题呈现方式的不同而对同一个问题有不同的理解，并可能给出不同的答案。这种调查模式对问答过程的影响被称为测量模式效应。本研究开发了方法学和统计工具，以识别混合模式调查中模式效应的存在及其大小。此外，它还使用特定的混合模式面板调查（荷兰亲属关系面板研究）评估了测量工具中模式效应的大小和重要性。荷兰亲属关系面板研究中的大多数测量工具都是多项目量表，因此验证性因素分析（CFA）将作为主要分析工具，并使用倾向得分方法来校正选择效应。结果表明，荷兰亲属关系面板研究的量表总体上具有测量等效性，但在大多数情况下只有部分测量等效性。控制受访者在人口统计学变量以及上一次单模式测量时的量表得分上的差异，往往会提高测量等效性，但并非对所有量表都有效。讨论最后回顾了我们的研究结果对使用这些量表进行分析的影响。
