a Department of Psychological and Quantitative Foundations , University of Iowa.
b Test Development , ACT.
J Pers Assess. 2019 May-Jun;101(3):237-252. doi: 10.1080/00223891.2017.1406361. Epub 2018 Jan 11.
Although interchangeability of results across computer and paper modes of administration is commonly assumed, recent meta-analyses and individual studies continue to reveal mean differences in scores for measures of socially desirable responding (SDR). Results from these studies have also failed to include new methods of scoring and crucial aspects of scaling, reliability, validity, and administration emphasized in professional standards for assessment that are essential in establishing equivalence. We addressed these shortcomings in a comprehensive, repeated measures investigation for 6 ways of scoring the Balanced Inventory of Desirable Responding (BIDR), one of the most frequently administered companion measures of SDR in research and practice. Results for many previously unexamined, standards-driven aspects of scaling, reliability, and validity strongly supported the interchangeability of scores across modes of administration. Computer questionnaires also took considerably less time to complete and were overwhelmingly favored by respondents in relation to physical characteristics of the measures, appraisals of the the assessment experience, and perceived quality of information obtained. Collectively, these results highlight the importance of following professional standards when constructing and administering computerized assessments and the evolution of computer technology in providing viable, effective, and accepted platforms for administering and scoring the BIDR in numerous ways.
尽管人们通常假定计算机和纸质模式下的结果可以互换,但最近的荟萃分析和个别研究继续揭示出在衡量社会期望反应(SDR)的措施方面,得分存在均值差异。这些研究的结果也没有包括新的评分方法和评分、可靠性、有效性和管理方面的重要方面,这些方面在评估的专业标准中至关重要,是建立等效性的基础。我们在一项全面的、重复测量的研究中解决了这些问题,该研究涉及平衡期望反应量表(BIDR)的 6 种评分方式,这是研究和实践中最常使用的 SDR 伴随测量方法之一。许多以前未经过检验的、基于标准的评分、可靠性和有效性方面的结果强烈支持了在不同管理模式下的评分可互换性。计算机问卷也需要花费更少的时间完成,并且在与测量的物理特征、评估的评估体验以及获得的信息质量相关方面,都得到了受访者的压倒性青睐。总的来说,这些结果强调了在构建和管理计算机化评估时遵循专业标准的重要性,以及计算机技术的发展在提供可行、有效和可接受的平台方面的重要性,这些平台可以以多种方式管理和评分 BIDR。