CEB.
Department of Psychology, Central Michigan University.
J Appl Psychol. 2014 Mar;99(2):282-95. doi: 10.1037/a0035213. Epub 2013 Dec 23.
This research examines the relationship between the construct and criterion-related validity of assessment centers (ACs) based on how convergence of dimension ratings across AC exercises affects their ability to predict managerial performance. According to traditional multitrait-multimethod perspective, a high degree of convergence represents more reliable measurement and has the potential for better validity. In contrast, the concept of situational bandwidth suggests that behavior assessed under a dissimilar set of circumstances should result in a more comprehensive assessment of a candidate's tendencies even though ratings are less likely to show high convergence. To test these opposing viewpoints, data from 3 operational ACs were obtained along with experts' evaluations of exercise characteristics and supervisors' ratings of candidates' managerial performance. Across the 3 samples, AC ratings taken from exercises with dissimilar demands had higher estimates of criterion-related validity than ratings taken from similar exercises, even though the same dimension-different exercise correlations were substantially higher between similar exercises. Composites of ratings high in convergence did not emerge as better predictors of managerial performance, and validity particularly suffered when derived from ratings that converged as a result of exercises with similar demands. Implications for AC design are discussed.
本研究考察了评估中心（AC）的构念和效标关联效度之间的关系，其依据是跨 AC 练习的维度评分的收敛度如何影响它们预测管理绩效的能力。根据传统的多特质-多方法观点，高程度的收敛度表示更可靠的测量，并且具有更好的有效性的潜力。相比之下，情境带宽的概念表明，在一组不同的情况下评估的行为应该导致对候选人的倾向的更全面的评估，即使评分不太可能显示出高度的收敛。为了检验这些相反的观点，从 3 个运营中的 AC 中获得了数据，以及专家对练习特征的评估和主管对候选人管理绩效的评分。在这 3 个样本中，来自需求不同的练习的 AC 评分比来自相似练习的评分具有更高的效标关联效度估计，尽管相同维度-不同练习之间的相关性在相似练习之间要高得多。高收敛度评分的综合评分并没有成为管理绩效的更好预测指标，当从由于具有相似需求的练习而收敛的评分中得出有效性时，尤其会受到影响。还讨论了对 AC 设计的影响。
