College of Business, Oregon State University.
Independent practice.
J Appl Psychol. 2017 Jul;102(7):1148-1158. doi: 10.1037/apl0000213. Epub 2017 Mar 23.
Conventional wisdom suggests that assessment length is positively related to the rate at which applicants opt out of the assessment phase. However, restricting assessment length can negatively impact the utility of a selection system by reducing the reliability of its construct scores and constraining coverage of the relevant criterion domain. Given the costly nature of these tradeoffs, is it better for managers to prioritize (a) shortening assessments to reduce applicant attrition rates or (b) ensuring optimal reliability and validity of their assessment scores? In the present study, we use data from 222,772 job-seekers nested within 69 selection systems to challenge the popular notion that selection system length predicts applicant attrition behavior. Specifically, we argue that the majority of applicant attrition occurs very early in the assessment phase and that attrition risk decreases, not increases, as a function of time spent in assessment. Our findings supported these predictions, revealing that the majority of applicants who quit assessments did so within the first 20 min of the assessment phase. Consequently, selection system length did not predict rates of applicant attrition. In fact, when controlling for observed system length and various job characteristics, we found that systems providing more conservative (i.e., longer) estimates of assessment length produced lower overall attrition rates. Collectively, these findings suggest that efforts to curtail applicant attrition by shortening assessment length may be misguided. (PsycINFO Database Record
传统观点认为,评估时长与申请人退出评估阶段的速度呈正相关。然而,限制评估时长可能会通过降低其结构分数的可靠性和限制相关标准领域的涵盖范围,对选拔系统的效用产生负面影响。鉴于这些权衡的代价高昂,对于管理者来说,优先考虑(a)缩短评估以降低申请人流失率,还是(b)确保评估分数的最佳可靠性和有效性,哪种做法更好?在本研究中,我们使用了来自 69 个选拔系统中的 222772 名求职者的嵌套数据,对普遍认为的选拔系统长度预测申请人流失行为的观点提出了挑战。具体来说,我们认为,大多数申请人流失发生在评估阶段的早期,而且随着评估时间的增加,流失风险会降低,而不是增加。我们的研究结果支持了这些预测,表明大多数退出评估的申请人是在评估阶段的前 20 分钟内退出的。因此,选拔系统长度并不能预测申请人的流失率。事实上,当控制观察到的系统长度和各种工作特征时,我们发现提供更保守(即更长)评估长度估计的系统产生的总体流失率更低。综上所述,这些发现表明,通过缩短评估长度来减少申请人流失的努力可能是错误的。