Wilkinson Tom M, Wilkinson Tim J
Hawkes Bay Hospital, Hastings, New Zealand.
Medical Education Unit, University of Otago, P.O. Box 4345, Christchurch, 8140, New Zealand.
BMC Med Educ. 2016 Oct 3;16(1):258. doi: 10.1186/s12909-016-0779-x.
Most research into the validity of admissions tools focuses on the isolated correlations of individual tools with later outcomes. Instead, looking at how domains of attributes, rather than tools, predict later success is likely to be more generalizable. We aim to produce a blueprint for an admissions scheme that is broadly relevant across institutions.
We broke down all measures used for admissions at one medical school into the smallest possible component scores. We grouped these into domains on the basis of a multicollinearity analysis, and conducted a regression analysis to determine the independent validity of each domain to predict outcomes of interest.
We identified four broad domains: logical reasoning and problem solving, understanding people, communication skills, and biomedical science. Each was independently and significantly associated with performance in final medical school examinations.
We identified two potential errors in the design of admissions schema that can undermine their validity: focusing on tools rather than outcomes, and including a wide range of measures without objectively evaluating the independent contribution of each. Both could be avoided by following a process of programmatic assessment for selection.
大多数关于录取工具有效性的研究都集中在单个工具与后续结果的孤立相关性上。相反,研究属性领域而非工具如何预测未来的成功可能更具普遍性。我们旨在制定一个适用于各机构的录取方案蓝图。
我们将一所医学院用于录取的所有指标分解为尽可能小的成分得分。我们基于多重共线性分析将这些指标分组为不同领域,并进行回归分析以确定每个领域预测感兴趣结果的独立有效性。
我们确定了四个广泛的领域:逻辑推理与问题解决、理解他人、沟通技巧和生物医学科学。每个领域都与医学院期末考试成绩独立且显著相关。
我们在录取方案设计中发现了两个可能会削弱其有效性的潜在错误:关注工具而非结果,以及纳入大量指标却未客观评估每个指标的独立贡献。通过遵循选拔的程序化评估过程可以避免这两个问题。