Greatrix Rachel, Nicholson Sandra, Anderson Susan
UCAT, School of Medicine, University of Nottingham, Nottingham, UK
Centre for Medical Education, Queen Mary University of London, London, UK.
BMJ Open. 2021 Jan 22;11(1):e040128. doi: 10.1136/bmjopen-2020-040128.
For the first time, this systematic review provides a summary of the literature exploring the relationship between performance in the UK Clinical Aptitude Test (UKCAT) and assessments in undergraduate medical and dental training.
In accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis, relevant studies were identified through systematic literature searches. Electronic searches were carried out on EBSCO, EMBASE, Educational Resources Information Centre, SCOPUS, Web of Knowledge. Studies which included the predictive validity of selection criteria including some element of the UKCAT were considered.
22 papers were identified for inclusion in the study. Four studies describe outcomes from dental programmes with limited results reported. 18 studies reported on relationships between the UKCAT and performance in undergraduate medical training. Of these, 15 studies reported relationships between the UKCAT cognitive tests and undergraduate medical assessments. Weak relationships (r=0.00-0.29) were observed in 14 of these studies; four studies reported some moderate relationships (r=0.30-0.49). The strongest relationships with performance in medical school were observed for the UKCAT total score and the verbal reasoning subtest. Relationships with knowledge-based assessments scores were higher than those for assessments of skills as the outcome. Relationships observed in small (single and double centre studies) were larger than those observed in multicentre studies.
The results indicate that UKCAT scores predict performance in medical school assessments. The relationship is generally weak, although noticeably stronger for both the UKCAT total score and the verbal reasoning subtest. There is some evidence that UKCAT continues to predict performance throughout medical school. We recommend more optimal approaches to future studies. This assessment of existing evidence should assist medical/dental schools in their evaluation of selection processes.
本系统评价首次对探索英国临床能力倾向测验（UKCAT）成绩与本科医学和牙科培训评估之间关系的文献进行总结。
根据系统评价和Meta分析的首选报告项目，通过系统的文献检索确定相关研究。在EBSCO、EMBASE、教育资源信息中心、SCOPUS、知识网络上进行了电子检索。纳入了包括UKCAT某些要素的选拔标准预测效度的研究。
确定了22篇论文纳入本研究。四项研究描述了牙科项目的结果，但报告的结果有限。18项研究报告了UKCAT与本科医学培训成绩之间的关系。其中，15项研究报告了UKCAT认知测试与本科医学评估之间的关系。在这些研究中，14项观察到弱相关性（r = 0.00 - 0.29）；四项研究报告了一些中等程度的相关性（r = 0.30 - 0.49）。UKCAT总分和言语推理子测试与医学院成绩的相关性最强。与基于知识的评估分数的相关性高于作为结果的技能评估分数。在小型研究（单中心和双中心研究）中观察到的相关性大于多中心研究中的相关性。
结果表明UKCAT成绩可预测医学院评估中的表现。这种关系通常较弱，尽管UKCAT总分和言语推理子测试的相关性明显更强。有证据表明UKCAT在整个医学院学习过程中持续预测表现。我们建议未来的研究采用更优化的方法。对现有证据的评估应有助于医学/牙科学院评估选拔过程。
