University of Cambridge, Free School Lane, Cambridge, UK.
Br Dent J. 2012 Jul 13;213(1):23-6. doi: 10.1038/sj.bdj.2012.560.
To pilot and evaluate a machine-markable situational judgement test (SJT) designed to select candidates into UK dental foundation training.
Single centre pilot study.
UK postgraduate deanery in 2010.
Seventy-four candidates attending interview for dental foundation training in Oxford and Wessex Deaneries volunteered to complete the situational judgement test.
The situational judgement test was developed to assess relevant professional attributes for dentistry (for example, empathy and integrity) in a machine-markable format. Test content was developed by subject matter experts working with experienced psychometricians.
Evaluation of psychometric properties of the pilot situational judgement test (for example, reliability, validity and fairness). Scores in the dental foundation training selection process (short-listing and interviews) were used to examine criterion-related validity. Candidates completed an evaluation questionnaire to examine candidate reactions and face validity of the new test.
Forty-six candidates were female and 28 male; mean age was 23.5-years-old (range 22-32). Situational judgement test scores were normally distributed and the test showed good internal reliability when corrected for test length (α = 0.74). Situational judgement test scores positively correlated with the management, leadership and professionalism interview (N = 50; r = 0.43, p <0.01) but not with the clinical skills interview, providing initial evidence of criterion-related validity as the situational judgement test is designed to test non-cognitive professional attributes beyond clinical knowledge. Most candidates perceived the situational judgement test as relevant to dentistry, appropriate for their training level, and fair.
This initial pilot study suggests that a situational judgement test is an appropriate and innovative method to measure professional attributes (eg empathy and integrity) for selection into foundation training. Further research will explore the long-term predictive validity of the situational judgement test once candidates have entered training.
试点并评估一种旨在选拔英国牙科基础培训候选人的机器可标记情境判断测试 (SJT)。
单中心试点研究。
2010 年英国研究生学系。
74 名参加牛津和威塞克斯学系牙科基础培训面试的候选人自愿完成情境判断测试。
情境判断测试旨在以机器可标记的格式评估与牙科相关的专业属性（例如同理心和诚信）。测试内容由与经验丰富的心理计量学家合作的主题专家开发。
评估试点情境判断测试的心理测量学特性（例如可靠性、有效性和公平性）。在牙科基础培训选拔过程（入围和面试）中的分数用于检验效标关联效度。候选人完成了一份评估问卷，以检验新测试的候选人反应和表面有效性。
46 名女性和 28 名男性；平均年龄为 23.5 岁（范围 22-32 岁）。情境判断测试分数呈正态分布，当校正测试长度时，测试显示出良好的内部可靠性（α=0.74）。情境判断测试分数与管理、领导力和专业精神面试呈正相关（N=50；r=0.43，p<0.01），但与临床技能面试无关，初步证明情境判断测试具有效标关联效度，因为情境判断测试旨在测试超出临床知识的非认知专业属性。大多数候选人认为情境判断测试与牙科相关，适合他们的培训水平，并且公平。
这项初步试点研究表明，情境判断测试是一种衡量基础培训选拔中专业属性（例如同理心和诚信）的适当且创新的方法。进一步的研究将探索情境判断测试在候选人进入培训后长期的预测有效性。
