Fahim Ayesha, Khan Rehan Ahmed, Sethi Ahsan
Dental Section, University College of Medicine and Dentistry, Lahore, Pakistan.
Islamic International Medical College, Riphah International University, Rawalpindi, Pakistan.
J Dent Educ. 2023 Feb;87(2):158-169. doi: 10.1002/jdd.13113. Epub 2022 Oct 2.
Situational judgment tests (SJT) have been previously used in the admission process of medical and dental undergraduate programs, but their utilization as an assessment tool is fairly new. The objective of this study was to explore essential non-cognitive attributes of dental graduates. We also aimed to assess the attributes of final year dental students utilizing SJT and later collected participants' reactions on the test.
A mixed-method exploratory sequential study was conducted. One-on-one and group discussions were done with subject matter experts (SMEs) to explore the essential attributes of fresh dental graduates. Based on the thematic analysis, 10 SJT items per domain were constructed by one group of SMEs and expert validated by a different group of SMEs and vice versa. The final dental-SJT was piloted online on final year dental students and their perceptions were collected using a five-point Likert scale questionnaire. Descriptive statistics and Cronbach's alpha were calculated for the test.
The consultation with SMEs generated three main themes, namely, Conventional skills, Tribal skills, and Occupational skills. The 70-item dental-SJT piloted on 150 final year dental students revealed data were normally distributed. The internal reliability of test was good (0.738). Students scored highest in "management skills" (>70%) and lowest in "professional ethics" (56%) and "diverse experiences" (58%). The overall student perception about the test was good.
SJT is an effective tool to assess non-cognitive attributes of dental students. It has an overall positive perception about perceived predictive validity, perceived fairness, face and content validity.
情境判断测验(SJT)此前已用于医学和牙科本科项目的招生过程,但其作为一种评估工具的应用相对较新。本研究的目的是探索牙科毕业生的重要非认知属性。我们还旨在利用情境判断测验评估牙科专业最后一年学生的属性,并随后收集参与者对该测试的反应。
进行了一项混合方法探索性序列研究。与主题专家(SMEs)进行了一对一和小组讨论,以探索新毕业牙科学生的基本属性。基于主题分析,一组主题专家构建了每个领域10个情境判断测验项目,并由另一组主题专家进行专家验证,反之亦然。最终的牙科情境判断测验在牙科专业最后一年的学生中进行了在线试点,并使用五点李克特量表问卷收集他们的看法。对该测试计算了描述性统计数据和克朗巴哈系数。
与主题专家的咨询产生了三个主要主题,即传统技能、群体技能和职业技能。在150名牙科专业最后一年的学生中进行试点的70项牙科情境判断测验显示数据呈正态分布。测试的内部信度良好(0.738)。学生在“管理技能”方面得分最高(>70%),在“职业道德”(56%)和“多样经历”(58%)方面得分最低。学生对该测试的总体看法良好。
情境判断测验是评估牙科学生非认知属性的有效工具。它在感知预测效度、感知公平性、表面效度和内容效度方面总体具有积极的看法。