Unit of Oral Surgery and Medicine, University of Dundee Dental School, Dundee, UK.
Eur J Dent Educ. 2011 Nov;15(4):244-9. doi: 10.1111/j.1600-0579.2010.00665.x. Epub 2011 Jan 31.
The assessment of clinical skills is essential to determine whether an undergraduate is competent to perform the tasks outlined in the curriculum. Such assessments in dentistry have historically not been subjected to large scale validity and reliability testing due the relatively small student numbers at each institute. The aims of this study were to test the validity and reliability of a standardised, checklist-based, suturing objective structured clinical examination (OSCE) and then to perform a multicentre trial to determine its performance over a large cohort of students.
A total of seven UK schools agreed to take part in the trial. To test the validity and reliability of the checklist, the examiner at each institution reviewed and scored video footage of 10 students performing the assessment. Each institution then carried out the assessment providing a checklist score and a global score for each of their own students.
The assessment was well received by the staff, with acceptable inter-examiner variability. In total, 496 students completed the suturing OSCE with a success rate of 81% with a variation between schools of between 66% and 96%. A significant correlation was found between the checklist score and the global score (r = 0.361, P = 0.000). No one item on the checklist was found to be a determinant factor in the outcome of the OSCE.
This checklist-based assessment of suturing skills was found to have face and content validity. Its reliability was promising, but merits further investigation. There may be an argument for the standardisation of the assessment of this core surgical skill throughout several UK-based dental schools.
评估临床技能对于确定本科生是否有能力完成课程大纲中规定的任务至关重要。由于每个学院的学生人数相对较少，因此历史上，牙科的此类评估并未经过大规模的有效性和可靠性测试。本研究的目的是测试基于标准化检查表的缝合客观结构化临床考试（OSCE）的有效性和可靠性，然后进行多中心试验，以确定其在大量学生中的表现。
共有七所英国学校同意参加这项试验。为了测试检查表的有效性和可靠性，每个机构的考官审查并对 10 名学生进行评估的视频片段进行评分。然后，每个机构进行评估，为自己的每个学生提供检查表分数和全球分数。
该评估受到工作人员的欢迎，具有可接受的考官间变异性。共有 496 名学生完成了缝合 OSCE，成功率为 81%，学校之间的成功率在 66%至 96%之间存在差异。发现检查表分数和全球分数之间存在显著相关性（r = 0.361，P = 0.000）。检查表上没有一个项目被发现是 OSCE 结果的决定因素。
发现基于检查表的缝合技能评估具有表面有效性和内容有效性。其可靠性很有希望，但值得进一步研究。在几个英国牙科学校之间，可能需要对这种核心手术技能的评估进行标准化。
