评估外科实习医生解决问题能力时客观结构化临床考试心理测量学特性的改进。

Improvement of psychometric properties of the objective structured clinical examination when assessing problem solving skills of surgical clerkship.

作者信息

Al-Naami Mohammed Y, El-Tinay Omer F, Khairy Gamal A, Mofti Safdar S, Anjum Muhammad N

机构信息

Teaching, Learning, and Assessment Program, King Saud University, and the Gastrointestinal and Bariatric Surgery Unit, Department of Surgery #37, King Saud University, PO Box 7805, Riyadh 11472, Kingdom of Saudi Arabia.

出版信息

Saudi Med J. 2011 Mar;32(3):300-4.

PMID:21384068

Abstract

OBJECTIVE

To improve the psychometric properties of the objective structured clinical examination (OSCE) and elevate staff motivation.

METHODS

The OSCE was conducted in May 2006 at the Department of Surgery, King Saud University, Riyadh, Saudi Arabia as a pilot study for 95 students split over 2 consecutive days lasting 120 minutes each day. There were 15 actual stations on each day consisting of 10 stations that addressed problem solving skills, and 5 addressed clinical skills testing.

RESULTS

The stability of the OSCE measured by Cronbach's alpha on day one was 0.87, and 0.88 on day 2. The internal consistency of the OSCE measured by Carmine's theta on day one was 0.76, and 0.79 on day 2. Overall, OSCE's reliability for each day was high (r=0.8), without a significant difference between the 2 days. Credibility and comprehensiveness of the the OSCE were considered good by both staff and students. Accuracy of the OSCE measured by Pearson's correlation with multiple choice question scores was 0.65. Feasibility of the OSCE has also improved remarkably compared with previous OSCEs.

CONCLUSION

The OSCE proved to be highly reliable, and a valid format when more problem solving skills testing has been emphasized for the final year surgical clerkship. Feasibility has also improved remarkably after using this strategy, marked by more staff participation and enthusiasm.

摘要

目的

改善客观结构化临床考试（OSCE）的心理测量特性并提高工作人员的积极性。

方法

2006年5月，在沙特阿拉伯利雅得的沙特国王大学外科进行了OSCE，作为一项试点研究，95名学生分连续两天进行，每天持续120分钟。每天有15个实际考站，其中10个考站考查问题解决能力，5个考站考查临床技能。

结果

用克朗巴哈系数（Cronbach's alpha）衡量的OSCE第一天的稳定性为0.87，第二天为0.88。用卡迈恩系数（Carmine's theta）衡量的OSCE第一天的内部一致性为0.76，第二天为0.79。总体而言，OSCE每天的可靠性都很高（r = 0.8），两天之间无显著差异。工作人员和学生都认为OSCE的可信度和全面性良好。用皮尔逊相关性衡量的OSCE与多项选择题分数的准确性为0.65。与以前的OSCE相比，OSCE的可行性也有了显著提高。