Sateia Michael J, Reed Virginia A, Christian Jernstedt G
Department of Psychiatry, Dartmouth Medical School, Hanover, NH 03755, USA.
Sleep Med. 2005 Jan;6(1):47-54. doi: 10.1016/j.sleep.2004.07.013. Epub 2004 Dec 25.
To construct and validate an instrument for the purpose of assessing effectiveness of curriculum development and educational interventions in sleep medicine.
Medical school and graduate medical curricula have historically contained quite limited instruction in sleep physiology and sleep medicine. Recent initiatives, particularly the Sleep Academic Award program, have attempted to address this issue through support of programs designed to develop educational resources and implement curriculum change. Effective measures for assessment of educational outcome are an essential component of these interventions.
A panel of sleep experts, other medical professionals, and education consultants developed a knowledge and attitude survey, designed to address a broad range of topics in sleep physiology and medicine. The instrument was modified in response to pilot testing, and a final 24-item survey has been administered to two cohorts of college undergraduates before and immediately following a ten-week course of instruction and to a single cohort of first-year medical students. A group of sleep medicine experts served as the comparison population. Results were analyzed for item difficulty, item discrimination, and instructional sensitivity.
Analyses of item difficulty, item discrimination, and instructional sensitivity were in line with acceptable norms for criterion-referenced tests. There was evidence of discriminative validity, as shown by scores on the measure and acknowledged expertise.
This instrument demonstrates both logical and empirical evidence of validity and may serve as a useful tool in assessing outcome of educational interventions in sleep medicine.
构建并验证一种用于评估睡眠医学课程开发和教育干预效果的工具。
医学院校和毕业后医学教育课程在历史上对睡眠生理学和睡眠医学的教学相当有限。近期的一些举措,尤其是睡眠学术奖计划,试图通过支持旨在开发教育资源和实施课程变革的项目来解决这一问题。评估教育成果的有效措施是这些干预措施的重要组成部分。
一个由睡眠专家、其他医学专业人员和教育顾问组成的小组开发了一项知识和态度调查,旨在涵盖睡眠生理学和医学的广泛主题。该工具根据预测试结果进行了修改,最终的24项调查已在两个大学生群体中实施,分别在为期十周的课程教学之前和之后立即进行,同时也对一个一年级医学生群体进行了调查。一组睡眠医学专家作为对照人群。对结果进行了项目难度、项目区分度和教学敏感性分析。
项目难度、项目区分度和教学敏感性分析符合标准参照测试的可接受规范。有证据表明该测量具有区分效度,如测量得分和公认的专业知识所示。
该工具展示了效度的逻辑和实证证据,可作为评估睡眠医学教育干预结果的有用工具。