K. Kirley is director of chronic disease prevention, Improving Health Outcomes, American Medical Association, Chicago, Illinois.
R. Hayer is senior program manager, Improving Health Outcomes, American Medical Association, Chicago, Illinois.
Acad Med. 2020 Nov;95(11S Association of American Medical Colleges Learn Serve Lead: Proceedings of the 59th Annual Research in Medical Education Presentations):S44-S50. doi: 10.1097/ACM.0000000000003640.
This study gathers validity evidence of an expanded History and Physical examination (H&P 360) to address chronic diseases through incorporation of biopsychosocial elements that are lacking in traditional H&P assessments via a multisite randomized controlled trial among medical students.
Third- and fourth-year medical students (n = 159) at 4 schools participated in an Objective Structured Clinical Examination designed with 2 cases for chronic disease. Students were randomized into the treatment group, which involved brief written instructions on how to use the H&P 360 followed by a standardized patient (SP) interaction, or the control group, which used the traditional H&P in an SP interaction without additional instructions. Validity evidence was gathered for content (alignment with an empirically derived expanded history list), response process (feedback from raters and learners on the process), internal structure (reliability and item-level psychometrics), relations to other variables (comparison between treatment and control groups), and consequences (survey results from learners on experience).
H&P 360 items were blueprinted by faculty experts. SP observation checklist grading was consistent, and postassessment debrief confirmed favorable educational experience among learners. The reliability of the H&P 360 was .76. Overall mean scores on the H&P 360 content (mean = 15.96, standard deviation [SD] = 3.66) were significantly higher compared with the traditional H&P (mean = 10.99, SD = 2.69, Cohen's d = 1.17, P < .001).
Medical students using the H&P 360 collected significantly more biopsychosocial information compared with students using the traditional H&P, providing empirical support for teaching and assessing biopsychosocial information. The assessment demonstrated strong validity evidence supporting the use of the H&P 360 assessment in medical schools.
本研究通过纳入传统体格检查评估中缺乏的生物心理社会要素,收集经过扩充的病史和体格检查(H&P 360)的有效性证据,以解决慢性病问题。该研究通过一项在医学生中开展的多站点随机对照试验进行。
来自 4 所学校的三、四年级医学生(n = 159)参加了一项设计有 2 个慢性病病例的客观结构化临床考试。学生被随机分为治疗组和对照组。治疗组学生接受了关于如何使用 H&P 360 的简短书面说明,随后与标准化患者(SP)进行互动;对照组学生则在 SP 互动中使用传统的 H&P,没有额外的说明。通过内容(与经验证的扩充病史清单的一致性)、反应过程(评估者和学习者对过程的反馈)、内部结构(可靠性和项目水平心理测量学)、与其他变量的关系(治疗组和对照组之间的比较)以及结果(学习者对体验的调查结果)来收集有效性证据。
H&P 360 项目由教师专家制定蓝图。SP 观察检查表评分一致,且评估后讨论确认了学习者的良好教育体验。H&P 360 的可靠性为.76。H&P 360 内容的总平均分(均值 = 15.96,标准差 [SD] = 3.66)显著高于传统 H&P(均值 = 10.99,SD = 2.69,Cohen's d = 1.17,P <.001)。
与使用传统 H&P 的学生相比,使用 H&P 360 的医学生收集的生物心理社会信息明显更多,为教授和评估生物心理社会信息提供了实证支持。该评估提供了强有力的有效性证据,支持在医学院校中使用 H&P 360 评估。