E.J. Warm is professor of medicine and program director, Department of Internal Medicine, University of Cincinnati College of Medicine, Cincinnati, Ohio; ORCID: https://orcid.org/0000-0002-6088-2434 .
B. Kinnear is associate professor of medicine and pediatrics and associate program director, Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio; ORCID: https://orcid.org/0000-0003-0052-4130 .
Acad Med. 2022 Feb 1;97(2):193-199. doi: 10.1097/ACM.0000000000004215.
Once medical students attain a certain level of medical knowledge, success in residency often depends on noncognitive attributes, such as conscientiousness, empathy, and grit. These traits are significantly more difficult to assess than cognitive performance, creating a potential gap in measurement. Despite its promise, competency-based medical education (CBME) has yet to bridge this gap, partly due to a lack of well-defined noncognitive observable behaviors that assessors and educators can use in formative and summative assessment. As a result, typical undergraduate to graduate medical education handovers stress standardized test scores, and program directors trust little of the remaining information they receive, sometimes turning to third-party companies to better describe potential residency candidates. The authors have created a list of noncognitive attributes, with associated definitions and noncognitive skills-called observable practice activities (OPAs)-written for learners across the continuum to help educators collect assessment data that can be turned into valuable information. OPAs are discrete work-based assessment elements collected over time and mapped to larger structures, such as milestones, entrustable professional activities, or competencies, to create learning trajectories for formative and summative decisions. Medical schools and graduate medical education programs could adapt these OPAs or determine ways to create new ones specific to their own contexts. Once OPAs are created, programs will have to find effective ways to assess them, interpret the data, determine consequence validity, and communicate information to learners and institutions. The authors discuss the need for culture change surrounding assessment-even for the adoption of behavior-based tools such as OPAs-including grounding the work in a growth mindset and the broad underpinnings of CBME. Ultimately, improving assessment of noncognitive capacity should benefit learners, schools, programs, and most importantly, patients.
一旦医学生获得了一定水平的医学知识,住院医师的成功往往取决于非认知属性,如尽责、同理心和毅力。这些特征比认知表现更难评估,这就造成了衡量标准上的潜在差距。尽管基于能力的医学教育(CBME)有很大的前景,但它尚未弥合这一差距,部分原因是缺乏评估员和教育者可以在形成性和总结性评估中使用的明确界定的非认知可观察行为。因此,从本科到研究生的典型医学教育交接强调标准化考试成绩,项目负责人对他们收到的其余信息几乎没有信任,有时会求助于第三方公司来更好地描述潜在的住院医师候选人。作者创建了一份非认知属性列表,以及相关的定义和非认知技能,称为可观察的实践活动(OPAs),为整个学习过程中的学习者编写,以帮助教育者收集可以转化为有价值信息的评估数据。OPA 是随着时间的推移收集的离散工作评估要素,并映射到更大的结构,如里程碑、可委托的专业活动或能力,以创建形成性和总结性决策的学习轨迹。医学院和研究生医学教育项目可以采用这些 OPA,也可以确定针对自身情况创建新的 OPA 的方法。一旦创建了 OPA,项目就必须找到评估它们的有效方法,解释数据,确定后果有效性,并将信息传达给学习者和机构。作者讨论了围绕评估进行文化变革的必要性,即使是采用 OPA 等基于行为的工具也需要进行文化变革,包括将工作建立在成长型思维和 CBME 的广泛基础之上。最终,提高对非认知能力的评估应该使学习者、学校、项目,最重要的是,使患者受益。