An Objective Structured Clinical Examination Case for Opioid Management: Standardized Patient Ratings of Communication Skills as a Predictor of Systems-Based Practice Scores.

The Wayne State University Office of Graduate Medical Education (WSUGME) uses an objective structured clinical examination (OSCE) to assess its programs' contribution to enhancing residents' communication skills. In response to revisions in Michigan's opioid-prescribing mandates in 2017, WSUGME developed a pain management case in collaboration with faculty and the Wayne State University School of Medicine to educate residents about these mandates while gauging their skills in Systems-Based Practice (SBP), an Accreditation Council for Graduate Medical Education Core Competency. This study examined whether resident OSCE performance predicted year-end milestones scores in SBP1 (coordinates patient care within various health care delivery settings), SBP2 (works in interdisciplinary teams to enhance patient safety and improve patient care quality), and SBP3 (practices and advocates for cost-effective, responsible care). Participants included two cohorts of first- (PRG-1) and second-year (PRG-2) residents in 6 programs: one cohort from academic year 2018-2019 (n=33), the other from 2019-2020 (n=37). Before the OSCE, WSUGME emailed residents the new state prescription requirements. During the simulated encounter, standardized patients rated residents on a validated communication instrument, and WSUGME conducted a linear regression of patient ratings on resident SBP milestone scores. The ratings of communication skills of PRG-1 residents did not predict any of the year-end SBP milestones. However, ratings of communication skills of PRG-2 residents predicted SBP1 and SBP2, though not SBP3, milestones. The OSCE opioid case proved to be a valid measure of PRG-2 residents' competence gained across the first year but was less meaningful when applied to PRG-1 residents.