Times of Medical Education Crisis Require New Evaluation Approaches: Proof of Concept of a System-Based Program Evaluation Model.

There are no program evaluation approaches designed for a crisis, such as the COVID-19 pandemic. It is critical to evaluate the educational impact of COVID-19 to keep administrators informed and guide decision-making. The authors used systems thinking to design an evaluation model. The evaluation results suggest complex interactions between individuals and course level changes due to COVID-19. Specifically, year 1-2 students found more education metrics lacking relative to year 3-4 students, faculty, and course directors. There was no consensus for the value of similar instructional/assessment adaptations. The evaluation model can be adapted by other medical schools to fit systems-based needs.