Improving outcomes on the ABS Certifying Examination: can monthly mock orals do it?

PURPOSE

First-time pass rates on the American Board of Surgery Certifying Examination (ABSCE) have now become one of the standards of excellence to evaluate residency programs. Our residency program started monthly simulated and critiqued (verbal, written, and video) oral examinations (MSCE) in 2003. The current study explores the outcomes of this intervention.

METHODS

We evaluated ABSCE performance of 48 residents who graduated from a large academic/community program between the years 2001 and 2006 though a prospective study with historical controls. Residents were divided into 2 groups: The intervention group comprised the 2003 to 2006 classes, which underwent MSCE; the historical control group spanned the 2001 and 2002 classes, which did not undergo MSCE. Results in the ABSCE were compared between groups using the Fisher exact test. In addition, the intervention group was queried in relation to the most important aspects of the MSCE as a learning experience through a structured questionnaire.

RESULTS

A statistically significant improvement (p = 0.038) in ABSCE first-time pass rates was noted in the intervention group. Examinees unanimously asserted they had been helped by the MSCE. Improvements in clinical reasoning and promotion of self-study were the most often cited benefits of the MSCE.

CONCLUSION

Monthly simulated and critiqued oral examinations improved the first-time pass rate of the American Board of Surgery Certifying Examination. Additional perceived benefits of this intervention included improvements in clinical reasoning and promotion of self-study.