When to cut? Using an objective structured clinical examination to evaluate surgical decision-making.

OBJECTIVES

To create an objective structured clinical examination (OSCE) tailored to surgical residents that uses surgical case scenarios appropriate for the experience level of the resident to evaluate whether residents understand the indications for a specific surgery, identify when indications are met, and make the appropriate decision to proceed with an operation.

METHODS

The surgical OSCE consisted of two case scenarios: a junior case created for postgraduate year (PGY) 2 to 3 level residents and a senior case created for PGY 4 to 5 level residents. Four senior residents and four junior residents in the otolaryngology department participated. Residents were instructed to proceed as if they had all the capabilities of the otolaryngology clinic. Recordings were made of each encounter and were reviewed by two separate faculty member with expertise in each case. Faculty evaluated whether surgical indications were elicited by history, whether certain physical examination or radiographic findings were recognized, whether residents made the correct diagnosis, and whether residents not only made the decision to proceed with surgery but also indicated the correct surgery.

RESULTS

Seniors (100%) were better at obtaining needed surgical information and indications than juniors (25%). Seniors were more willing to make the decision to proceed with surgery (100%), whereas no juniors actually scheduled surgery. The reasons for this ranged from failure to elicit surgical indications to lack of surety in proceeding with surgery. All seniors recommended the appropriate surgery, but only 75% correctly identified the need for emergent intervention. Results of evaluations were reviewed with each resident individually.

CONCLUSIONS

The surgical OSCE was successful in evaluating resident surgical decision-making. Juniors were not as capable as seniors in eliciting surgical indications and in "making the jump" to proceed with surgery. These results were used by our faculty to work with juniors on surgical history-taking and decision-making. These results were also useful in identifying seniors who could recognize an emergency situation.