Systematic development of a proctor certification examination for the Fundamentals of Laparoscopic Surgery testing program.

BACKGROUND

The fundamentals of laparoscopic surgery (FLS) examination is administered by proctors around the world. Inconsistent administration represents a threat to test validity. We systematically developed a test to assess the FLS proctors knowledge and skills relating to FLS test administration.

METHODS

Downing's 12 steps for test development were used. subject matter expert's created a job and/or task analysis inventory of the knowledge and skills of an FLS proctor. Using the weighted blueprint, a 45 question examination was created using online testing software and piloted.

RESULTS

The blueprint generated 38 job and/or task analysis items in 4 domains. Items on the test had an average content validity index of .9. The mean score during beta testing was 32 of 45 (71%). Reliability was good at .72. Mean item difficulty and discrimination were .71 and .28, respectively. The cut score was set at 62% resulting in a pass rate of 83%.

CONCLUSIONS

We developed a test representing the skills of the FLS proctor that demonstrates considerable validity evidence. Incorporation of this examination into proctor training should reduce the threats to validity for the FLS examination.