Artificial neural networks as adjuncts for assessing medical students' problem solving performances on computer-based simulations.

Artificial neural networks were trained by supervised learning to recognize the test selection patterns associated with students' successful solutions to seven immunology computer-based simulations. New test selection patterns evaluated by the trained neural network were correctly classified as successful or unsuccessful solutions to the problem > 90% of the time. The examination of the neural networks output weights after each test selection revealed a progressive and selective increase for the relevant problem suggesting that a successful solution is represented by the neural network as the accumulation of relevant tests. Unsuccessful problem solutions were classified by the neural network software into two patterns of students performance. The first pattern was characterized by low neural network output weights for all seven problems reflecting extensive searching and lack of recognition of relevant information. In the second pattern, the output weights from the neural network were biased toward one of the remaining six incorrect problems suggesting that the student misrepresented the current problem as an instance of a previous problem. Finally, neural network analysis could detect cases where the students switched hypotheses during the problem solving exercises.