A methodology for evaluation of knowledge-based systems in medicine.

Evaluation is critical to the development and successful integration of knowledge-based systems into their application environment. This is of particular importance in the medical domain--not only for reasons of safety and correctness, but also to reinforce the users' confidence in these systems. In this paper we describe an iterative, four-phased development evaluation cycle covering the following areas: (i) early prototype development, (ii) validity of the system, (iii) functionality of the system, and (iv) impact of the system.