Evaluation of computer advisor in the interpretation of CT images of the head.

This paper describes the evaluation of a computer advisor system (BRAINS), which was constructed to aid in the interpretation of CT images of the head. It was developed at the National Hospital for Nervous Diseases, Queen Square, London. The system was transferred, without difficulty, to an 'external', that is previously unassociated, site (the Department of Diagnostic Radiology, University of Manchester) for an external evaluation. Response of external users to the system was mixed. Many were unfamiliar with the concept of formal description of images and the evaluation demonstrated the need for a person to person training programme. Users who accessed the HELP facilities most frequently were the most successful in obtaining accurate descriptions and hence satisfactory diagnostic advice. An objective appraisal of user's success in describing images to obtain the correct diagnosis as first choice indicated that, in general, the system performed well.