Ketting C H, Austin-Seymour M M, Kalet I J, Jacky J P, Kromhout-Schiro S E, Hummel S M, Unger J M, Fagan L M
Radiation Oncology Dept., University of Washington, Seattle 98195, USA.
Proc Annu Symp Comput Appl Med Care. 1995:683-7.
This paper reports the evaluation of an expert system whose output is a three-dimensional geometric solid. Evaluating such an output emphasizes the problems of establishing a comparison standard, and of identifying and classifying deviations from that standard. Our evaluation design used a panel of physicians for the first task and a separate panel of expert judges for the second. We found that multi-parameter or multi-dimensional expert system outputs, such as this one, may result in lower overall performance scores and increased variation in acceptability to different physicians. We surmise that these effects are a consequence of the higher number of factors which may be deemed unacceptable. The effects appear, however, to be equal for computer and human output. This evaluation design is thus applicable to other expert systems producing similarly complex output.
本文报告了对一个输出为三维几何实体的专家系统的评估。评估这样的输出突出了建立比较标准以及识别和分类与该标准偏差的问题。我们的评估设计在第一项任务中使用了一组医生，在第二项任务中使用了另一组专家评委。我们发现，像这样的多参数或多维度专家系统输出可能会导致总体性能得分较低，并且不同医生的可接受性差异增大。我们推测这些影响是由于可能被视为不可接受的因素数量较多所致。然而，这些影响对于计算机输出和人工输出似乎是相同的。因此，这种评估设计适用于产生类似复杂输出的其他专家系统。
