Wilcox A, Hripcsak G, Johnson S B, Hwang J J, Wu M
Department of Medical Informatics, Columbia University, New York, USA.
Comput Biomed Res. 1998 Apr;31(2):112-21. doi: 10.1006/cbmr.1998.1470.
We investigate a knowledge-based help system for developers of an integrated clinical information system (CIS). The first objective in the study was to determine the system's ability to answer users' questions effectively. User performance and behavior were studied. The second objective was to evaluate the effect of using questions and answers to augment or replace traditional program documentation.
A comparative study of user and system effectiveness using a collection of 47 veritable questions regarding the CIS, solicited from various CIS developers, is conducted. Most questions were concerning the clinical data model and acquiring the data.
Answers using current documentation known by users were compared to answers found using the help system. Answers existing within traditional documentation were compared to answers existing within question-answer exchanges (Q-A's).
The support system augmented 39% of users' answers to test questions. Though the Q-A's were less than 5% of the total documentation collected, these files contained answers to nearly 50% of the questions in the test group. The rest of the documentation contained about 75% of the answers.
A knowledge-based help system built by collecting questions and answers can be a viable alternative to large documentation files, providing the questions and answers can be collected effectively.
我们针对集成临床信息系统(CIS)的开发者研究了一个基于知识的帮助系统。该研究的首要目标是确定该系统有效回答用户问题的能力。对用户的表现和行为进行了研究。第二个目标是评估使用问答来扩充或取代传统程序文档的效果。
利用从不同CIS开发者那里征集到的47个关于CIS的真实问题进行了一项关于用户和系统有效性的对比研究。大多数问题涉及临床数据模型和数据获取。
将用户已知的当前文档所给出的答案与使用帮助系统找到的答案进行比较。将传统文档中已有的答案与问答交流(Q-A)中存在的答案进行比较。
支持系统使39%的用户对测试问题的回答得到了扩充。尽管问答内容不到所收集的全部文档的5%,但这些文件包含了测试组中近50%问题的答案。其余文档包含了约75%的答案。
通过收集问题和答案构建的基于知识的帮助系统可以成为大型文档文件的一个可行替代方案,前提是能够有效地收集问题和答案。