Hersh W R, Elliot D L, Hickam D H, Wolf S L, Molnar A, Leichtenstien C
Oregon Health Sciences University, Portland.
Proc Annu Symp Comput Appl Med Care. 1994:895-9. doi: 10.1145/215206.215355.
All of the methods currently used to assess information retrieval (IR) systems have limitations in their ability to measure how well users are able to acquire information. We utilized a new approach to assessing information obtained, based on a short-answer test given to senior medical students. Students took the ten-question test and then searched one of two IR systems on the five questions for which they were least certain of their answer Our results showed that pre-searching scores on the test were low but that searching yielded a high proportion of answers with both systems. These methods are able to measure information obtained, and will be used in subsequent studies to assess differences among IR systems.
目前用于评估信息检索（IR）系统的所有方法在衡量用户获取信息能力方面都存在局限性。我们采用了一种基于对高年级医学生进行的简答题测试来评估所获信息的新方法。学生们参加了十道题的测试，然后在两个IR系统之一中搜索他们最不确定答案的五道题。我们的结果表明，测试前的分数较低，但搜索后两个系统都给出了很高比例的答案。这些方法能够衡量所获信息，并将在后续研究中用于评估IR系统之间的差异。
