Suppr超能文献

迈向信息检索评估的新方法。

Towards new measures of information retrieval evaluation.

作者信息

Hersh W R, Elliot D L, Hickam D H, Wolf S L, Molnar A, Leichtenstien C

机构信息

Oregon Health Sciences University, Portland.

出版信息

Proc Annu Symp Comput Appl Med Care. 1994:895-9. doi: 10.1145/215206.215355.

Abstract

All of the methods currently used to assess information retrieval (IR) systems have limitations in their ability to measure how well users are able to acquire information. We utilized a new approach to assessing information obtained, based on a short-answer test given to senior medical students. Students took the ten-question test and then searched one of two IR systems on the five questions for which they were least certain of their answer Our results showed that pre-searching scores on the test were low but that searching yielded a high proportion of answers with both systems. These methods are able to measure information obtained, and will be used in subsequent studies to assess differences among IR systems.

摘要

目前用于评估信息检索(IR)系统的所有方法在衡量用户获取信息能力方面都存在局限性。我们采用了一种基于对高年级医学生进行的简答题测试来评估所获信息的新方法。学生们参加了十道题的测试,然后在两个IR系统之一中搜索他们最不确定答案的五道题。我们的结果表明,测试前的分数较低,但搜索后两个系统都给出了很高比例的答案。这些方法能够衡量所获信息,并将在后续研究中用于评估IR系统之间的差异。

相似文献

1
Towards new measures of information retrieval evaluation.
Proc Annu Symp Comput Appl Med Care. 1994:895-9. doi: 10.1145/215206.215355.
2
Factors associated with success in searching MEDLINE and applying evidence to answer clinical questions.
J Am Med Inform Assoc. 2002 May-Jun;9(3):283-93. doi: 10.1197/jamia.m0996.
3
A comparison of two methods for indexing and retrieval from a full-text medical database.
Med Decis Making. 1993 Jul-Sep;13(3):220-6. doi: 10.1177/0272989X9301300308.
6
Do people experience cognitive biases while searching for information?
J Am Med Inform Assoc. 2007 Sep-Oct;14(5):599-608. doi: 10.1197/jamia.M2411. Epub 2007 Jun 28.
7
Do online information retrieval systems help experienced clinicians answer clinical questions?
J Am Med Inform Assoc. 2005 May-Jun;12(3):315-21. doi: 10.1197/jamia.M1717. Epub 2005 Jan 31.
8
Beyond information retrieval--medical question answering.
AMIA Annu Symp Proc. 2006;2006:469-73.
9
On-line search strategies of third year medical students: perception vs fact.
J Surg Res. 1994 Apr;56(4):338-44. doi: 10.1006/jsre.1994.1052.
10
Current status of the evaluation of information retrieval.
J Med Syst. 2003 Oct;27(5):409-24. doi: 10.1023/a:1025603704680.

本文引用的文献

1
A comparison of two methods for indexing and retrieval from a full-text medical database.
Med Decis Making. 1993 Jul-Sep;13(3):220-6. doi: 10.1177/0272989X9301300308.
2
Database access and problem solving in the basic sciences.
Proc Annu Symp Comput Appl Med Care. 1993:678-82.
3
A performance and failure analysis of SAPHIRE with a MEDLINE test collection.
J Am Med Inform Assoc. 1994 Jan-Feb;1(1):51-60. doi: 10.1136/jamia.1994.95236136.
4
Online access to MEDLINE in clinical settings. A study of use and usefulness.
Ann Intern Med. 1990 Jan 1;112(1):78-84. doi: 10.7326/0003-4819-112-1-78.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验